[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:02:12.449988  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:40495
I20260709 13:02:12.451530  7005 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:02:12.452551  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:12.469714  7012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:12.470161  7014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:12.472321  7005 server_base.cc:1061] running on GCE node
W20260709 13:02:12.470435  7011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.605180  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:13.605463  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:13.605618  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602133605603 us; error 0 us; skew 500 ppm
I20260709 13:02:13.606666  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:13.613535  7005 webserver.cc:533] Webserver started at http://127.6.215.126:45259/ using document root <none> and password file <none>
I20260709 13:02:13.614394  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:13.614599  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:13.615020  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:13.620692  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "6c0856ac398745fe9db4a1305ad3ed8c"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-r31z"
I20260709 13:02:13.628428  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:13.633882  7020 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.635459  7005 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:02:13.635838  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "6c0856ac398745fe9db4a1305ad3ed8c"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-r31z"
I20260709 13:02:13.636152  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:13.698529  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:13.700309  7005 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:02:13.700809  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:13.774044  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:40495
I20260709 13:02:13.774276  7071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:40495 every 8 connection(s)
I20260709 13:02:13.781450  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.804770  7072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c: Bootstrap starting.
I20260709 13:02:13.810494  7072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.812254  7072 log.cc:826] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c: Log is configured to *not* fsync() on all Append() calls
I20260709 13:02:13.817075  7072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c: No bootstrap required, opened a new log
I20260709 13:02:13.837296  7072 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" member_type: VOTER }
I20260709 13:02:13.837908  7072 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.838161  7072 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0856ac398745fe9db4a1305ad3ed8c, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.838969  7072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" member_type: VOTER }
I20260709 13:02:13.839452  7072 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:13.839690  7072 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:13.839963  7072 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.844121  7072 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" member_type: VOTER }
I20260709 13:02:13.844785  7072 leader_election.cc:304] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c0856ac398745fe9db4a1305ad3ed8c; no voters: 
I20260709 13:02:13.846383  7072 leader_election.cc:290] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:13.846705  7075 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:13.848706  7075 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 1 LEADER]: Becoming Leader. State: Replica: 6c0856ac398745fe9db4a1305ad3ed8c, State: Running, Role: LEADER
I20260709 13:02:13.849618  7075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" member_type: VOTER }
I20260709 13:02:13.850629  7072 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:13.861953  7077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" member_type: VOTER } }
I20260709 13:02:13.862243  7076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c0856ac398745fe9db4a1305ad3ed8c. Latest consensus state: current_term: 1 leader_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0856ac398745fe9db4a1305ad3ed8c" member_type: VOTER } }
I20260709 13:02:13.862732  7077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:13.862738  7076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:13.865384  7085 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:13.876505  7085 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:13.879287  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:13.892716  7085 catalog_manager.cc:1383] Generated new cluster ID: b3515bc62a914dfbb3b1a65dc0a97378
I20260709 13:02:13.893031  7085 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:13.909641  7085 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:13.911206  7085 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:13.939605  7085 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c: Generated new TSK 0
I20260709 13:02:13.941218  7085 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:14.010089  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:14.018184  7094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.019428  7095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.023654  7005 server_base.cc:1061] running on GCE node
W20260709 13:02:14.023834  7097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.024935  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:14.025203  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:14.025440  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602134025423 us; error 0 us; skew 500 ppm
I20260709 13:02:14.026206  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:14.030179  7005 webserver.cc:533] Webserver started at http://127.6.215.65:37953/ using document root <none> and password file <none>
I20260709 13:02:14.030855  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:14.031101  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:14.031441  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:14.032881  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "bf645723685c4cf28c0e927e7f5ebd93"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-r31z"
I20260709 13:02:14.039791  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.006s
I20260709 13:02:14.044828  7102 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.045617  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:02:14.045889  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "bf645723685c4cf28c0e927e7f5ebd93"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-r31z"
I20260709 13:02:14.046178  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:14.063023  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:14.064643  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:14.066979  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:14.071719  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:14.071965  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.072198  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:14.072361  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.164319  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:37191
I20260709 13:02:14.164391  7164 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:37191 every 8 connection(s)
I20260709 13:02:14.171839  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:14.181854  7169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.185220  7170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.193771  7172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.199275  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:14.200287  7165 heartbeater.cc:344] Connected to a master server at 127.6.215.126:40495
I20260709 13:02:14.200523  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:14.200796  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:14.200939  7165 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:14.201097  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602134201065 us; error 0 us; skew 500 ppm
I20260709 13:02:14.202360  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:14.202832  7165 heartbeater.cc:507] Master 127.6.215.126:40495 requested a full tablet report, sending...
I20260709 13:02:14.206516  7037 ts_manager.cc:194] Registered new tserver with Master: bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191)
I20260709 13:02:14.209002  7005 webserver.cc:533] Webserver started at http://127.6.215.66:45645/ using document root <none> and password file <none>
I20260709 13:02:14.209586  7037 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53754
I20260709 13:02:14.209681  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:14.210062  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:14.210415  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:14.211894  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "da851454051846b1a0b043afcb3e9291"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-r31z"
I20260709 13:02:14.218451  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.007s
I20260709 13:02:14.222729  7177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.223699  7005 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:02:14.223965  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "da851454051846b1a0b043afcb3e9291"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-r31z"
I20260709 13:02:14.224208  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:14.240206  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:14.241428  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:14.243680  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:14.246729  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:14.246899  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.247123  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:14.247265  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.340212  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:42515
I20260709 13:02:14.340478  7239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:42515 every 8 connection(s)
I20260709 13:02:14.346110  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:14.356612  7244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.357323  7243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.364804  7005 server_base.cc:1061] running on GCE node
W20260709 13:02:14.366077  7247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.367122  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:14.367327  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:14.367378  7240 heartbeater.cc:344] Connected to a master server at 127.6.215.126:40495
I20260709 13:02:14.367524  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602134367506 us; error 0 us; skew 500 ppm
I20260709 13:02:14.367779  7240 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:14.368134  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:14.368652  7240 heartbeater.cc:507] Master 127.6.215.126:40495 requested a full tablet report, sending...
I20260709 13:02:14.370842  7005 webserver.cc:533] Webserver started at http://127.6.215.67:35741/ using document root <none> and password file <none>
I20260709 13:02:14.371057  7037 ts_manager.cc:194] Registered new tserver with Master: da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:14.371321  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:14.371573  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:14.371847  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:14.372735  7037 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53762
I20260709 13:02:14.372944  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "1f6889e296e64aa8965a17175dd0691f"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-r31z"
I20260709 13:02:14.377285  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:02:14.381044  7251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.381806  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:14.382133  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "1f6889e296e64aa8965a17175dd0691f"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-r31z"
I20260709 13:02:14.382483  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:14.411427  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:14.412968  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:14.416064  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:14.419946  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:14.420229  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.420502  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:14.420701  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.507145  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:35103
I20260709 13:02:14.507225  7313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:35103 every 8 connection(s)
I20260709 13:02:14.525861  7314 heartbeater.cc:344] Connected to a master server at 127.6.215.126:40495
I20260709 13:02:14.526221  7314 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:14.526932  7314 heartbeater.cc:507] Master 127.6.215.126:40495 requested a full tablet report, sending...
I20260709 13:02:14.528718  7037 ts_manager.cc:194] Registered new tserver with Master: 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:14.528901  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014954471s
I20260709 13:02:14.530031  7037 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53766
I20260709 13:02:14.584592  7037 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53776:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:14.588619  7037 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:14.690544  7130 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf12fc202f24f838edc3e9f64070a62 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:14.691727  7127 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce25b5ab4f435a8c7151d84d895b16 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:14.693614  7130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf12fc202f24f838edc3e9f64070a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.692101  7128 tablet_service.cc:1511] Processing CreateTablet for tablet d05c1b06299e4f849af3d9fd30557015 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:14.690563  7129 tablet_service.cc:1511] Processing CreateTablet for tablet 5549324d1b9245ce8af265ab264ee439 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:14.699337  7126 tablet_service.cc:1511] Processing CreateTablet for tablet 507624b34d3d4637969f13db4bab16e6 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:14.700362  7127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce25b5ab4f435a8c7151d84d895b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.704183  7129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5549324d1b9245ce8af265ab264ee439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.703446  7125 tablet_service.cc:1511] Processing CreateTablet for tablet 33ab222d664349a0aef7aafe15febbd4 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:14.706264  7126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507624b34d3d4637969f13db4bab16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.708557  7125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ab222d664349a0aef7aafe15febbd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.712538  7124 tablet_service.cc:1511] Processing CreateTablet for tablet f96dd77d22de4acd84586bdf6fdb6495 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:14.713095  7128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c1b06299e4f849af3d9fd30557015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.717208  7124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96dd77d22de4acd84586bdf6fdb6495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.720656  7123 tablet_service.cc:1511] Processing CreateTablet for tablet e88fe7b57e134639b5b247d009a7dcca (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:14.725380  7123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88fe7b57e134639b5b247d009a7dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.742717  7278 tablet_service.cc:1511] Processing CreateTablet for tablet 5549324d1b9245ce8af265ab264ee439 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:14.744699  7278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5549324d1b9245ce8af265ab264ee439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.749372  7275 tablet_service.cc:1511] Processing CreateTablet for tablet 507624b34d3d4637969f13db4bab16e6 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:14.758239  7276 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce25b5ab4f435a8c7151d84d895b16 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:14.760372  7279 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf12fc202f24f838edc3e9f64070a62 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:14.760463  7274 tablet_service.cc:1511] Processing CreateTablet for tablet 33ab222d664349a0aef7aafe15febbd4 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:14.756688  7273 tablet_service.cc:1511] Processing CreateTablet for tablet f96dd77d22de4acd84586bdf6fdb6495 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:14.763101  7122 tablet_service.cc:1511] Processing CreateTablet for tablet f41d2e54cb0c41fcbb80ea83d5a6926e (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:14.759593  7277 tablet_service.cc:1511] Processing CreateTablet for tablet d05c1b06299e4f849af3d9fd30557015 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:14.765653  7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507624b34d3d4637969f13db4bab16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.775033  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41d2e54cb0c41fcbb80ea83d5a6926e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.782927  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce25b5ab4f435a8c7151d84d895b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.787360  7205 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf12fc202f24f838edc3e9f64070a62 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:14.788584  7199 tablet_service.cc:1511] Processing CreateTablet for tablet f96dd77d22de4acd84586bdf6fdb6495 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:14.793833  7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c1b06299e4f849af3d9fd30557015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.790666  7272 tablet_service.cc:1511] Processing CreateTablet for tablet e88fe7b57e134639b5b247d009a7dcca (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:14.792752  7204 tablet_service.cc:1511] Processing CreateTablet for tablet 5549324d1b9245ce8af265ab264ee439 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:14.800889  7199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96dd77d22de4acd84586bdf6fdb6495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.800220  7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ab222d664349a0aef7aafe15febbd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.797812  7201 tablet_service.cc:1511] Processing CreateTablet for tablet 507624b34d3d4637969f13db4bab16e6 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:14.806313  7205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf12fc202f24f838edc3e9f64070a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.805142  7202 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce25b5ab4f435a8c7151d84d895b16 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:14.796066  7203 tablet_service.cc:1511] Processing CreateTablet for tablet d05c1b06299e4f849af3d9fd30557015 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:14.807092  7198 tablet_service.cc:1511] Processing CreateTablet for tablet e88fe7b57e134639b5b247d009a7dcca (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:14.811728  7200 tablet_service.cc:1511] Processing CreateTablet for tablet 33ab222d664349a0aef7aafe15febbd4 (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:14.806945  7197 tablet_service.cc:1511] Processing CreateTablet for tablet f41d2e54cb0c41fcbb80ea83d5a6926e (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:14.814994  7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96dd77d22de4acd84586bdf6fdb6495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.816664  7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88fe7b57e134639b5b247d009a7dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.821070  7204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5549324d1b9245ce8af265ab264ee439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.832008  7202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce25b5ab4f435a8c7151d84d895b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.842725  7201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507624b34d3d4637969f13db4bab16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.845155  7198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88fe7b57e134639b5b247d009a7dcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.846678  7203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05c1b06299e4f849af3d9fd30557015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.850112  7197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41d2e54cb0c41fcbb80ea83d5a6926e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.848855  7279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf12fc202f24f838edc3e9f64070a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.854367  7200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ab222d664349a0aef7aafe15febbd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.845904  7271 tablet_service.cc:1511] Processing CreateTablet for tablet f41d2e54cb0c41fcbb80ea83d5a6926e (DEFAULT_TABLE table=test-workload [id=f16c0002c5e642429430d3355f297ef2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:14.861143  7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41d2e54cb0c41fcbb80ea83d5a6926e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:14.916405  7084 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:14.986835  7332 tablet_bootstrap.cc:492] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.022485  7332 tablet_bootstrap.cc:654] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.060410  7333 tablet_bootstrap.cc:492] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.065418  7334 tablet_bootstrap.cc:492] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.088284  7333 tablet_bootstrap.cc:654] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.088990  7332 tablet_bootstrap.cc:492] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.093917  7332 ts_tablet_manager.cc:1403] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.004s
I20260709 13:02:15.096155  7334 tablet_bootstrap.cc:654] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.096196  7332 raft_consensus.cc:359] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.096992  7332 raft_consensus.cc:385] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.097213  7332 raft_consensus.cc:740] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.097925  7332 consensus_queue.cc:260] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.104240  7333 tablet_bootstrap.cc:492] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.104794  7333 ts_tablet_manager.cc:1403] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.005s
I20260709 13:02:15.108181  7333 raft_consensus.cc:359] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.109139  7333 raft_consensus.cc:385] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.109530  7333 raft_consensus.cc:740] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.110813  7333 consensus_queue.cc:260] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.113283  7334 tablet_bootstrap.cc:492] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.113915  7334 ts_tablet_manager.cc:1403] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.019s
I20260709 13:02:15.115422  7165 heartbeater.cc:499] Master 127.6.215.126:40495 was elected leader, sending a full tablet report...
I20260709 13:02:15.115882  7332 ts_tablet_manager.cc:1434] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:02:15.117442  7332 tablet_bootstrap.cc:492] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.117971  7240 heartbeater.cc:499] Master 127.6.215.126:40495 was elected leader, sending a full tablet report...
I20260709 13:02:15.118701  7333 ts_tablet_manager.cc:1434] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:02:15.119666  7333 tablet_bootstrap.cc:492] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.121579  7334 raft_consensus.cc:359] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.122264  7334 raft_consensus.cc:385] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.122552  7334 raft_consensus.cc:740] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.123250  7334 consensus_queue.cc:260] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.126379  7333 tablet_bootstrap.cc:654] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.134517  7332 tablet_bootstrap.cc:654] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.138682  7333 tablet_bootstrap.cc:492] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.139262  7333 ts_tablet_manager.cc:1403] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:02:15.142374  7333 raft_consensus.cc:359] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.143194  7333 raft_consensus.cc:385] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.143549  7333 raft_consensus.cc:740] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.144397  7333 consensus_queue.cc:260] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.147586  7333 ts_tablet_manager.cc:1434] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:15.148599  7333 tablet_bootstrap.cc:492] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.153431  7332 tablet_bootstrap.cc:492] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.154052  7332 ts_tablet_manager.cc:1403] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.010s
I20260709 13:02:15.156764  7332 raft_consensus.cc:359] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.157478  7332 raft_consensus.cc:385] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.157770  7332 raft_consensus.cc:740] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.162469  7314 heartbeater.cc:499] Master 127.6.215.126:40495 was elected leader, sending a full tablet report...
I20260709 13:02:15.163021  7334 ts_tablet_manager.cc:1434] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.049s	user 0.021s	sys 0.023s
I20260709 13:02:15.164034  7334 tablet_bootstrap.cc:492] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.164052  7332 consensus_queue.cc:260] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.167385  7332 ts_tablet_manager.cc:1434] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:02:15.168161  7333 tablet_bootstrap.cc:654] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.168704  7332 tablet_bootstrap.cc:492] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.170183  7334 tablet_bootstrap.cc:654] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:15.171538  7166 tablet.cc:2406] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:15.175652  7332 tablet_bootstrap.cc:654] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.183719  7333 tablet_bootstrap.cc:492] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.184238  7333 ts_tablet_manager.cc:1403] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.008s
I20260709 13:02:15.188129  7333 raft_consensus.cc:359] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.188974  7333 raft_consensus.cc:385] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.189304  7333 raft_consensus.cc:740] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.191581  7334 tablet_bootstrap.cc:492] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.192621  7334 ts_tablet_manager.cc:1403] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.009s
I20260709 13:02:15.192375  7333 consensus_queue.cc:260] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.194878  7333 ts_tablet_manager.cc:1434] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:02:15.195744  7333 tablet_bootstrap.cc:492] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.195521  7334 raft_consensus.cc:359] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.196197  7334 raft_consensus.cc:385] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.196486  7334 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.197290  7334 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.199561  7334 ts_tablet_manager.cc:1434] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:02:15.200389  7334 tablet_bootstrap.cc:492] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.202307  7332 tablet_bootstrap.cc:492] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.202777  7332 ts_tablet_manager.cc:1403] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.010s
I20260709 13:02:15.205539  7332 raft_consensus.cc:359] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.206269  7332 raft_consensus.cc:385] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.206610  7332 raft_consensus.cc:740] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.206871  7333 tablet_bootstrap.cc:654] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.207450  7332 consensus_queue.cc:260] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.209839  7332 ts_tablet_manager.cc:1434] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:15.210768  7332 tablet_bootstrap.cc:492] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.216339  7334 tablet_bootstrap.cc:654] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.217871  7332 tablet_bootstrap.cc:654] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.222251  7339 raft_consensus.cc:493] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.222698  7339 raft_consensus.cc:515] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.231622  7339 leader_election.cc:290] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.239856  7332 tablet_bootstrap.cc:492] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.240483  7332 ts_tablet_manager.cc:1403] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.012s
I20260709 13:02:15.242755  7338 raft_consensus.cc:493] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.243232  7338 raft_consensus.cc:515] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.245879  7338 leader_election.cc:290] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.247447  7332 raft_consensus.cc:359] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.249495  7332 raft_consensus.cc:385] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.249845  7332 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.250604  7332 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.254730  7332 ts_tablet_manager.cc:1434] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:15.255908  7332 tablet_bootstrap.cc:492] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.259128  7334 tablet_bootstrap.cc:492] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.259582  7334 ts_tablet_manager.cc:1403] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.059s	user 0.001s	sys 0.010s
I20260709 13:02:15.262431  7332 tablet_bootstrap.cc:654] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.262349  7334 raft_consensus.cc:359] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.263094  7334 raft_consensus.cc:385] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.263407  7334 raft_consensus.cc:740] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.264153  7334 consensus_queue.cc:260] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.267596  7334 ts_tablet_manager.cc:1434] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:02:15.268573  7334 tablet_bootstrap.cc:492] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.274605  7334 tablet_bootstrap.cc:654] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.276270  7332 tablet_bootstrap.cc:492] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.276767  7332 ts_tablet_manager.cc:1403] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:02:15.279053  7333 tablet_bootstrap.cc:492] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.279474  7333 ts_tablet_manager.cc:1403] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.084s	user 0.032s	sys 0.011s
I20260709 13:02:15.279850  7332 raft_consensus.cc:359] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.280635  7332 raft_consensus.cc:385] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.280979  7332 raft_consensus.cc:740] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.282183  7333 raft_consensus.cc:359] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.283391  7333 raft_consensus.cc:385] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.283728  7333 raft_consensus.cc:740] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.283850  7332 consensus_queue.cc:260] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.284410  7333 consensus_queue.cc:260] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.286546  7332 ts_tablet_manager.cc:1434] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:02:15.294135  7140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.286742  7333 ts_tablet_manager.cc:1434] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:02:15.288762  7334 tablet_bootstrap.cc:492] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.295096  7334 ts_tablet_manager.cc:1403] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.004s
I20260709 13:02:15.295599  7333 tablet_bootstrap.cc:492] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.297873  7334 raft_consensus.cc:359] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.298553  7334 raft_consensus.cc:385] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.298836  7334 raft_consensus.cc:740] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.299518  7334 consensus_queue.cc:260] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.294543  7332 tablet_bootstrap.cc:492] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
W20260709 13:02:15.301542  7181 leader_election.cc:343] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.305397  7340 raft_consensus.cc:493] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.305927  7340 raft_consensus.cc:515] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.310477  7334 ts_tablet_manager.cc:1434] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:02:15.313385  7340 leader_election.cc:290] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.313495  7334 tablet_bootstrap.cc:492] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.319240  7333 tablet_bootstrap.cc:654] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.339445  7338 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.338788  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.341308  7339 raft_consensus.cc:493] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.342890  7339 raft_consensus.cc:515] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.342438  7338 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.343434  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.350818  7340 raft_consensus.cc:493] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.354264  7340 raft_consensus.cc:515] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.354358  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.354575  7338 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.356089  7140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.346966  7339 leader_election.cc:290] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.357118  7140 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 0.
I20260709 13:02:15.358673  7340 leader_election.cc:290] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.350114  7215 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 0.
W20260709 13:02:15.360397  7180 leader_election.cc:343] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.361057  7332 tablet_bootstrap.cc:654] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.361235  7181 leader_election.cc:304] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.366019  7339 raft_consensus.cc:2804] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.366377  7339 raft_consensus.cc:493] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.367048  7339 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.361157  7180 leader_election.cc:304] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:15.369362  7340 raft_consensus.cc:493] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.374861  7340 raft_consensus.cc:515] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.380118  7334 tablet_bootstrap.cc:654] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.384011  7340 leader_election.cc:290] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.385111  7340 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.387461  7340 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.397212  7339 raft_consensus.cc:515] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.397909  7340 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191)
I20260709 13:02:15.404583  7140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.403242  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.403264  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.404371  7339 leader_election.cc:290] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.406674  7140 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:15.409932  7105 leader_election.cc:343] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.414039  7363 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.414512  7105 leader_election.cc:343] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.409966  7339 raft_consensus.cc:2749] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.414495  7363 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
W20260709 13:02:15.415311  7180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:35103, user_credentials={real_user=slave}} blocked reactor thread for 55389.1us
I20260709 13:02:15.419129  7333 tablet_bootstrap.cc:492] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.419415  7363 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.419580  7333 ts_tablet_manager.cc:1403] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.014s
W20260709 13:02:15.421952  7180 leader_election.cc:343] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.423405  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.424147  7333 raft_consensus.cc:359] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.424469  7139 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 0.
I20260709 13:02:15.425318  7333 raft_consensus.cc:385] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.425721  7333 raft_consensus.cc:740] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.426308  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:15.426493  7333 consensus_queue.cc:260] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.427843  7103 leader_election.cc:304] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:15.428938  7363 raft_consensus.cc:493] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.429462  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.429376  7363 raft_consensus.cc:515] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.427953  7181 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.434048  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.434258  7363 leader_election.cc:290] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.434602  7215 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 0.
I20260709 13:02:15.437682  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.439347  7103 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:15.439972  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.435887  7363 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.445277  7333 ts_tablet_manager.cc:1434] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:02:15.444171  7363 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.447016  7214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
W20260709 13:02:15.448889  7181 leader_election.cc:343] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.468932  7333 tablet_bootstrap.cc:492] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.473819  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.449843  7363 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:15.449481  7180 leader_election.cc:343] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.459859  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.475370  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.469823  7140 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 1.
I20260709 13:02:15.481037  7368 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.481730  7338 raft_consensus.cc:2764] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:02:15.481997  7252 leader_election.cc:343] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.481040  7215 raft_consensus.cc:2468] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 0.
I20260709 13:02:15.482709  7368 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.485596  7332 tablet_bootstrap.cc:492] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.485839  7334 tablet_bootstrap.cc:492] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
W20260709 13:02:15.486979  7252 leader_election.cc:343] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:15.485284  7180 leader_election.cc:343] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.487396  7332 ts_tablet_manager.cc:1403] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.193s	user 0.033s	sys 0.036s
I20260709 13:02:15.487802  7252 leader_election.cc:304] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
W20260709 13:02:15.488101  7180 leader_election.cc:343] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:15.488796  7252 leader_election.cc:343] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.488982  7180 leader_election.cc:304] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:15.489424  7340 raft_consensus.cc:2804] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.489756  7340 raft_consensus.cc:493] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.490088  7340 raft_consensus.cc:3060] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.487426  7334 ts_tablet_manager.cc:1403] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.021s
I20260709 13:02:15.487048  7368 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.491036  7365 raft_consensus.cc:2749] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.490800  7181 leader_election.cc:304] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:15.495043  7365 raft_consensus.cc:2804] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.495500  7365 raft_consensus.cc:697] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:15.495178  7332 raft_consensus.cc:359] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.496941  7332 raft_consensus.cc:385] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.496282  7365 consensus_queue.cc:237] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.497614  7332 raft_consensus.cc:740] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.500753  7332 consensus_queue.cc:260] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.507069  7340 raft_consensus.cc:515] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.503695  7334 raft_consensus.cc:359] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.509289  7334 raft_consensus.cc:385] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.509874  7340 leader_election.cc:290] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.509938  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.509594  7334 raft_consensus.cc:740] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.514266  7333 tablet_bootstrap.cc:654] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.514219  7140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.516469  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.517546  7137 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 0.
I20260709 13:02:15.515499  7212 raft_consensus.cc:3060] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.517000  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.520485  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.521466  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.521518  7138 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 0.
W20260709 13:02:15.525408  7255 leader_election.cc:343] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.527218  7255 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.519842  7334 consensus_queue.cc:260] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.528119  7340 raft_consensus.cc:2804] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:15.528414  7255 leader_election.cc:343] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.528904  7255 leader_election.cc:304] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f; no voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.529876  7334 ts_tablet_manager.cc:1434] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:02:15.529942  7255 leader_election.cc:304] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.528474  7340 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.519716  7332 ts_tablet_manager.cc:1434] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:02:15.530999  7340 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.524366  7368 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.531090  7361 raft_consensus.cc:2749] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.533934  7361 raft_consensus.cc:2804] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.534473  7361 raft_consensus.cc:493] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.534788  7361 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.536224  7332 tablet_bootstrap.cc:492] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.540112  7363 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.542912  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.543952  7139 raft_consensus.cc:2393] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate da851454051846b1a0b043afcb3e9291 in current term 1: Already voted for candidate bf645723685c4cf28c0e927e7f5ebd93 in this term.
I20260709 13:02:15.539113  7334 tablet_bootstrap.cc:492] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.549160  7034 catalog_manager.cc:5697] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 0 to 1, leader changed from <none> to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.550707  7340 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.552111  7212 raft_consensus.cc:2468] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 1.
I20260709 13:02:15.552397  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.553862  7215 raft_consensus.cc:2393] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bf645723685c4cf28c0e927e7f5ebd93 in current term 1: Already voted for candidate da851454051846b1a0b043afcb3e9291 in this term.
I20260709 13:02:15.553874  7252 leader_election.cc:304] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.554977  7368 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.556721  7340 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191)
I20260709 13:02:15.557590  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.558445  7363 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
W20260709 13:02:15.559662  7252 leader_election.cc:343] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.559827  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:15.555939  7361 raft_consensus.cc:515] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
W20260709 13:02:15.562404  7180 leader_election.cc:343] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.563618  7180 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93
W20260709 13:02:15.564093  7255 leader_election.cc:343] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.560778  7340 raft_consensus.cc:2804] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.565521  7363 raft_consensus.cc:2749] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.570267  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.571028  7139 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.574030  7340 raft_consensus.cc:697] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:15.576005  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:15.575670  7332 tablet_bootstrap.cc:654] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:15.578320  7105 leader_election.cc:343] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.578824  7105 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93; no voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.579723  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.580175  7368 raft_consensus.cc:2749] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:02:15.581321  7252 leader_election.cc:343] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.582381  7334 tablet_bootstrap.cc:654] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.583220  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.578639  7361 leader_election.cc:290] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.585495  7138 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.583843  7340 consensus_queue.cc:237] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.584601  7139 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 1.
I20260709 13:02:15.593725  7255 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.593971  7333 tablet_bootstrap.cc:492] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.594529  7333 ts_tablet_manager.cc:1403] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.126s	user 0.022s	sys 0.006s
I20260709 13:02:15.594485  7361 raft_consensus.cc:2804] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.595533  7361 raft_consensus.cc:697] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:15.596262  7138 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 1.
I20260709 13:02:15.597081  7368 raft_consensus.cc:493] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.597554  7368 raft_consensus.cc:515] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.598188  7338 raft_consensus.cc:493] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.598603  7338 raft_consensus.cc:515] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.599649  7368 leader_election.cc:290] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.599908  7333 raft_consensus.cc:359] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.600561  7338 leader_election.cc:290] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.601677  7333 raft_consensus.cc:385] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.602345  7333 raft_consensus.cc:740] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.596284  7361 consensus_queue.cc:237] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.602734  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.603089  7255 leader_election.cc:304] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.603329  7212 raft_consensus.cc:2468] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 0.
I20260709 13:02:15.604152  7370 raft_consensus.cc:2804] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.611250  7103 leader_election.cc:304] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.612179  7338 raft_consensus.cc:2804] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.609850  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.612566  7338 raft_consensus.cc:493] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.613201  7338 raft_consensus.cc:3060] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:15.615036  7103 leader_election.cc:343] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.617920  7334 tablet_bootstrap.cc:492] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.617846  7333 consensus_queue.cc:260] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.619141  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.618459  7334 ts_tablet_manager.cc:1403] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.007s
I20260709 13:02:15.620366  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
W20260709 13:02:15.621661  7105 leader_election.cc:343] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.623063  7105 leader_election.cc:304] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93; no voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.624183  7368 raft_consensus.cc:2749] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.615527  7370 raft_consensus.cc:697] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
W20260709 13:02:15.634469  7105 leader_election.cc:343] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.637741  7333 ts_tablet_manager.cc:1434] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.006s
I20260709 13:02:15.631251  7370 consensus_queue.cc:237] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.630224  7338 raft_consensus.cc:515] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.641571  7037 catalog_manager.cc:5697] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 1 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.646838  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.647384  7215 raft_consensus.cc:3060] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.648288  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:15.649040  7333 tablet_bootstrap.cc:492] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.647392  7334 raft_consensus.cc:359] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
W20260709 13:02:15.649677  7105 leader_election.cc:343] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.647477  7338 leader_election.cc:290] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.650583  7334 raft_consensus.cc:385] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.652686  7334 raft_consensus.cc:740] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.653604  7334 consensus_queue.cc:260] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.660000  7334 ts_tablet_manager.cc:1434] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:02:15.660677  7215 raft_consensus.cc:2468] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 1.
I20260709 13:02:15.661823  7103 leader_election.cc:304] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:15.664346  7338 raft_consensus.cc:2804] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.665776  7338 raft_consensus.cc:697] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:15.666671  7338 consensus_queue.cc:237] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.672262  7334 tablet_bootstrap.cc:492] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.678273  7333 tablet_bootstrap.cc:654] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.688375  7332 tablet_bootstrap.cc:492] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.688992  7332 ts_tablet_manager.cc:1403] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.019s
I20260709 13:02:15.696343  7036 catalog_manager.cc:5697] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.700845  7334 tablet_bootstrap.cc:654] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.704631  7332 raft_consensus.cc:359] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.712631  7332 raft_consensus.cc:385] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.712975  7332 raft_consensus.cc:740] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.713730  7332 consensus_queue.cc:260] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.716157  7036 catalog_manager.cc:5697] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 1 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.718641  7036 catalog_manager.cc:5697] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 1 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.723361  7332 ts_tablet_manager.cc:1434] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:02:15.732580  7332 tablet_bootstrap.cc:492] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.737571  7334 tablet_bootstrap.cc:492] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.738018  7334 ts_tablet_manager.cc:1403] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.067s	user 0.039s	sys 0.004s
I20260709 13:02:15.738701  7332 tablet_bootstrap.cc:654] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.738998  7333 tablet_bootstrap.cc:492] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.739426  7333 ts_tablet_manager.cc:1403] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.022s
I20260709 13:02:15.740825  7334 raft_consensus.cc:359] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.741530  7334 raft_consensus.cc:385] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.741809  7334 raft_consensus.cc:740] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.742168  7333 raft_consensus.cc:359] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.742849  7333 raft_consensus.cc:385] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.742601  7334 consensus_queue.cc:260] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.743274  7333 raft_consensus.cc:740] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.744119  7333 consensus_queue.cc:260] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.746224  7333 ts_tablet_manager.cc:1434] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:15.747262  7333 tablet_bootstrap.cc:492] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.751492  7334 ts_tablet_manager.cc:1434] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:15.753373  7333 tablet_bootstrap.cc:654] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.759137  7334 tablet_bootstrap.cc:492] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.761658  7332 tablet_bootstrap.cc:492] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.761736  7363 raft_consensus.cc:493] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.762151  7332 ts_tablet_manager.cc:1403] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.002s
I20260709 13:02:15.762238  7363 raft_consensus.cc:515] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.764040  7333 tablet_bootstrap.cc:492] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.764190  7363 leader_election.cc:290] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.764526  7333 ts_tablet_manager.cc:1403] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:02:15.765630  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.766872  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.767091  7333 raft_consensus.cc:359] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.767463  7289 raft_consensus.cc:2468] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 0.
I20260709 13:02:15.767699  7333 raft_consensus.cc:385] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.767978  7333 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.768555  7333 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
W20260709 13:02:15.769006  7181 leader_election.cc:343] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.769744  7334 tablet_bootstrap.cc:654] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.770579  7333 ts_tablet_manager.cc:1434] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:15.771435  7333 tablet_bootstrap.cc:492] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291: Bootstrap starting.
I20260709 13:02:15.776252  7332 raft_consensus.cc:359] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.776870  7332 raft_consensus.cc:385] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.777115  7332 raft_consensus.cc:740] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.777479  7333 tablet_bootstrap.cc:654] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.777850  7332 consensus_queue.cc:260] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.780735  7332 ts_tablet_manager.cc:1434] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:02:15.783211  7332 tablet_bootstrap.cc:492] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: Bootstrap starting.
I20260709 13:02:15.784860  7180 leader_election.cc:304] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:15.785692  7363 raft_consensus.cc:2804] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.786046  7363 raft_consensus.cc:493] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.786425  7363 raft_consensus.cc:3060] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.786639  7370 raft_consensus.cc:493] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.787155  7370 raft_consensus.cc:515] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.789516  7370 leader_election.cc:290] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.790938  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.791525  7138 raft_consensus.cc:2468] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 0.
I20260709 13:02:15.793407  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.793550  7363 raft_consensus.cc:515] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.794917  7255 leader_election.cc:304] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
W20260709 13:02:15.796286  7252 leader_election.cc:343] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.797283  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.797904  7138 raft_consensus.cc:3060] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.799906  7332 tablet_bootstrap.cc:654] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.802369  7333 tablet_bootstrap.cc:492] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291: No bootstrap required, opened a new log
I20260709 13:02:15.802758  7333 ts_tablet_manager.cc:1403] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291: Time spent bootstrapping tablet: real 0.031s	user 0.001s	sys 0.009s
I20260709 13:02:15.803668  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:15.804184  7289 raft_consensus.cc:3060] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.804243  7138 raft_consensus.cc:2468] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 1.
I20260709 13:02:15.805130  7333 raft_consensus.cc:359] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.805855  7333 raft_consensus.cc:385] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.806111  7333 raft_consensus.cc:740] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.806716  7333 consensus_queue.cc:260] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.808661  7333 ts_tablet_manager.cc:1434] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:15.809464  7363 leader_election.cc:290] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.810374  7289 raft_consensus.cc:2468] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 1.
I20260709 13:02:15.811388  7180 leader_election.cc:304] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.812071  7332 tablet_bootstrap.cc:492] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: No bootstrap required, opened a new log
I20260709 13:02:15.812041  7370 raft_consensus.cc:2804] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.812106  7363 raft_consensus.cc:2804] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.812582  7370 raft_consensus.cc:493] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.812693  7332 ts_tablet_manager.cc:1403] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.006s
I20260709 13:02:15.812870  7363 raft_consensus.cc:697] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:15.814261  7363 consensus_queue.cc:237] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.814949  7334 tablet_bootstrap.cc:492] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.815349  7334 ts_tablet_manager.cc:1403] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.004s
I20260709 13:02:15.812945  7370 raft_consensus.cc:3060] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.815528  7332 raft_consensus.cc:359] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.816147  7332 raft_consensus.cc:385] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.816413  7332 raft_consensus.cc:740] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.817018  7332 consensus_queue.cc:260] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.817898  7334 raft_consensus.cc:359] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.818466  7334 raft_consensus.cc:385] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.818713  7334 raft_consensus.cc:740] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.818841  7332 ts_tablet_manager.cc:1434] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:15.819451  7334 consensus_queue.cc:260] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.821717  7334 ts_tablet_manager.cc:1434] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:15.822512  7334 tablet_bootstrap.cc:492] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f: Bootstrap starting.
I20260709 13:02:15.824568  7361 raft_consensus.cc:493] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.825026  7361 raft_consensus.cc:515] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.826932  7361 leader_election.cc:290] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.827308  7370 raft_consensus.cc:515] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.830598  7370 leader_election.cc:290] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.832294  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.833551  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.834103  7212 raft_consensus.cc:3060] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.838747  7334 tablet_bootstrap.cc:654] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.840413  7212 raft_consensus.cc:2468] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 1.
I20260709 13:02:15.842271  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.843009  7138 raft_consensus.cc:2393] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f6889e296e64aa8965a17175dd0691f in current term 1: Already voted for candidate da851454051846b1a0b043afcb3e9291 in this term.
I20260709 13:02:15.843871  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:15.844383  7139 raft_consensus.cc:3060] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.848166  7037 catalog_manager.cc:5697] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 0 to 1, leader changed from <none> to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.850328  7252 leader_election.cc:304] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f; no voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.851079  7370 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.851410  7252 leader_election.cc:304] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.852165  7361 raft_consensus.cc:2804] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.853210  7361 raft_consensus.cc:697] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:15.854003  7361 consensus_queue.cc:237] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.855896  7338 raft_consensus.cc:493] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.856353  7338 raft_consensus.cc:515] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.858352  7338 leader_election.cc:290] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.857316  7139 raft_consensus.cc:2468] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 1.
I20260709 13:02:15.863853  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.864432  7289 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 0.
I20260709 13:02:15.865571  7105 leader_election.cc:304] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:15.866468  7338 raft_consensus.cc:2804] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.866837  7338 raft_consensus.cc:493] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.867164  7338 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.859516  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.869999  7215 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 0.
I20260709 13:02:15.870723  7334 tablet_bootstrap.cc:492] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f: No bootstrap required, opened a new log
I20260709 13:02:15.871189  7334 ts_tablet_manager.cc:1403] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.018s
I20260709 13:02:15.873596  7334 raft_consensus.cc:359] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.874207  7334 raft_consensus.cc:385] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.874096  7338 raft_consensus.cc:515] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.874516  7334 raft_consensus.cc:740] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.875187  7334 consensus_queue.cc:260] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.876781  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:15.877264  7334 ts_tablet_manager.cc:1434] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:15.876716  7036 catalog_manager.cc:5697] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 1 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.877604  7215 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.882912  7370 raft_consensus.cc:2749] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.887766  7215 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 1.
I20260709 13:02:15.888475  7338 leader_election.cc:290] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.888823  7103 leader_election.cc:304] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:15.889906  7338 raft_consensus.cc:2804] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.890100  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:15.890432  7338 raft_consensus.cc:697] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:15.890653  7289 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.891572  7338 consensus_queue.cc:237] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.897614  7289 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 1.
I20260709 13:02:15.901264  7363 consensus_queue.cc:1048] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.903402  7036 catalog_manager.cc:5697] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:15.919456  7084 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:15.923501  7365 consensus_queue.cc:1048] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:15.959599  7365 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.960110  7365 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.962464  7370 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.962929  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.962908  7370 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:15.963624  7365 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:15.963187  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:15.964093  7139 raft_consensus.cc:2393] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da851454051846b1a0b043afcb3e9291 in current term 1: Already voted for candidate 1f6889e296e64aa8965a17175dd0691f in this term.
I20260709 13:02:15.965060  7370 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:15.965906  7181 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da851454051846b1a0b043afcb3e9291; no voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:15.965997  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:15.966780  7215 raft_consensus.cc:2393] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f6889e296e64aa8965a17175dd0691f in current term 1: Already voted for candidate da851454051846b1a0b043afcb3e9291 in this term.
I20260709 13:02:15.966719  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:15.966971  7365 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.967633  7139 raft_consensus.cc:2393] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f6889e296e64aa8965a17175dd0691f in current term 1: Already voted for candidate bf645723685c4cf28c0e927e7f5ebd93 in this term.
I20260709 13:02:15.968583  7255 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f; no voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291
I20260709 13:02:15.969280  7370 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.975001  7370 raft_consensus.cc:2749] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.975606  7365 raft_consensus.cc:2749] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.979326  7139 raft_consensus.cc:3060] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.984465  7370 consensus_queue.cc:1048] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:15.993690  7370 consensus_queue.cc:1048] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.049777  7215 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.056098  7370 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:16.067957  7340 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.072470  7370 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.083048  7361 raft_consensus.cc:493] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.083487  7361 raft_consensus.cc:515] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:16.086886  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da851454051846b1a0b043afcb3e9291" is_pre_election: true
I20260709 13:02:16.087643  7215 raft_consensus.cc:2393] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f6889e296e64aa8965a17175dd0691f in current term 1: Already voted for candidate bf645723685c4cf28c0e927e7f5ebd93 in this term.
I20260709 13:02:16.087769  7340 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:16.099172  7338 consensus_queue.cc:1048] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.099537  7361 leader_election.cc:290] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:16.100356  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:16.104943  7255 leader_election.cc:304] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f; no voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291
I20260709 13:02:16.106006  7361 raft_consensus.cc:3060] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.114049  7361 raft_consensus.cc:2749] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.121934  7368 consensus_queue.cc:1048] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.293910  7365 consensus_queue.cc:1048] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.295706  7368 consensus_queue.cc:1048] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.309070  7339 consensus_queue.cc:1048] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.313217  7408 consensus_queue.cc:1048] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.368134  7361 consensus_queue.cc:1048] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.378827  7361 consensus_queue.cc:1048] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:16.921954  7084 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:17.652519  7363 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.652967  7363 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:17.654664  7363 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:17.655301  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93" is_pre_election: true
I20260709 13:02:17.655582  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f" is_pre_election: true
I20260709 13:02:17.655804  7138 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 1.
I20260709 13:02:17.656075  7287 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 1.
I20260709 13:02:17.656704  7181 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:17.657442  7363 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:17.657784  7363 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.658015  7363 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:17.663021  7363 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:17.664634  7363 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:17.665657  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:17.665844  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:17.666282  7138 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:17.666522  7287 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:17.670989  7287 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:17.671916  7180 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:17.672501  7363 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:17.672482  7138 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:17.673542  7363 raft_consensus.cc:697] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:17.674333  7363 consensus_queue.cc:237] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:17.680395  7037 catalog_manager.cc:5697] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 0 to 2, leader changed from <none> to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.053562  7139 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:18.054567  7363 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.067070  7287 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:18.068367  7425 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:18.095912  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
mode: GRACEFUL
new_leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:37104
I20260709 13:02:18.096447  7287 raft_consensus.cc:606] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Received request to transfer leadership to TS bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:18.109740  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:54138
I20260709 13:02:18.110342  7215 raft_consensus.cc:606] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Received request to transfer leadership to TS bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:18.117465  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
mode: GRACEFUL
new_leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:37104
I20260709 13:02:18.117920  7287 raft_consensus.cc:606] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Received request to transfer leadership to TS bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:18.124433  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:37104
I20260709 13:02:18.125066  7287 raft_consensus.cc:606] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:18.132236  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:37104
I20260709 13:02:18.132661  7287 raft_consensus.cc:606] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:18.145134  7139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
mode: GRACEFUL
new_leader_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:48180
I20260709 13:02:18.145643  7139 raft_consensus.cc:606] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Received request to transfer leadership to TS 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:18.256183  7433 raft_consensus.cc:993] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: : Instructing follower bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:18.256583  7340 raft_consensus.cc:1081] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Signalling peer bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:18.258042  7139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:48176
I20260709 13:02:18.258489  7139 raft_consensus.cc:493] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.258831  7139 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.264086  7139 raft_consensus.cc:515] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.265749  7139 leader_election.cc:290] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 2 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:18.266368  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:18.267050  7215 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.266928  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:18.267660  7287 raft_consensus.cc:3055] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.268041  7287 raft_consensus.cc:740] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:18.268826  7287 consensus_queue.cc:260] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.269846  7287 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.272334  7434 raft_consensus.cc:993] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: : Instructing follower 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:18.272816  7368 raft_consensus.cc:1081] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Signalling peer 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:18.273273  7215 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 2.
I20260709 13:02:18.274286  7103 leader_election.cc:304] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:18.274370  7288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:37094
I20260709 13:02:18.274904  7288 raft_consensus.cc:493] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.275089  7368 raft_consensus.cc:2804] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.275276  7288 raft_consensus.cc:3060] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.275565  7287 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 2.
I20260709 13:02:18.275770  7368 raft_consensus.cc:697] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:18.276597  7368 consensus_queue.cc:237] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.280467  7288 raft_consensus.cc:515] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.282305  7288 leader_election.cc:290] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 2 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:18.283111  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:18.283561  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41d2e54cb0c41fcbb80ea83d5a6926e" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:18.283675  7139 raft_consensus.cc:3055] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.284143  7215 raft_consensus.cc:3060] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.283506  7037 catalog_manager.cc:5697] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 1 to 2, leader changed from 1f6889e296e64aa8965a17175dd0691f (127.6.215.67) to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.284152  7139 raft_consensus.cc:740] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:18.285049  7139 consensus_queue.cc:260] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.286170  7139 raft_consensus.cc:3060] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.288534  7215 raft_consensus.cc:2468] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 2.
I20260709 13:02:18.289636  7252 leader_election.cc:304] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:18.290395  7340 raft_consensus.cc:2804] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.290848  7340 raft_consensus.cc:697] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:18.292448  7139 raft_consensus.cc:2468] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 2.
I20260709 13:02:18.292169  7340 consensus_queue.cc:237] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.299810  7037 catalog_manager.cc:5697] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 1 to 2, leader changed from bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65) to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 2 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.396428  7433 raft_consensus.cc:993] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: : Instructing follower bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:18.396804  7433 raft_consensus.cc:1081] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Signalling peer bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:18.398240  7139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:48176
I20260709 13:02:18.398684  7139 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.398967  7139 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.403107  7139 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.404541  7139 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 2 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:18.405337  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:18.405582  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:18.405925  7215 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.406191  7288 raft_consensus.cc:3055] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.406514  7288 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:18.407575  7288 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.408999  7288 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.410893  7215 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 2.
I20260709 13:02:18.411796  7103 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:18.412700  7368 raft_consensus.cc:2804] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.413298  7368 raft_consensus.cc:697] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:18.414104  7368 consensus_queue.cc:237] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.415556  7288 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 2.
I20260709 13:02:18.420930  7037 catalog_manager.cc:5697] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 1 to 2, leader changed from 1f6889e296e64aa8965a17175dd0691f (127.6.215.67) to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.450554  7340 raft_consensus.cc:993] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:18.450959  7433 raft_consensus.cc:1081] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:18.452468  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:18.452939  7215 raft_consensus.cc:493] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.453305  7215 raft_consensus.cc:3060] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.458786  7215 raft_consensus.cc:515] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.460491  7215 leader_election.cc:290] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:18.461155  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:18.461436  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ab222d664349a0aef7aafe15febbd4" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:18.461689  7139 raft_consensus.cc:3060] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.461935  7288 raft_consensus.cc:3055] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.462196  7288 raft_consensus.cc:740] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:18.462821  7288 consensus_queue.cc:260] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.463634  7288 raft_consensus.cc:3060] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.466267  7139 raft_consensus.cc:2468] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:18.467199  7181 leader_election.cc:304] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:18.467969  7425 raft_consensus.cc:2804] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.468120  7288 raft_consensus.cc:2468] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:18.468348  7425 raft_consensus.cc:697] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:18.469125  7425 consensus_queue.cc:237] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.476256  7037 catalog_manager.cc:5697] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 1 to 2, leader changed from 1f6889e296e64aa8965a17175dd0691f (127.6.215.67) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.492818  7340 raft_consensus.cc:993] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:18.493266  7433 raft_consensus.cc:1081] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:18.494688  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:18.495144  7215 raft_consensus.cc:493] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.495405  7215 raft_consensus.cc:3060] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.499603  7215 raft_consensus.cc:515] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.501034  7215 leader_election.cc:290] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:18.501842  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:18.502323  7139 raft_consensus.cc:3060] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.502168  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88fe7b57e134639b5b247d009a7dcca" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:18.502955  7288 raft_consensus.cc:3055] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.503242  7288 raft_consensus.cc:740] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:18.503934  7288 consensus_queue.cc:260] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.504931  7288 raft_consensus.cc:3060] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.506850  7139 raft_consensus.cc:2468] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:18.507742  7181 leader_election.cc:304] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:18.508487  7425 raft_consensus.cc:2804] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.508885  7425 raft_consensus.cc:697] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:18.509519  7288 raft_consensus.cc:2468] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:18.509598  7425 consensus_queue.cc:237] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.512089  7417 raft_consensus.cc:993] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: : Instructing follower bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:18.512513  7363 raft_consensus.cc:1081] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Signalling peer bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:18.514133  7139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:48174
I20260709 13:02:18.514654  7139 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.514976  7139 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.516938  7037 catalog_manager.cc:5697] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 1 to 2, leader changed from 1f6889e296e64aa8965a17175dd0691f (127.6.215.67) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.519661  7139 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.521544  7139 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 3 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:18.522529  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:18.522769  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:18.523070  7288 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.523399  7215 raft_consensus.cc:3055] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:18.523685  7215 raft_consensus.cc:740] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:18.524432  7215 consensus_queue.cc:260] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.525373  7215 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.528491  7288 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 3.
I20260709 13:02:18.529457  7105 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:18.529808  7215 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 3.
I20260709 13:02:18.530328  7368 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:18.530856  7368 raft_consensus.cc:697] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:18.531564  7368 consensus_queue.cc:237] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:18.537451  7037 catalog_manager.cc:5697] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 2 to 3, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.810272  7288 raft_consensus.cc:1275] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.811421  7368 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.820029  7215 raft_consensus.cc:1275] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.821630  7368 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.829640  7139 raft_consensus.cc:1275] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.830958  7433 consensus_queue.cc:1048] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.833570  7215 raft_consensus.cc:1275] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.835427  7340 consensus_queue.cc:1048] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.893873  7139 raft_consensus.cc:1275] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.895112  7363 consensus_queue.cc:1048] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.903422  7288 raft_consensus.cc:1275] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.905179  7425 consensus_queue.cc:1048] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.956110  7139 raft_consensus.cc:1275] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.957456  7425 consensus_queue.cc:1048] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.969046  7287 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:18.969069  7215 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.970414  7368 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.971585  7288 raft_consensus.cc:1275] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.972687  7368 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.973098  7417 consensus_queue.cc:1048] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.979209  7212 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:18.980715  7434 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:18.991981  7287 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.993232  7445 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.175747  7005 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:02:21.176525  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:21.196432  7139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
mode: GRACEFUL
new_leader_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:48196
I20260709 13:02:21.196884  7139 raft_consensus.cc:606] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Received request to transfer leadership to TS 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:21.207290  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:02:21.207702  7215 raft_consensus.cc:606] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Received request to transfer leadership to TS 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:21.208668  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:21.209162  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:21.306483  7368 raft_consensus.cc:993] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: : Instructing follower 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:21.306872  7463 raft_consensus.cc:1081] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Signalling peer 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:21.308190  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:37094
I20260709 13:02:21.308610  7287 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.308869  7287 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.312956  7287 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:21.314494  7287 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 3 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191)
I20260709 13:02:21.315121  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:21.315390  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:21.315584  7215 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.315889  7139 raft_consensus.cc:3055] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:21.316150  7139 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:21.316733  7139 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:21.317526  7139 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.319311  7215 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 3.
I20260709 13:02:21.320194  7252 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:21.320938  7340 raft_consensus.cc:2804] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:21.321734  7139 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 3.
I20260709 13:02:21.322082  7340 raft_consensus.cc:697] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:21.322906  7340 consensus_queue.cc:237] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:21.329125  7036 catalog_manager.cc:5697] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 2 to 3, leader changed from bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65) to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 3 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.692726  7363 raft_consensus.cc:993] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: : Instructing follower 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:21.693107  7363 raft_consensus.cc:1081] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Signalling peer 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:21.694429  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:02:21.694856  7287 raft_consensus.cc:493] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.695097  7287 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.699247  7287 raft_consensus.cc:515] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:21.700635  7287 leader_election.cc:290] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 2 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:21.701390  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:21.701594  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:21.701894  7139 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.702052  7215 raft_consensus.cc:3055] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:21.702359  7215 raft_consensus.cc:740] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:21.703006  7215 consensus_queue.cc:260] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:21.704042  7215 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.707902  7139 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 2.
I20260709 13:02:21.708832  7255 leader_election.cc:304] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:21.709461  7340 raft_consensus.cc:2804] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:21.709523  7215 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 2.
I20260709 13:02:21.709973  7340 raft_consensus.cc:697] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:21.710747  7340 consensus_queue.cc:237] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:21.716610  7036 catalog_manager.cc:5697] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 1 to 2, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 2 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.788492  7215 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.789773  7340 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:21.799693  7139 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.801584  7474 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:22.209977  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:22.219117  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:37104
I20260709 13:02:22.219599  7287 raft_consensus.cc:606] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:22.223915  7139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:48180
I20260709 13:02:22.224298  7139 raft_consensus.cc:606] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:22.228423  7139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:48180
I20260709 13:02:22.228782  7139 raft_consensus.cc:606] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:22.232793  7139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:48180
I20260709 13:02:22.233431  7139 raft_consensus.cc:606] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:22.237607  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
mode: GRACEFUL
new_leader_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:37104
I20260709 13:02:22.238014  7287 raft_consensus.cc:606] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Received request to transfer leadership to TS da851454051846b1a0b043afcb3e9291
I20260709 13:02:22.244561  7215 raft_consensus.cc:1275] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:22.245618  7475 consensus_queue.cc:1048] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:22.251106  7474 raft_consensus.cc:993] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.251513  7340 raft_consensus.cc:1081] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.252911  7212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:22.253466  7212 raft_consensus.cc:493] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.253801  7212 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.258846  7139 raft_consensus.cc:1275] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:22.259021  7212 raft_consensus.cc:515] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.260049  7215 raft_consensus.cc:1240] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Rejecting Update request from peer 1f6889e296e64aa8965a17175dd0691f for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:22.260049  7474 consensus_queue.cc:1048] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:22.261569  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:22.262049  7139 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.262423  7212 leader_election.cc:290] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 3 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:22.261965  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507624b34d3d4637969f13db4bab16e6" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:22.263105  7287 raft_consensus.cc:3055] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:22.263401  7287 raft_consensus.cc:740] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:22.263971  7474 consensus_queue.cc:1059] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:22.264860  7287 consensus_queue.cc:260] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.265656  7287 raft_consensus.cc:3060] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.266530  7139 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 3.
I20260709 13:02:22.267031  7138 raft_consensus.cc:1240] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Rejecting Update request from peer 1f6889e296e64aa8965a17175dd0691f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:22.268818  7181 leader_election.cc:304] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:22.269466  7363 raft_consensus.cc:2804] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:22.270349  7363 raft_consensus.cc:697] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:22.270330  7287 raft_consensus.cc:2468] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 3.
W20260709 13:02:22.271059  7340 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:02:22.271299  7363 consensus_queue.cc:237] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.277602  7034 catalog_manager.cc:5697] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 2 to 3, leader changed from 1f6889e296e64aa8965a17175dd0691f (127.6.215.67) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.562476  7485 raft_consensus.cc:993] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.563021  7485 raft_consensus.cc:1081] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.564801  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54130
I20260709 13:02:22.565337  7215 raft_consensus.cc:493] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.565676  7215 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.570387  7215 raft_consensus.cc:515] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.571940  7215 leader_election.cc:290] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:22.573309  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:22.573489  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:22.574009  7139 raft_consensus.cc:3055] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:22.574025  7287 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.574241  7139 raft_consensus.cc:740] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:22.575014  7139 consensus_queue.cc:260] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.576238  7139 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.579653  7287 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:22.580258  7139 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 2.
I20260709 13:02:22.580649  7180 leader_election.cc:304] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:22.581445  7363 raft_consensus.cc:2804] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:22.581780  7363 raft_consensus.cc:697] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:22.582624  7363 consensus_queue.cc:237] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.592244  7034 catalog_manager.cc:5697] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 1 to 2, leader changed from bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.637547  7474 raft_consensus.cc:993] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.637985  7474 raft_consensus.cc:1081] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.639319  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:22.639690  7215 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.639899  7215 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:22.643692  7215 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.645147  7215 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 4 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:22.645823  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:22.646106  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:22.646236  7139 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:22.646545  7287 raft_consensus.cc:3055] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:22.646770  7287 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:22.647441  7287 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.648277  7287 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:22.650242  7139 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 4.
I20260709 13:02:22.651114  7181 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:22.651716  7363 raft_consensus.cc:2804] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:22.652170  7363 raft_consensus.cc:697] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:22.652256  7287 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 4.
I20260709 13:02:22.653050  7363 consensus_queue.cc:237] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.657258  7368 raft_consensus.cc:993] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.657763  7485 raft_consensus.cc:1081] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.659221  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54130
I20260709 13:02:22.659618  7215 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.659957  7215 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:22.659572  7034 catalog_manager.cc:5697] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 3 to 4, leader changed from 1f6889e296e64aa8965a17175dd0691f (127.6.215.67) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 4 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.665337  7215 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.667434  7215 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 4 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:22.668751  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:22.668073  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:22.669477  7139 raft_consensus.cc:3055] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:22.669488  7287 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:22.670078  7139 raft_consensus.cc:740] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:22.671066  7139 consensus_queue.cc:260] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.672346  7139 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:22.674574  7368 raft_consensus.cc:993] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: : Instructing follower da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.675168  7368 raft_consensus.cc:1081] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Signalling peer da851454051846b1a0b043afcb3e9291 to start an election
I20260709 13:02:22.676805  7287 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 4.
I20260709 13:02:22.676998  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
 from {username='slave'} at 127.0.0.1:54130
I20260709 13:02:22.677798  7215 raft_consensus.cc:493] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.678189  7215 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.678045  7180 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:22.678910  7363 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:22.678915  7139 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 4.
I20260709 13:02:22.679498  7363 raft_consensus.cc:697] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:22.680262  7363 consensus_queue.cc:237] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.682708  7215 raft_consensus.cc:515] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.684904  7215 leader_election.cc:290] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 3 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:22.685338  7139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:22.685979  7139 raft_consensus.cc:3055] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:22.686220  7139 raft_consensus.cc:740] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:22.686910  7139 consensus_queue.cc:260] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.688038  7139 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.687466  7034 catalog_manager.cc:5697] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 3 to 4, leader changed from bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 4 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.694065  7139 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 3.
I20260709 13:02:22.694389  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "da851454051846b1a0b043afcb3e9291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:22.694962  7287 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.695317  7181 leader_election.cc:304] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf645723685c4cf28c0e927e7f5ebd93, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:22.696100  7363 raft_consensus.cc:2804] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:22.696455  7363 raft_consensus.cc:697] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Becoming Leader. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:22.697271  7363 consensus_queue.cc:237] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:22.700466  7287 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da851454051846b1a0b043afcb3e9291 in term 3.
I20260709 13:02:22.704036  7034 catalog_manager.cc:5697] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 reported cstate change: term changed from 2 to 3, leader changed from bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65) to da851454051846b1a0b043afcb3e9291 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "da851454051846b1a0b043afcb3e9291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.823271  7139 raft_consensus.cc:1275] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:22.824467  7363 consensus_queue.cc:1048] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:22.842108  7287 raft_consensus.cc:1275] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:22.843482  7363 consensus_queue.cc:1048] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:22.990471  7287 raft_consensus.cc:1275] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:22.991649  7363 consensus_queue.cc:1048] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.000638  7139 raft_consensus.cc:1275] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.002627  7363 consensus_queue.cc:1048] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.042672  7139 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:23.044046  7363 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.052631  7287 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:23.053926  7363 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.156494  7139 raft_consensus.cc:1275] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.157603  7363 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.164130  7139 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:23.165692  7492 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.166121  7287 raft_consensus.cc:1275] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.167616  7480 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.179807  7287 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Refusing update from remote peer da851454051846b1a0b043afcb3e9291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:23.181144  7363 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.249799  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:25.256289  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:02:25.256743  7215 raft_consensus.cc:606] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Received request to transfer leadership to TS bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:25.258893  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:02:25.259277  7215 raft_consensus.cc:606] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Received request to transfer leadership to TS 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:25.261390  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:02:25.261785  7215 raft_consensus.cc:606] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Received request to transfer leadership to TS 1f6889e296e64aa8965a17175dd0691f
I20260709 13:02:25.263816  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:02:25.264210  7215 raft_consensus.cc:606] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Received request to transfer leadership to TS bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:25.266081  7215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495"
dest_uuid: "da851454051846b1a0b043afcb3e9291"
mode: GRACEFUL
new_leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:02:25.266443  7215 raft_consensus.cc:606] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Received request to transfer leadership to TS bf645723685c4cf28c0e927e7f5ebd93
I20260709 13:02:25.267279  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:25.267660  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:25.343178  7502 raft_consensus.cc:993] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: : Instructing follower bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:25.343581  7480 raft_consensus.cc:1081] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Signalling peer bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:25.344973  7138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:48174
I20260709 13:02:25.345420  7138 raft_consensus.cc:493] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.345677  7138 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.350061  7138 raft_consensus.cc:515] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.351538  7138 leader_election.cc:290] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 5 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:25.352617  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:25.352720  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf12fc202f24f838edc3e9f64070a62" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:25.353117  7215 raft_consensus.cc:3055] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:25.353140  7287 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.353475  7215 raft_consensus.cc:740] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:25.354067  7215 consensus_queue.cc:260] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.354828  7215 raft_consensus.cc:3060] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.357610  7287 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 5.
I20260709 13:02:25.358745  7215 raft_consensus.cc:2468] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 5.
I20260709 13:02:25.358783  7105 leader_election.cc:304] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:25.360380  7503 raft_consensus.cc:2804] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:25.361299  7503 raft_consensus.cc:697] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:25.362066  7503 consensus_queue.cc:237] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.367918  7034 catalog_manager.cc:5697] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 4 to 5, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 5 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.478793  7502 raft_consensus.cc:993] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: : Instructing follower bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:25.479178  7502 raft_consensus.cc:1081] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Signalling peer bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:25.480515  7138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:48174
I20260709 13:02:25.481026  7138 raft_consensus.cc:493] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.481297  7138 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.486105  7138 raft_consensus.cc:515] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.487643  7138 leader_election.cc:290] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 3 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:25.488220  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:25.488543  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05c1b06299e4f849af3d9fd30557015" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:25.488655  7215 raft_consensus.cc:3055] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:25.488950  7215 raft_consensus.cc:740] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:25.488963  7287 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.489542  7215 consensus_queue.cc:260] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.490299  7215 raft_consensus.cc:3060] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.492666  7287 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 3.
I20260709 13:02:25.493482  7105 leader_election.cc:304] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:25.494026  7215 raft_consensus.cc:2468] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 3.
I20260709 13:02:25.494177  7503 raft_consensus.cc:2804] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.494616  7503 raft_consensus.cc:697] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:25.495327  7503 consensus_queue.cc:237] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.501050  7034 catalog_manager.cc:5697] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 2 to 3, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.639037  7480 raft_consensus.cc:993] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: : Instructing follower 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:25.639575  7502 raft_consensus.cc:1081] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Signalling peer 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:25.640992  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:02:25.641394  7287 raft_consensus.cc:493] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.641623  7287 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.645483  7287 raft_consensus.cc:515] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.647107  7287 leader_election.cc:290] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 5 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:25.648171  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:25.648161  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5549324d1b9245ce8af265ab264ee439" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:25.648795  7138 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.648825  7215 raft_consensus.cc:3055] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:25.649261  7215 raft_consensus.cc:740] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:25.649823  7215 consensus_queue.cc:260] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.650555  7215 raft_consensus.cc:3060] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.653122  7138 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 5.
I20260709 13:02:25.654218  7255 leader_election.cc:304] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:25.654361  7215 raft_consensus.cc:2468] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 5.
I20260709 13:02:25.655148  7474 raft_consensus.cc:2804] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:25.656133  7474 raft_consensus.cc:697] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 5 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:25.656762  7474 consensus_queue.cc:237] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.664268  7034 catalog_manager.cc:5697] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 4 to 5, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 5 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.665120  7480 raft_consensus.cc:993] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: : Instructing follower 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:25.665598  7502 raft_consensus.cc:1081] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Signalling peer 1f6889e296e64aa8965a17175dd0691f to start an election
I20260709 13:02:25.667050  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16"
dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:02:25.667506  7287 raft_consensus.cc:493] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.667757  7287 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:25.672523  7287 raft_consensus.cc:515] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.673910  7287 leader_election.cc:290] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 4 election: Requested vote from peers bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65:37191), da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515)
I20260709 13:02:25.674589  7138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
I20260709 13:02:25.674827  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce25b5ab4f435a8c7151d84d895b16" candidate_uuid: "1f6889e296e64aa8965a17175dd0691f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:25.675071  7138 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:25.675233  7215 raft_consensus.cc:3055] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:25.675500  7215 raft_consensus.cc:740] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:25.676115  7215 consensus_queue.cc:260] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.676903  7215 raft_consensus.cc:3060] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:25.680444  7215 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 4.
I20260709 13:02:25.680997  7138 raft_consensus.cc:2468] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6889e296e64aa8965a17175dd0691f in term 4.
I20260709 13:02:25.681548  7252 leader_election.cc:304] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, da851454051846b1a0b043afcb3e9291; no voters: 
I20260709 13:02:25.682178  7474 raft_consensus.cc:2804] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:25.682497  7474 raft_consensus.cc:697] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 4 LEADER]: Becoming Leader. State: Replica: 1f6889e296e64aa8965a17175dd0691f, State: Running, Role: LEADER
I20260709 13:02:25.683086  7474 consensus_queue.cc:237] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.689005  7034 catalog_manager.cc:5697] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f reported cstate change: term changed from 3 to 4, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to 1f6889e296e64aa8965a17175dd0691f (127.6.215.67). New cstate: current_term: 4 leader_uuid: "1f6889e296e64aa8965a17175dd0691f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.710328  7480 raft_consensus.cc:993] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: : Instructing follower bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:25.710707  7502 raft_consensus.cc:1081] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Signalling peer bf645723685c4cf28c0e927e7f5ebd93 to start an election
I20260709 13:02:25.711930  7138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495"
dest_uuid: "bf645723685c4cf28c0e927e7f5ebd93"
 from {username='slave'} at 127.0.0.1:48174
I20260709 13:02:25.712337  7138 raft_consensus.cc:493] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.712591  7138 raft_consensus.cc:3060] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.716687  7138 raft_consensus.cc:515] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.718128  7138 leader_election.cc:290] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 2 election: Requested vote from peers da851454051846b1a0b043afcb3e9291 (127.6.215.66:42515), 1f6889e296e64aa8965a17175dd0691f (127.6.215.67:35103)
I20260709 13:02:25.719158  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da851454051846b1a0b043afcb3e9291"
I20260709 13:02:25.719241  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96dd77d22de4acd84586bdf6fdb6495" candidate_uuid: "bf645723685c4cf28c0e927e7f5ebd93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6889e296e64aa8965a17175dd0691f"
I20260709 13:02:25.719578  7215 raft_consensus.cc:3055] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.719642  7287 raft_consensus.cc:3060] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.719816  7215 raft_consensus.cc:740] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da851454051846b1a0b043afcb3e9291, State: Running, Role: LEADER
I20260709 13:02:25.720409  7215 consensus_queue.cc:260] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.721139  7215 raft_consensus.cc:3060] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.723914  7287 raft_consensus.cc:2468] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 2.
I20260709 13:02:25.724735  7105 leader_election.cc:304] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6889e296e64aa8965a17175dd0691f, bf645723685c4cf28c0e927e7f5ebd93; no voters: 
I20260709 13:02:25.725227  7215 raft_consensus.cc:2468] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf645723685c4cf28c0e927e7f5ebd93 in term 2.
I20260709 13:02:25.725318  7503 raft_consensus.cc:2804] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.725780  7503 raft_consensus.cc:697] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Becoming Leader. State: Replica: bf645723685c4cf28c0e927e7f5ebd93, State: Running, Role: LEADER
I20260709 13:02:25.726439  7503 consensus_queue.cc:237] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } }
I20260709 13:02:25.732331  7034 catalog_manager.cc:5697] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 reported cstate change: term changed from 1 to 2, leader changed from da851454051846b1a0b043afcb3e9291 (127.6.215.66) to bf645723685c4cf28c0e927e7f5ebd93 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "bf645723685c4cf28c0e927e7f5ebd93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.803421  7215 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:25.804602  7503 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:25.813388  7287 raft_consensus.cc:1275] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:25.814589  7504 consensus_queue.cc:1048] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:25.976656  7287 raft_consensus.cc:1275] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:25.977756  7504 consensus_queue.cc:1048] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.986385  7215 raft_consensus.cc:1275] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:25.988178  7503 consensus_queue.cc:1048] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.114871  7138 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:26.116189  7474 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:26.124285  7215 raft_consensus.cc:1275] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:26.125967  7474 consensus_queue.cc:1048] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:26.154197  7139 raft_consensus.cc:1275] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:26.155318  7524 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf645723685c4cf28c0e927e7f5ebd93" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:26.163421  7215 raft_consensus.cc:1275] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Refusing update from remote peer 1f6889e296e64aa8965a17175dd0691f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:26.164767  7524 consensus_queue.cc:1048] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:26.178717  7287 raft_consensus.cc:1275] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.180120  7503 consensus_queue.cc:1048] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6889e296e64aa8965a17175dd0691f" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.188566  7215 raft_consensus.cc:1275] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Refusing update from remote peer bf645723685c4cf28c0e927e7f5ebd93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.189597  7503 consensus_queue.cc:1048] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da851454051846b1a0b043afcb3e9291" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.268440  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.274256  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
I20260709 13:02:26.300122  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:26.300938  7005 tablet_replica.cc:333] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.301707  7005 raft_consensus.cc:2243] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.302441  7005 raft_consensus.cc:2272] T d05c1b06299e4f849af3d9fd30557015 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.305109  7005 tablet_replica.cc:333] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.305617  7005 raft_consensus.cc:2243] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.305986  7005 raft_consensus.cc:2272] T e88fe7b57e134639b5b247d009a7dcca P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.307468  7005 tablet_replica.cc:333] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.307936  7005 raft_consensus.cc:2243] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.308557  7005 raft_consensus.cc:2272] T f96dd77d22de4acd84586bdf6fdb6495 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.310268  7005 tablet_replica.cc:333] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.310715  7005 raft_consensus.cc:2243] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.311058  7005 raft_consensus.cc:2272] T f41d2e54cb0c41fcbb80ea83d5a6926e P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.312407  7005 tablet_replica.cc:333] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.312839  7005 raft_consensus.cc:2243] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.313457  7005 raft_consensus.cc:2272] T 1cf12fc202f24f838edc3e9f64070a62 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.315153  7005 tablet_replica.cc:333] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.315582  7005 raft_consensus.cc:2243] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.315932  7005 raft_consensus.cc:2272] T 507624b34d3d4637969f13db4bab16e6 P bf645723685c4cf28c0e927e7f5ebd93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.317268  7005 tablet_replica.cc:333] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.317736  7005 raft_consensus.cc:2243] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.318056  7005 raft_consensus.cc:2272] T 33ab222d664349a0aef7aafe15febbd4 P bf645723685c4cf28c0e927e7f5ebd93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.319450  7005 tablet_replica.cc:333] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.319839  7005 raft_consensus.cc:2243] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.320166  7005 raft_consensus.cc:2272] T 8fce25b5ab4f435a8c7151d84d895b16 P bf645723685c4cf28c0e927e7f5ebd93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.321887  7005 tablet_replica.cc:333] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93: stopping tablet replica
I20260709 13:02:26.322280  7005 raft_consensus.cc:2243] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.322615  7005 raft_consensus.cc:2272] T 5549324d1b9245ce8af265ab264ee439 P bf645723685c4cf28c0e927e7f5ebd93 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.409168  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
I20260709 13:02:26.428294  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
I20260709 13:02:26.450934  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:26.451488  7005 tablet_replica.cc:333] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.452047  7005 raft_consensus.cc:2243] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.452726  7005 raft_consensus.cc:2272] T 33ab222d664349a0aef7aafe15febbd4 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.454342  7005 tablet_replica.cc:333] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.454762  7005 raft_consensus.cc:2243] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.455170  7005 raft_consensus.cc:2272] T 1cf12fc202f24f838edc3e9f64070a62 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.457064  7005 tablet_replica.cc:333] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.457566  7005 raft_consensus.cc:2243] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.457890  7005 raft_consensus.cc:2272] T 8fce25b5ab4f435a8c7151d84d895b16 P da851454051846b1a0b043afcb3e9291 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.459652  7005 tablet_replica.cc:333] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.460078  7005 raft_consensus.cc:2243] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.460690  7005 raft_consensus.cc:2272] T e88fe7b57e134639b5b247d009a7dcca P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.462212  7005 tablet_replica.cc:333] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.462603  7005 raft_consensus.cc:2243] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.462913  7005 raft_consensus.cc:2272] T 5549324d1b9245ce8af265ab264ee439 P da851454051846b1a0b043afcb3e9291 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.464686  7005 tablet_replica.cc:333] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.465099  7005 raft_consensus.cc:2243] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.465794  7005 raft_consensus.cc:2272] T 507624b34d3d4637969f13db4bab16e6 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.467293  7005 tablet_replica.cc:333] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.467669  7005 raft_consensus.cc:2243] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.467975  7005 raft_consensus.cc:2272] T d05c1b06299e4f849af3d9fd30557015 P da851454051846b1a0b043afcb3e9291 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.469699  7005 tablet_replica.cc:333] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.470081  7005 raft_consensus.cc:2243] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.470383  7005 raft_consensus.cc:2272] T f96dd77d22de4acd84586bdf6fdb6495 P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.472069  7005 tablet_replica.cc:333] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291: stopping tablet replica
I20260709 13:02:26.472442  7005 raft_consensus.cc:2243] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.472754  7005 raft_consensus.cc:2272] T f41d2e54cb0c41fcbb80ea83d5a6926e P da851454051846b1a0b043afcb3e9291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.499342  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
I20260709 13:02:26.515353  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
I20260709 13:02:26.537041  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:26.537672  7005 tablet_replica.cc:333] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.538226  7005 raft_consensus.cc:2243] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.538973  7005 raft_consensus.cc:2272] T 5549324d1b9245ce8af265ab264ee439 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.540895  7005 tablet_replica.cc:333] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.541414  7005 raft_consensus.cc:2243] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.541816  7005 raft_consensus.cc:2272] T 507624b34d3d4637969f13db4bab16e6 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.543320  7005 tablet_replica.cc:333] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.543773  7005 raft_consensus.cc:2243] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.544109  7005 raft_consensus.cc:2272] T 33ab222d664349a0aef7aafe15febbd4 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.545889  7005 tablet_replica.cc:333] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.546341  7005 raft_consensus.cc:2243] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.546691  7005 raft_consensus.cc:2272] T d05c1b06299e4f849af3d9fd30557015 P 1f6889e296e64aa8965a17175dd0691f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.548574  7005 tablet_replica.cc:333] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.548998  7005 raft_consensus.cc:2243] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.549337  7005 raft_consensus.cc:2272] T 1cf12fc202f24f838edc3e9f64070a62 P 1f6889e296e64aa8965a17175dd0691f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.551082  7005 tablet_replica.cc:333] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.551506  7005 raft_consensus.cc:2243] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.552141  7005 raft_consensus.cc:2272] T 8fce25b5ab4f435a8c7151d84d895b16 P 1f6889e296e64aa8965a17175dd0691f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.553862  7005 tablet_replica.cc:333] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.554319  7005 raft_consensus.cc:2243] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.554935  7005 raft_consensus.cc:2272] T f41d2e54cb0c41fcbb80ea83d5a6926e P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.556262  7005 tablet_replica.cc:333] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.556667  7005 raft_consensus.cc:2243] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.557010  7005 raft_consensus.cc:2272] T f96dd77d22de4acd84586bdf6fdb6495 P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.559039  7005 tablet_replica.cc:333] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f: stopping tablet replica
I20260709 13:02:26.559471  7005 raft_consensus.cc:2243] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:26.559818  7005 raft_consensus.cc:2272] T e88fe7b57e134639b5b247d009a7dcca P 1f6889e296e64aa8965a17175dd0691f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.584777  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
I20260709 13:02:26.599587  7005 master.cc:562] Master@127.6.215.126:40495 shutting down...
I20260709 13:02:26.732060  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:26.732580  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:26.732889  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6c0856ac398745fe9db4a1305ad3ed8c: stopping tablet replica
I20260709 13:02:26.750888  7005 master.cc:584] Master@127.6.215.126:40495 shutdown complete.
1f6889e296e64aa8965a17175dd0691f  1
bf645723685c4cf28c0e927e7f5ebd93  4
da851454051846b1a0b043afcb3e9291  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14341 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:02:26.787549  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:45489
I20260709 13:02:26.788594  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:26.793464  7530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:26.794070  7531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:26.794940  7533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:26.795867  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:26.796597  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:26.796764  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:26.796904  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602146796889 us; error 0 us; skew 500 ppm
I20260709 13:02:26.797433  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:26.799919  7005 webserver.cc:533] Webserver started at http://127.6.215.126:33353/ using document root <none> and password file <none>
I20260709 13:02:26.800374  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:26.800536  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:26.800791  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:26.801865  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "6945cd928595473ba6e2efb02067991d"
format_stamp: "Formatted at 2026-07-09 13:02:26 on dist-test-slave-r31z"
I20260709 13:02:26.805871  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:02:26.808884  7538 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:26.809587  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:26.809851  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "6945cd928595473ba6e2efb02067991d"
format_stamp: "Formatted at 2026-07-09 13:02:26 on dist-test-slave-r31z"
I20260709 13:02:26.810120  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:26.822358  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:26.823498  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:26.859258  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:45489
I20260709 13:02:26.859340  7589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:45489 every 8 connection(s)
I20260709 13:02:26.862993  7590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.871769  7590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d: Bootstrap starting.
I20260709 13:02:26.875991  7590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.879698  7590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d: No bootstrap required, opened a new log
I20260709 13:02:26.881625  7590 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6945cd928595473ba6e2efb02067991d" member_type: VOTER }
I20260709 13:02:26.881978  7590 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.882189  7590 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6945cd928595473ba6e2efb02067991d, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.882685  7590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6945cd928595473ba6e2efb02067991d" member_type: VOTER }
I20260709 13:02:26.883080  7590 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:26.883285  7590 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:26.883525  7590 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.887326  7590 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6945cd928595473ba6e2efb02067991d" member_type: VOTER }
I20260709 13:02:26.887763  7590 leader_election.cc:304] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6945cd928595473ba6e2efb02067991d; no voters: 
I20260709 13:02:26.888761  7590 leader_election.cc:290] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:26.889060  7593 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.890213  7593 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 1 LEADER]: Becoming Leader. State: Replica: 6945cd928595473ba6e2efb02067991d, State: Running, Role: LEADER
I20260709 13:02:26.890810  7593 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6945cd928595473ba6e2efb02067991d" member_type: VOTER }
I20260709 13:02:26.891330  7590 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:26.895200  7594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6945cd928595473ba6e2efb02067991d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6945cd928595473ba6e2efb02067991d" member_type: VOTER } }
I20260709 13:02:26.895325  7595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6945cd928595473ba6e2efb02067991d. Latest consensus state: current_term: 1 leader_uuid: "6945cd928595473ba6e2efb02067991d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6945cd928595473ba6e2efb02067991d" member_type: VOTER } }
I20260709 13:02:26.895738  7594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:26.895750  7595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:26.903396  7600 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:26.908460  7600 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:26.909416  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:26.916366  7600 catalog_manager.cc:1383] Generated new cluster ID: 40ff92d473094a9e9caa9616a9d36972
I20260709 13:02:26.916631  7600 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:26.937032  7600 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:26.938203  7600 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:26.953953  7600 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d: Generated new TSK 0
I20260709 13:02:26.954525  7600 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:26.975612  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:26.981153  7611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:26.981801  7612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:26.984494  7005 server_base.cc:1061] running on GCE node
W20260709 13:02:26.984470  7614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:26.985529  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:26.985720  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:26.985986  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602146985950 us; error 0 us; skew 500 ppm
I20260709 13:02:26.986639  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:26.989038  7005 webserver.cc:533] Webserver started at http://127.6.215.65:39403/ using document root <none> and password file <none>
I20260709 13:02:26.989529  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:26.989699  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:26.989950  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:26.990896  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
format_stamp: "Formatted at 2026-07-09 13:02:26 on dist-test-slave-r31z"
I20260709 13:02:26.995010  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:26.997927  7619 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:26.998636  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:26.998860  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
format_stamp: "Formatted at 2026-07-09 13:02:26 on dist-test-slave-r31z"
I20260709 13:02:26.999086  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:27.023625  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:27.024763  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:27.026623  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:27.028860  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:27.029034  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.029206  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:27.029395  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.069783  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:42367
I20260709 13:02:27.069908  7681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:42367 every 8 connection(s)
I20260709 13:02:27.075017  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:27.081825  7686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:27.082712  7687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:27.088011  7689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:27.088124  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:27.089917  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:27.090165  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:27.090443  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602147090424 us; error 0 us; skew 500 ppm
I20260709 13:02:27.091650  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:27.093626  7682 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45489
I20260709 13:02:27.094024  7682 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:27.094638  7005 webserver.cc:533] Webserver started at http://127.6.215.66:40667/ using document root <none> and password file <none>
I20260709 13:02:27.094978  7682 heartbeater.cc:507] Master 127.6.215.126:45489 requested a full tablet report, sending...
I20260709 13:02:27.095348  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:27.095594  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:27.095893  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:27.097149  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "b960ef56844d4093aa3a3963cf68e717"
format_stamp: "Formatted at 2026-07-09 13:02:27 on dist-test-slave-r31z"
I20260709 13:02:27.097394  7555 ts_manager.cc:194] Registered new tserver with Master: 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367)
I20260709 13:02:27.099129  7555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34764
I20260709 13:02:27.101639  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:02:27.104902  7694 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.105758  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:27.106025  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "b960ef56844d4093aa3a3963cf68e717"
format_stamp: "Formatted at 2026-07-09 13:02:27 on dist-test-slave-r31z"
I20260709 13:02:27.106278  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:27.130375  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:27.131515  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:27.133859  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:27.136154  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:27.136364  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.136602  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:27.136744  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.176846  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:44257
I20260709 13:02:27.176964  7756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:44257 every 8 connection(s)
I20260709 13:02:27.181097  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:27.187482  7760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:27.189180  7761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:27.192306  7763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:27.193080  7757 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45489
I20260709 13:02:27.193240  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:27.193485  7757 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:27.194191  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:02:27.194331  7757 heartbeater.cc:507] Master 127.6.215.126:45489 requested a full tablet report, sending...
W20260709 13:02:27.194468  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:27.194677  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602147194659 us; error 0 us; skew 500 ppm
I20260709 13:02:27.195338  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:27.196494  7555 ts_manager.cc:194] Registered new tserver with Master: b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:27.198052  7005 webserver.cc:533] Webserver started at http://127.6.215.67:36725/ using document root <none> and password file <none>
I20260709 13:02:27.198393  7555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34780
I20260709 13:02:27.198824  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:27.199112  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:27.199448  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:27.201057  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
format_stamp: "Formatted at 2026-07-09 13:02:27 on dist-test-slave-r31z"
I20260709 13:02:27.205272  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:02:27.208460  7768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.209247  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:27.209571  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
format_stamp: "Formatted at 2026-07-09 13:02:27 on dist-test-slave-r31z"
I20260709 13:02:27.209858  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:27.244565  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:27.245734  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:27.247304  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:27.249310  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:27.249516  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.249725  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:27.249876  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:27.290975  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:42611
I20260709 13:02:27.291077  7830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:42611 every 8 connection(s)
I20260709 13:02:27.303869  7831 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45489
I20260709 13:02:27.304178  7831 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:27.304808  7831 heartbeater.cc:507] Master 127.6.215.126:45489 requested a full tablet report, sending...
I20260709 13:02:27.306645  7555 ts_manager.cc:194] Registered new tserver with Master: b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:27.307391  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013382519s
I20260709 13:02:27.307868  7555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34788
I20260709 13:02:27.331192  7555 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34802:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:27.333820  7555 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:27.398561  7721 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca814b458364fba8f76dd3bcb536893 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:27.400110  7721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca814b458364fba8f76dd3bcb536893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.400636  7722 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4d427579bf4788a9b4d6d101732c3c (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:27.401993  7722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4d427579bf4788a9b4d6d101732c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.404443  7720 tablet_service.cc:1511] Processing CreateTablet for tablet 504d0ec746714fa89adcac1ef4849bad (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:27.406265  7720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504d0ec746714fa89adcac1ef4849bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.424724  7719 tablet_service.cc:1511] Processing CreateTablet for tablet 58123953cef94ce2b27fecff7f81e239 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:27.426106  7719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58123953cef94ce2b27fecff7f81e239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.428574  7796 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4d427579bf4788a9b4d6d101732c3c (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:27.429900  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4d427579bf4788a9b4d6d101732c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.430791  7845 tablet_bootstrap.cc:492] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.431020  7794 tablet_service.cc:1511] Processing CreateTablet for tablet 504d0ec746714fa89adcac1ef4849bad (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:27.432545  7794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504d0ec746714fa89adcac1ef4849bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.434271  7795 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca814b458364fba8f76dd3bcb536893 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:27.435537  7795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca814b458364fba8f76dd3bcb536893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.437655  7845 tablet_bootstrap.cc:654] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.448984  7647 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4d427579bf4788a9b4d6d101732c3c (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:27.450307  7647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4d427579bf4788a9b4d6d101732c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.452625  7643 tablet_service.cc:1511] Processing CreateTablet for tablet 318ad11941004771b6f7ec05d8919358 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:27.454557  7720 tablet_service.cc:1511] Processing CreateTablet for tablet 318ad11941004771b6f7ec05d8919358 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:27.455588  7645 tablet_service.cc:1511] Processing CreateTablet for tablet 504d0ec746714fa89adcac1ef4849bad (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:27.455979  7720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318ad11941004771b6f7ec05d8919358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.454463  7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318ad11941004771b6f7ec05d8919358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.457690  7644 tablet_service.cc:1511] Processing CreateTablet for tablet 58123953cef94ce2b27fecff7f81e239 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:27.454470  7646 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca814b458364fba8f76dd3bcb536893 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:27.459685  7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58123953cef94ce2b27fecff7f81e239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.461651  7793 tablet_service.cc:1511] Processing CreateTablet for tablet 58123953cef94ce2b27fecff7f81e239 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:27.462878  7793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58123953cef94ce2b27fecff7f81e239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.466332  7792 tablet_service.cc:1511] Processing CreateTablet for tablet 318ad11941004771b6f7ec05d8919358 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:27.467734  7792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318ad11941004771b6f7ec05d8919358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.470216  7646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca814b458364fba8f76dd3bcb536893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.481760  7645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504d0ec746714fa89adcac1ef4849bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.500877  7848 tablet_bootstrap.cc:492] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.500886  7847 tablet_bootstrap.cc:492] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.507030  7721 tablet_service.cc:1511] Processing CreateTablet for tablet 59ae2e17985b46ea8187f2b2a7ed948f (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:27.507485  7848 tablet_bootstrap.cc:654] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.508339  7721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ae2e17985b46ea8187f2b2a7ed948f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.512151  7642 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd71891f0a418eb3aee1e0f3b8c809 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:27.513439  7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd71891f0a418eb3aee1e0f3b8c809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.513569  7845 tablet_bootstrap.cc:492] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.512012  7795 tablet_service.cc:1511] Processing CreateTablet for tablet 59ae2e17985b46ea8187f2b2a7ed948f (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:27.513983  7845 ts_tablet_manager.cc:1403] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.009s
I20260709 13:02:27.513808  7643 tablet_service.cc:1511] Processing CreateTablet for tablet 59ae2e17985b46ea8187f2b2a7ed948f (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:27.518448  7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ae2e17985b46ea8187f2b2a7ed948f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.518975  7847 tablet_bootstrap.cc:654] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.521425  7722 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd71891f0a418eb3aee1e0f3b8c809 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:27.534781  7722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd71891f0a418eb3aee1e0f3b8c809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.525207  7718 tablet_service.cc:1511] Processing CreateTablet for tablet a86660ee624e4c3c956beafdb41d1e80 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:27.538092  7718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86660ee624e4c3c956beafdb41d1e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.525925  7845 raft_consensus.cc:359] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.539016  7845 raft_consensus.cc:385] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.539440  7845 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.540186  7845 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.526676  7644 tablet_service.cc:1511] Processing CreateTablet for tablet a86660ee624e4c3c956beafdb41d1e80 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:27.527077  7795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ae2e17985b46ea8187f2b2a7ed948f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.545485  7793 tablet_service.cc:1511] Processing CreateTablet for tablet a86660ee624e4c3c956beafdb41d1e80 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:27.528147  7796 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd71891f0a418eb3aee1e0f3b8c809 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:27.547060  7793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86660ee624e4c3c956beafdb41d1e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.547808  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd71891f0a418eb3aee1e0f3b8c809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.550469  7845 ts_tablet_manager.cc:1434] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:02:27.551389  7845 tablet_bootstrap.cc:492] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.552855  7757 heartbeater.cc:499] Master 127.6.215.126:45489 was elected leader, sending a full tablet report...
I20260709 13:02:27.546675  7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86660ee624e4c3c956beafdb41d1e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.576423  7719 tablet_service.cc:1511] Processing CreateTablet for tablet 4af3294904f146e0a3c1dd4995a02c57 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:27.580417  7647 tablet_service.cc:1511] Processing CreateTablet for tablet 4af3294904f146e0a3c1dd4995a02c57 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:27.587329  7647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af3294904f146e0a3c1dd4995a02c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.591903  7845 tablet_bootstrap.cc:654] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.585091  7796 tablet_service.cc:1511] Processing CreateTablet for tablet 4af3294904f146e0a3c1dd4995a02c57 (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:27.581259  7719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af3294904f146e0a3c1dd4995a02c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.594365  7646 tablet_service.cc:1511] Processing CreateTablet for tablet 35ec56b03c9047cd94b86a821ed22fdb (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:27.598253  7848 tablet_bootstrap.cc:492] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.598692  7848 ts_tablet_manager.cc:1403] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.023s
I20260709 13:02:27.600441  7646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ec56b03c9047cd94b86a821ed22fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.601054  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af3294904f146e0a3c1dd4995a02c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.601318  7848 raft_consensus.cc:359] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.604871  7848 raft_consensus.cc:385] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.605152  7848 raft_consensus.cc:740] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.606050  7848 consensus_queue.cc:260] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.609143  7847 tablet_bootstrap.cc:492] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.609580  7847 ts_tablet_manager.cc:1403] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.109s	user 0.009s	sys 0.010s
I20260709 13:02:27.613293  7847 raft_consensus.cc:359] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.613960  7847 raft_consensus.cc:385] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.614215  7847 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.615739  7721 tablet_service.cc:1511] Processing CreateTablet for tablet 35ec56b03c9047cd94b86a821ed22fdb (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:27.616532  7848 ts_tablet_manager.cc:1434] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 13:02:27.617038  7721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ec56b03c9047cd94b86a821ed22fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.617489  7848 tablet_bootstrap.cc:492] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.617610  7847 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.621754  7682 heartbeater.cc:499] Master 127.6.215.126:45489 was elected leader, sending a full tablet report...
I20260709 13:02:27.623478  7848 tablet_bootstrap.cc:654] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.630421  7845 tablet_bootstrap.cc:492] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.631047  7845 ts_tablet_manager.cc:1403] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:02:27.633781  7845 raft_consensus.cc:359] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.634445  7845 raft_consensus.cc:385] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.634696  7848 tablet_bootstrap.cc:492] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.635197  7848 ts_tablet_manager.cc:1403] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 13:02:27.634724  7845 raft_consensus.cc:740] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.638136  7845 consensus_queue.cc:260] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.639500  7848 raft_consensus.cc:359] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.640151  7848 raft_consensus.cc:385] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.640420  7848 raft_consensus.cc:740] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.641079  7848 consensus_queue.cc:260] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.645314  7845 ts_tablet_manager.cc:1434] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:27.646297  7845 tablet_bootstrap.cc:492] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.649469  7792 tablet_service.cc:1511] Processing CreateTablet for tablet 35ec56b03c9047cd94b86a821ed22fdb (DEFAULT_TABLE table=test-workload [id=cb65758e63fa433486e19b08d908ae7d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:27.651010  7792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ec56b03c9047cd94b86a821ed22fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:27.651321  7848 ts_tablet_manager.cc:1434] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:02:27.652482  7848 tablet_bootstrap.cc:492] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.667790  7831 heartbeater.cc:499] Master 127.6.215.126:45489 was elected leader, sending a full tablet report...
I20260709 13:02:27.667816  7856 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.669157  7856 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.675099  7845 tablet_bootstrap.cc:654] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.682619  7848 tablet_bootstrap.cc:654] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.678875  7856 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367)
I20260709 13:02:27.694868  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" is_pre_election: true
W20260709 13:02:27.696241  7769 leader_election.cc:343] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.692920  7847 ts_tablet_manager.cc:1434] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.083s	user 0.022s	sys 0.019s
I20260709 13:02:27.697762  7847 tablet_bootstrap.cc:492] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.704753  7847 tablet_bootstrap.cc:654] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.715476  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:27.716084  7732 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 0.
I20260709 13:02:27.718133  7771 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:27.718966  7856 raft_consensus.cc:2804] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.719357  7856 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.719607  7845 tablet_bootstrap.cc:492] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.720155  7845 ts_tablet_manager.cc:1403] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.006s
I20260709 13:02:27.719702  7856 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.723300  7848 tablet_bootstrap.cc:492] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.723455  7847 tablet_bootstrap.cc:492] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.723349  7845 raft_consensus.cc:359] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.723975  7848 ts_tablet_manager.cc:1403] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.010s
I20260709 13:02:27.724167  7847 ts_tablet_manager.cc:1403] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:02:27.724205  7845 raft_consensus.cc:385] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.724752  7845 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.725562  7845 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.726620  7848 raft_consensus.cc:359] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.727439  7848 raft_consensus.cc:385] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.727391  7847 raft_consensus.cc:359] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.728024  7848 raft_consensus.cc:740] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.728227  7847 raft_consensus.cc:385] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.727111  7856 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.728680  7847 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.728886  7848 consensus_queue.cc:260] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.729604  7847 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.731612  7847 ts_tablet_manager.cc:1434] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:27.732477  7847 tablet_bootstrap.cc:492] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.733069  7845 ts_tablet_manager.cc:1434] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:27.734154  7845 tablet_bootstrap.cc:492] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.735383  7848 ts_tablet_manager.cc:1434] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:27.736375  7848 tablet_bootstrap.cc:492] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.738626  7847 tablet_bootstrap.cc:654] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.739986  7845 tablet_bootstrap.cc:654] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.740746  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:27.741290  7732 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.741645  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
W20260709 13:02:27.743083  7769 leader_election.cc:343] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.743623  7856 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367)
I20260709 13:02:27.746922  7847 tablet_bootstrap.cc:492] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.747433  7847 ts_tablet_manager.cc:1403] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:02:27.750080  7847 raft_consensus.cc:359] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.750602  7732 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 1.
I20260709 13:02:27.750793  7847 raft_consensus.cc:385] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.751310  7847 raft_consensus.cc:740] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.750857  7845 tablet_bootstrap.cc:492] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.752115  7845 ts_tablet_manager.cc:1403] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:02:27.752017  7847 consensus_queue.cc:260] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.754289  7847 ts_tablet_manager.cc:1434] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:27.755154  7847 tablet_bootstrap.cc:492] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.755184  7845 raft_consensus.cc:359] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.755990  7845 raft_consensus.cc:385] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.756265  7845 raft_consensus.cc:740] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.757030  7845 consensus_queue.cc:260] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.758771  7771 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:27.759593  7856 raft_consensus.cc:2804] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.760033  7856 raft_consensus.cc:697] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:27.760877  7856 consensus_queue.cc:237] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.761443  7847 tablet_bootstrap.cc:654] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.761476  7845 ts_tablet_manager.cc:1434] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:27.762490  7845 tablet_bootstrap.cc:492] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.764452  7848 tablet_bootstrap.cc:654] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.775727  7845 tablet_bootstrap.cc:654] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.776038  7853 raft_consensus.cc:493] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.776463  7853 raft_consensus.cc:515] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.783069  7553 catalog_manager.cc:5697] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.789268  7847 tablet_bootstrap.cc:492] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.787361  7853 leader_election.cc:290] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:27.793596  7847 ts_tablet_manager.cc:1403] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.019s
I20260709 13:02:27.798014  7856 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.798151  7847 raft_consensus.cc:359] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.798843  7847 raft_consensus.cc:385] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.799117  7847 raft_consensus.cc:740] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.799839  7847 consensus_queue.cc:260] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.798449  7856 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.802088  7847 ts_tablet_manager.cc:1434] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:27.802996  7847 tablet_bootstrap.cc:492] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.803658  7856 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:27.805501  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:27.806116  7732 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 0.
I20260709 13:02:27.808106  7771 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:27.809203  7847 tablet_bootstrap.cc:654] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.809244  7848 tablet_bootstrap.cc:492] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.810257  7848 ts_tablet_manager.cc:1403] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.009s
I20260709 13:02:27.812029  7856 raft_consensus.cc:2804] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.812467  7856 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.812862  7856 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.819852  7856 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.823477  7848 raft_consensus.cc:359] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.824044  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:27.824422  7848 raft_consensus.cc:385] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.824731  7732 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.831928  7732 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 1.
I20260709 13:02:27.833114  7771 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:27.833278  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" is_pre_election: true
I20260709 13:02:27.834010  7854 raft_consensus.cc:2804] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.834115  7856 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:27.824822  7848 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.835373  7848 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.836304  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:27.837699  7848 ts_tablet_manager.cc:1434] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:02:27.838835  7848 tablet_bootstrap.cc:492] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.844769  7848 tablet_bootstrap.cc:654] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.849640  7845 tablet_bootstrap.cc:492] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.850179  7845 ts_tablet_manager.cc:1403] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.056s
W20260709 13:02:27.853924  7769 leader_election.cc:343] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:27.855069  7769 leader_election.cc:343] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.853659  7845 raft_consensus.cc:359] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.855764  7845 raft_consensus.cc:385] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.856009  7845 raft_consensus.cc:740] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.856580  7845 consensus_queue.cc:260] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.857204  7847 tablet_bootstrap.cc:492] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.857699  7847 ts_tablet_manager.cc:1403] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.010s
I20260709 13:02:27.858258  7854 raft_consensus.cc:697] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:27.858469  7845 ts_tablet_manager.cc:1434] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:27.859403  7845 tablet_bootstrap.cc:492] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.859122  7854 consensus_queue.cc:237] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.865162  7847 raft_consensus.cc:359] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.865861  7847 raft_consensus.cc:385] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.866134  7847 raft_consensus.cc:740] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.866783  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:27.867450  7806 raft_consensus.cc:2468] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:27.867534  7847 consensus_queue.cc:260] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.869338  7620 leader_election.cc:304] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:27.870095  7853 raft_consensus.cc:2804] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.870455  7853 raft_consensus.cc:493] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.870846  7853 raft_consensus.cc:3060] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.872255  7847 ts_tablet_manager.cc:1434] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:27.873145  7847 tablet_bootstrap.cc:492] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.874315  7553 catalog_manager.cc:5697] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.878948  7847 tablet_bootstrap.cc:654] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.879377  7853 raft_consensus.cc:515] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.880242  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:27.880806  7732 raft_consensus.cc:2468] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:27.881307  7853 leader_election.cc:290] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:27.870523  7848 tablet_bootstrap.cc:492] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.881999  7848 ts_tablet_manager.cc:1403] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.009s
I20260709 13:02:27.883097  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:27.883591  7732 raft_consensus.cc:3060] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.884663  7848 raft_consensus.cc:359] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.885321  7848 raft_consensus.cc:385] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.886323  7848 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.886663  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:27.887164  7806 raft_consensus.cc:3060] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.887075  7848 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.889153  7848 ts_tablet_manager.cc:1434] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:02:27.893071  7848 tablet_bootstrap.cc:492] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.895371  7845 tablet_bootstrap.cc:654] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.897874  7806 raft_consensus.cc:2468] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:27.899108  7620 leader_election.cc:304] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:27.899996  7853 raft_consensus.cc:2804] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.901961  7848 tablet_bootstrap.cc:654] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:27.905222  7603 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:27.905860  7847 tablet_bootstrap.cc:492] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.906368  7847 ts_tablet_manager.cc:1403] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.021s
I20260709 13:02:27.901299  7732 raft_consensus.cc:2468] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:27.909085  7847 raft_consensus.cc:359] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.909981  7847 raft_consensus.cc:385] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.910308  7847 raft_consensus.cc:740] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.911039  7847 consensus_queue.cc:260] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.911718  7853 raft_consensus.cc:697] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:27.911748  7848 tablet_bootstrap.cc:492] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.912906  7848 ts_tablet_manager.cc:1403] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.005s
I20260709 13:02:27.912597  7853 consensus_queue.cc:237] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.916474  7848 raft_consensus.cc:359] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.917070  7848 raft_consensus.cc:385] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.917296  7848 raft_consensus.cc:740] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.918080  7848 consensus_queue.cc:260] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.918917  7845 tablet_bootstrap.cc:492] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.919404  7845 ts_tablet_manager.cc:1403] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.005s
I20260709 13:02:27.919989  7847 ts_tablet_manager.cc:1434] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:02:27.920099  7848 ts_tablet_manager.cc:1434] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:27.922318  7845 raft_consensus.cc:359] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.923135  7845 raft_consensus.cc:385] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.923465  7845 raft_consensus.cc:740] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.924010  7848 tablet_bootstrap.cc:492] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.924387  7845 consensus_queue.cc:260] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.925371  7847 tablet_bootstrap.cc:492] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.925477  7555 catalog_manager.cc:5697] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.929307  7845 ts_tablet_manager.cc:1434] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:27.930321  7845 tablet_bootstrap.cc:492] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.931255  7848 tablet_bootstrap.cc:654] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.931492  7847 tablet_bootstrap.cc:654] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.936342  7845 tablet_bootstrap.cc:654] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.949052  7845 tablet_bootstrap.cc:492] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:27.949641  7845 ts_tablet_manager.cc:1403] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:02:27.951229  7853 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.951465  7847 tablet_bootstrap.cc:492] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.951663  7848 tablet_bootstrap.cc:492] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.951704  7853 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:27.952037  7847 ts_tablet_manager.cc:1403] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 13:02:27.951961  7845 raft_consensus.cc:359] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.952569  7848 ts_tablet_manager.cc:1403] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:02:27.952733  7845 raft_consensus.cc:385] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.953063  7845 raft_consensus.cc:740] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.953872  7845 consensus_queue.cc:260] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.954437  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:27.955137  7732 raft_consensus.cc:2393] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fd9f2199c5548aebf0ea181fcd143b9 in current term 1: Already voted for candidate b9da8d26218947d3bbe14ca6ea03fc37 in this term.
I20260709 13:02:27.955025  7847 raft_consensus.cc:359] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.955715  7847 raft_consensus.cc:385] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.956023  7847 raft_consensus.cc:740] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.956275  7848 raft_consensus.cc:359] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.957036  7848 raft_consensus.cc:385] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.956835  7847 consensus_queue.cc:260] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.957392  7848 raft_consensus.cc:740] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.958081  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:27.958287  7845 ts_tablet_manager.cc:1434] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:27.958276  7848 consensus_queue.cc:260] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.959297  7845 tablet_bootstrap.cc:492] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:27.959487  7620 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9; no voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:27.960749  7848 ts_tablet_manager.cc:1434] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:27.960796  7847 ts_tablet_manager.cc:1434] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:27.961874  7848 tablet_bootstrap.cc:492] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.961874  7847 tablet_bootstrap.cc:492] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.960673  7875 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.968767  7848 tablet_bootstrap.cc:654] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.969327  7847 tablet_bootstrap.cc:654] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.971314  7853 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:27.980543  7845 tablet_bootstrap.cc:654] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.981698  7848 tablet_bootstrap.cc:492] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:27.981829  7847 tablet_bootstrap.cc:492] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:27.974172  7875 raft_consensus.cc:2749] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.982228  7848 ts_tablet_manager.cc:1403] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:02:27.982268  7847 ts_tablet_manager.cc:1403] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:02:27.984817  7847 raft_consensus.cc:359] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.984957  7848 raft_consensus.cc:359] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.985519  7847 raft_consensus.cc:385] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.985661  7848 raft_consensus.cc:385] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.985872  7847 raft_consensus.cc:740] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.985999  7848 raft_consensus.cc:740] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.986711  7847 consensus_queue.cc:260] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.986728  7848 consensus_queue.cc:260] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:27.990921  7847 ts_tablet_manager.cc:1434] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:27.991453  7848 ts_tablet_manager.cc:1434] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:27.991761  7847 tablet_bootstrap.cc:492] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:27.992362  7848 tablet_bootstrap.cc:492] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:27.997573  7848 tablet_bootstrap.cc:654] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.997573  7847 tablet_bootstrap.cc:654] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:28.002243  7851 raft_consensus.cc:493] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.002702  7851 raft_consensus.cc:515] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.005213  7851 leader_election.cc:290] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.011524  7848 tablet_bootstrap.cc:492] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:28.012319  7848 ts_tablet_manager.cc:1403] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:02:28.014137  7875 raft_consensus.cc:493] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.014627  7875 raft_consensus.cc:515] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.015508  7848 raft_consensus.cc:359] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.015908  7845 tablet_bootstrap.cc:492] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:28.016145  7848 raft_consensus.cc:385] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.016412  7845 ts_tablet_manager.cc:1403] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.007s
I20260709 13:02:28.016438  7848 raft_consensus.cc:740] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.016710  7875 leader_election.cc:290] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.017251  7848 consensus_queue.cc:260] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.019055  7848 ts_tablet_manager.cc:1434] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:28.019076  7845 raft_consensus.cc:359] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.019537  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.019837  7845 raft_consensus.cc:385] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.019942  7848 tablet_bootstrap.cc:492] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9: Bootstrap starting.
I20260709 13:02:28.020136  7845 raft_consensus.cc:740] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.019181  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:28.020890  7845 consensus_queue.cc:260] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.022840  7845 ts_tablet_manager.cc:1434] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:28.023409  7732 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.024147  7845 tablet_bootstrap.cc:492] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:28.025719  7848 tablet_bootstrap.cc:654] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:28.027464  7622 leader_election.cc:304] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.028498  7881 raft_consensus.cc:2804] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.028868  7881 raft_consensus.cc:493] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.029187  7881 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.030025  7845 tablet_bootstrap.cc:654] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:28.046862  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" is_pre_election: true
I20260709 13:02:28.047513  7657 raft_consensus.cc:2468] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 0.
I20260709 13:02:28.048791  7695 leader_election.cc:304] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.020121  7806 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.049691  7851 raft_consensus.cc:2804] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.050074  7851 raft_consensus.cc:493] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.050384  7851 raft_consensus.cc:3060] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.054557  7875 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.055145  7875 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.058359  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.061640  7806 raft_consensus.cc:2468] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 0.
I20260709 13:02:28.065315  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:28.066359  7732 raft_consensus.cc:2393] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fd9f2199c5548aebf0ea181fcd143b9 in current term 1: Already voted for candidate b9da8d26218947d3bbe14ca6ea03fc37 in this term.
I20260709 13:02:28.069162  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.071749  7620 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9; no voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:28.072638  7853 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.078181  7875 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.060354  7851 raft_consensus.cc:515] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.079896  7881 raft_consensus.cc:515] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.083246  7848 tablet_bootstrap.cc:492] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9: No bootstrap required, opened a new log
I20260709 13:02:28.083739  7848 ts_tablet_manager.cc:1403] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent bootstrapping tablet: real 0.064s	user 0.028s	sys 0.031s
I20260709 13:02:28.083534  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:28.084192  7657 raft_consensus.cc:3060] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.085000  7881 leader_election.cc:290] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.084254  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.086911  7732 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.086630  7848 raft_consensus.cc:359] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.087549  7848 raft_consensus.cc:385] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.087780  7845 tablet_bootstrap.cc:492] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:28.087950  7848 raft_consensus.cc:740] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.088195  7845 ts_tablet_manager.cc:1403] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.064s	user 0.039s	sys 0.022s
I20260709 13:02:28.088810  7848 consensus_queue.cc:260] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.089915  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.090720  7806 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.090739  7845 raft_consensus.cc:359] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.091387  7848 ts_tablet_manager.cc:1434] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:28.091534  7845 raft_consensus.cc:385] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.091956  7845 raft_consensus.cc:740] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.092852  7845 consensus_queue.cc:260] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.093750  7732 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.094940  7622 leader_election.cc:304] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.095738  7881 raft_consensus.cc:2804] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.095875  7657 raft_consensus.cc:2468] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 1.
I20260709 13:02:28.096302  7881 raft_consensus.cc:697] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.096995  7695 leader_election.cc:304] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.097131  7881 consensus_queue.cc:237] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.080622  7853 raft_consensus.cc:2749] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:28.100929  7891 raft_consensus.cc:2804] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.101397  7891 raft_consensus.cc:697] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:28.102166  7853 raft_consensus.cc:493] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.102593  7853 raft_consensus.cc:515] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.103456  7845 ts_tablet_manager.cc:1434] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:02:28.104350  7845 tablet_bootstrap.cc:492] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717: Bootstrap starting.
I20260709 13:02:28.105258  7731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:28.105916  7731 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.107350  7622 leader_election.cc:304] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.109598  7847 tablet_bootstrap.cc:492] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:28.110035  7847 ts_tablet_manager.cc:1403] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.010s
I20260709 13:02:28.110677  7875 raft_consensus.cc:2804] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.111028  7875 raft_consensus.cc:493] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.111346  7875 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.112520  7847 raft_consensus.cc:359] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.113152  7847 raft_consensus.cc:385] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.113430  7847 raft_consensus.cc:740] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.114127  7847 consensus_queue.cc:260] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.116500  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.117089  7805 raft_consensus.cc:3060] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.118304  7806 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.121629  7853 leader_election.cc:290] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.121821  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.122416  7806 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.124065  7805 raft_consensus.cc:2468] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 1.
I20260709 13:02:28.124958  7847 ts_tablet_manager.cc:1434] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:02:28.125850  7847 tablet_bootstrap.cc:492] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37: Bootstrap starting.
I20260709 13:02:28.125854  7553 catalog_manager.cc:5697] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.129138  7875 raft_consensus.cc:515] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.102198  7891 consensus_queue.cc:237] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.131772  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.132042  7853 raft_consensus.cc:493] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.132283  7732 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.132054  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.133317  7805 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.134686  7853 raft_consensus.cc:515] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.112746  7851 leader_election.cc:290] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.136865  7853 leader_election.cc:290] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.137079  7731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318ad11941004771b6f7ec05d8919358" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:28.137328  7845 tablet_bootstrap.cc:654] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:28.137673  7731 raft_consensus.cc:2468] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.137902  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318ad11941004771b6f7ec05d8919358" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.138391  7806 raft_consensus.cc:2468] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.137233  7875 leader_election.cc:290] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.139030  7622 leader_election.cc:304] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.139782  7875 raft_consensus.cc:2804] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.140108  7875 raft_consensus.cc:493] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.140394  7875 raft_consensus.cc:3060] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.141211  7847 tablet_bootstrap.cc:654] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:28.144286  7732 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.144681  7875 raft_consensus.cc:515] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.145520  7622 leader_election.cc:304] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.146229  7853 raft_consensus.cc:2804] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.146657  7853 raft_consensus.cc:697] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.146770  7805 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.147243  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318ad11941004771b6f7ec05d8919358" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.147375  7853 consensus_queue.cc:237] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.147799  7732 raft_consensus.cc:3060] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.151156  7875 leader_election.cc:290] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.152057  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318ad11941004771b6f7ec05d8919358" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.152840  7805 raft_consensus.cc:3060] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.156188  7552 catalog_manager.cc:5697] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.159478  7553 catalog_manager.cc:5697] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 0 to 1, leader changed from <none> to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.161715  7805 raft_consensus.cc:2468] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.161774  7732 raft_consensus.cc:2468] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.162894  7620 leader_election.cc:304] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.163722  7853 raft_consensus.cc:2804] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.164170  7853 raft_consensus.cc:697] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.165521  7845 tablet_bootstrap.cc:492] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717: No bootstrap required, opened a new log
I20260709 13:02:28.165170  7853 consensus_queue.cc:237] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.165858  7845 ts_tablet_manager.cc:1403] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.003s
I20260709 13:02:28.167714  7845 raft_consensus.cc:359] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.168303  7845 raft_consensus.cc:385] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.168550  7845 raft_consensus.cc:740] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.169163  7847 tablet_bootstrap.cc:492] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37: No bootstrap required, opened a new log
I20260709 13:02:28.169267  7845 consensus_queue.cc:260] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.169679  7847 ts_tablet_manager.cc:1403] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.004s
I20260709 13:02:28.171366  7891 raft_consensus.cc:493] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.171772  7891 raft_consensus.cc:515] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.173789  7891 leader_election.cc:290] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.174547  7845 ts_tablet_manager.cc:1434] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:28.175163  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af3294904f146e0a3c1dd4995a02c57" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" is_pre_election: true
I20260709 13:02:28.175765  7657 raft_consensus.cc:2468] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 0.
I20260709 13:02:28.176855  7695 leader_election.cc:304] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.177693  7891 raft_consensus.cc:2804] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.178169  7891 raft_consensus.cc:493] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.178483  7891 raft_consensus.cc:3060] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.177678  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af3294904f146e0a3c1dd4995a02c57" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.179041  7805 raft_consensus.cc:2468] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 0.
I20260709 13:02:28.179320  7847 raft_consensus.cc:359] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.179944  7847 raft_consensus.cc:385] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:28.180210  7847 raft_consensus.cc:740] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Initialized, Role: FOLLOWER
I20260709 13:02:28.180047  7552 catalog_manager.cc:5697] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.180840  7847 consensus_queue.cc:260] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.182725  7847 ts_tablet_manager.cc:1434] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.001s
I20260709 13:02:28.185196  7891 raft_consensus.cc:515] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.188038  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af3294904f146e0a3c1dd4995a02c57" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:28.188560  7657 raft_consensus.cc:3060] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.190500  7875 raft_consensus.cc:493] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.190925  7875 raft_consensus.cc:515] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.193382  7875 leader_election.cc:290] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.193864  7875 raft_consensus.cc:493] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.194252  7875 raft_consensus.cc:515] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.194785  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.195372  7805 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.195717  7657 raft_consensus.cc:2468] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 1.
I20260709 13:02:28.196250  7620 leader_election.cc:304] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.196828  7695 leader_election.cc:304] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.197983  7731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:28.198362  7851 raft_consensus.cc:2804] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.198503  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" is_pre_election: true
I20260709 13:02:28.198817  7851 raft_consensus.cc:697] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:28.198702  7731 raft_consensus.cc:2468] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.199275  7805 raft_consensus.cc:2468] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.199707  7851 consensus_queue.cc:237] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.200162  7622 leader_election.cc:304] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.197786  7853 raft_consensus.cc:2804] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.200752  7853 raft_consensus.cc:493] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.201035  7853 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.200999  7881 raft_consensus.cc:2804] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:28.201524  7881 raft_consensus.cc:493] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.201849  7881 raft_consensus.cc:3060] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.198051  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717" is_pre_election: true
I20260709 13:02:28.203256  7891 leader_election.cc:290] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 1 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.203182  7732 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 0.
I20260709 13:02:28.196173  7875 leader_election.cc:290] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.205453  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af3294904f146e0a3c1dd4995a02c57" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.206015  7805 raft_consensus.cc:3060] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.208184  7853 raft_consensus.cc:515] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.210523  7853 leader_election.cc:290] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.211530  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.211993  7806 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.212733  7805 raft_consensus.cc:2468] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 1.
I20260709 13:02:28.213039  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.213557  7732 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.216858  7806 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.210196  7881 raft_consensus.cc:515] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.217715  7620 leader_election.cc:304] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.217875  7732 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.218971  7853 raft_consensus.cc:2804] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.220059  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.220063  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.220132  7881 leader_election.cc:290] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.220834  7732 raft_consensus.cc:3060] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.220935  7806 raft_consensus.cc:3060] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:28.220031  7552 catalog_manager.cc:5697] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 0 to 1, leader changed from <none> to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.220060  7853 raft_consensus.cc:697] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.222311  7853 consensus_queue.cc:237] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.227059  7732 raft_consensus.cc:2468] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.228142  7622 leader_election.cc:304] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.228879  7881 raft_consensus.cc:2804] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:28.228219  7806 raft_consensus.cc:2468] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 1.
I20260709 13:02:28.229311  7881 raft_consensus.cc:697] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.230928  7881 consensus_queue.cc:237] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.234532  7552 catalog_manager.cc:5697] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.245025  7552 catalog_manager.cc:5697] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.256160  7854 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.266292  7854 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.267894  7870 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.283901  7870 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.345497  7806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:28.345973  7806 raft_consensus.cc:606] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:28.350772  7806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:28.351238  7806 raft_consensus.cc:606] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:28.362413  7731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:02:28.362876  7731 raft_consensus.cc:606] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:28.379518  7657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:57766
I20260709 13:02:28.379945  7657 raft_consensus.cc:606] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Received request to transfer leadership to TS b960ef56844d4093aa3a3963cf68e717
I20260709 13:02:28.384155  7657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:57766
I20260709 13:02:28.384549  7657 raft_consensus.cc:606] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Received request to transfer leadership to TS b960ef56844d4093aa3a3963cf68e717
I20260709 13:02:28.388684  7657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:57766
I20260709 13:02:28.389061  7657 raft_consensus.cc:606] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Received request to transfer leadership to TS b960ef56844d4093aa3a3963cf68e717
I20260709 13:02:28.395221  7657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:57766
I20260709 13:02:28.395603  7657 raft_consensus.cc:606] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Received request to transfer leadership to TS b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:28.471792  7881 consensus_queue.cc:1048] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.475620  7881 consensus_queue.cc:1048] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.498883  7853 consensus_queue.cc:1048] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.509272  7881 consensus_queue.cc:1048] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.515643  7875 raft_consensus.cc:993] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:28.516086  7881 raft_consensus.cc:1081] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Signalling peer b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:28.517484  7731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:45232
I20260709 13:02:28.517990  7731 raft_consensus.cc:493] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.518359  7731 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.522904  7731 raft_consensus.cc:515] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.524609  7731 leader_election.cc:290] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.525556  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:28.525926  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.526307  7657 raft_consensus.cc:3055] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.526449  7806 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.526618  7657 raft_consensus.cc:740] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.527354  7657 consensus_queue.cc:260] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.528213  7657 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.531637  7806 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:28.532513  7695 leader_election.cc:304] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.532835  7657 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:28.533138  7851 raft_consensus.cc:2804] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.533572  7851 raft_consensus.cc:697] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:28.534240  7851 consensus_queue.cc:237] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.539566  7555 catalog_manager.cc:5697] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 1 to 2, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.643388  7881 consensus_queue.cc:1048] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.649560  7875 raft_consensus.cc:993] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:28.650008  7853 raft_consensus.cc:1081] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Signalling peer b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:28.651912  7732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:45232
I20260709 13:02:28.653432  7732 raft_consensus.cc:493] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.653808  7732 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.655400  7853 consensus_queue.cc:1048] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.659689  7732 raft_consensus.cc:515] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.663621  7732 leader_election.cc:290] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.666208  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:28.666745  7657 raft_consensus.cc:3055] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.666441  7853 consensus_queue.cc:1048] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:28.666985  7657 raft_consensus.cc:740] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.667850  7657 consensus_queue.cc:260] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.669010  7657 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.669201  7806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.669718  7806 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.673692  7854 raft_consensus.cc:993] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:28.674110  7854 raft_consensus.cc:1081] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:28.675758  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:02:28.676244  7656 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.676211  7657 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:28.676765  7656 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.676986  7806 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:28.677606  7695 leader_election.cc:304] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.678448  7851 raft_consensus.cc:2804] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.678920  7851 raft_consensus.cc:697] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:28.679684  7851 consensus_queue.cc:237] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.683557  7875 raft_consensus.cc:993] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:28.683990  7875 raft_consensus.cc:1081] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Signalling peer b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:28.685917  7806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:54112
I20260709 13:02:28.687309  7806 raft_consensus.cc:493] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.687682  7806 raft_consensus.cc:3060] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.687721  7656 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:28.689471  7552 catalog_manager.cc:5697] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 1 to 2, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.690963  7656 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 2 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.690826  7851 consensus_queue.cc:1048] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.695732  7806 raft_consensus.cc:515] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.697284  7853 consensus_queue.cc:1048] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.698487  7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:28.699072  7657 raft_consensus.cc:3055] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.699450  7657 raft_consensus.cc:740] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.700359  7657 consensus_queue.cc:260] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.701298  7657 raft_consensus.cc:3060] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.701747  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.708586  7806 leader_election.cc:290] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 2 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:28.702257  7805 raft_consensus.cc:3055] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.709206  7805 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:28.707921  7657 raft_consensus.cc:2468] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 2.
I20260709 13:02:28.710098  7805 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:28.711283  7730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec56b03c9047cd94b86a821ed22fdb" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.711383  7769 leader_election.cc:304] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.711650  7891 consensus_queue.cc:1048] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.713760  7856 raft_consensus.cc:2804] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.714213  7856 raft_consensus.cc:697] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:28.714707  7891 consensus_queue.cc:1048] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.714973  7856 consensus_queue.cc:237] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.711326  7805 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.722676  7555 catalog_manager.cc:5697] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 1 to 2, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.711627  7731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.726931  7891 consensus_queue.cc:1048] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.727779  7731 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.743332  7881 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.744541  7805 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 2.
I20260709 13:02:28.746189  7620 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.747506  7875 raft_consensus.cc:2804] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.747941  7875 raft_consensus.cc:697] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.748697  7875 consensus_queue.cc:237] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:28.751492  7731 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 2.
I20260709 13:02:28.752102  7881 consensus_queue.cc:1048] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.756055  7851 raft_consensus.cc:993] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:28.756440  7851 raft_consensus.cc:1081] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:28.758464  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57764
I20260709 13:02:28.759217  7656 raft_consensus.cc:493] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.759610  7656 raft_consensus.cc:3060] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.766987  7656 raft_consensus.cc:515] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.769901  7731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.770473  7731 raft_consensus.cc:3055] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.770768  7731 raft_consensus.cc:740] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:28.771561  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504d0ec746714fa89adcac1ef4849bad" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.771513  7731 consensus_queue.cc:260] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.772179  7805 raft_consensus.cc:3060] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.772774  7731 raft_consensus.cc:3060] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.771011  7553 catalog_manager.cc:5697] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 1 to 2, leader changed from b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.774401  7853 consensus_queue.cc:1048] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.780257  7731 raft_consensus.cc:2468] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 2.
I20260709 13:02:28.780757  7805 raft_consensus.cc:2468] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 2.
I20260709 13:02:28.781834  7655 raft_consensus.cc:1240] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Rejecting Update request from peer b960ef56844d4093aa3a3963cf68e717 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:28.781622  7622 leader_election.cc:304] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.781586  7656 leader_election.cc:290] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 2 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.782783  7853 raft_consensus.cc:2804] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.783217  7853 raft_consensus.cc:697] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.784040  7853 consensus_queue.cc:237] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.795419  7875 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.798557  7552 catalog_manager.cc:5697] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 1 to 2, leader changed from b960ef56844d4093aa3a3963cf68e717 (127.6.215.66) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.817147  7853 raft_consensus.cc:993] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:28.817601  7853 raft_consensus.cc:1081] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Signalling peer b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:28.820127  7730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:45232
I20260709 13:02:28.820612  7730 raft_consensus.cc:493] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.820966  7730 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.827345  7730 raft_consensus.cc:515] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.828742  7730 leader_election.cc:290] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.829509  7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:28.829910  7804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.830165  7656 raft_consensus.cc:3055] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.830385  7804 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.830490  7656 raft_consensus.cc:740] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.831380  7656 consensus_queue.cc:260] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.832444  7656 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.835160  7804 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:28.836179  7695 leader_election.cc:304] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:28.837015  7656 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:28.837083  7921 raft_consensus.cc:2804] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.837574  7921 raft_consensus.cc:697] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:28.838333  7921 consensus_queue.cc:237] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.843732  7553 catalog_manager.cc:5697] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 1 to 2, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.876775  7854 raft_consensus.cc:993] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:28.877170  7856 raft_consensus.cc:1081] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:28.878546  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:02:28.878995  7656 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.879385  7656 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.883773  7656 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.885290  7656 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 2 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:28.886009  7730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:28.886250  7804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:28.886461  7730 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.886729  7804 raft_consensus.cc:3055] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.886986  7804 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:28.887595  7804 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.888404  7804 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.890780  7730 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 2.
I20260709 13:02:28.891745  7622 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:28.892501  7875 raft_consensus.cc:2804] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.892763  7804 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 2.
I20260709 13:02:28.892846  7875 raft_consensus.cc:697] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:28.893689  7875 consensus_queue.cc:237] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:28.899194  7553 catalog_manager.cc:5697] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 1 to 2, leader changed from b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.950512  7656 raft_consensus.cc:1275] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.951654  7921 consensus_queue.cc:1048] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.958364  7804 raft_consensus.cc:1275] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.959910  7927 consensus_queue.cc:1048] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.154734  7656 raft_consensus.cc:1275] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.155877  7927 consensus_queue.cc:1048] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.165338  7730 raft_consensus.cc:3060] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:29.168121  7805 raft_consensus.cc:1275] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.169654  7921 consensus_queue.cc:1048] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.171969  7730 raft_consensus.cc:1275] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.173161  7856 consensus_queue.cc:1048] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.180907  7656 raft_consensus.cc:1275] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.181928  7732 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.182618  7870 consensus_queue.cc:1048] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.183734  7875 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.193063  7805 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.194247  7853 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.300333  7732 raft_consensus.cc:1275] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.301836  7875 consensus_queue.cc:1048] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.309567  7805 raft_consensus.cc:1275] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.310722  7881 consensus_queue.cc:1048] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.384783  7656 raft_consensus.cc:1275] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.385854  7851 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.392319  7805 raft_consensus.cc:1275] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.394307  7927 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.462844  7805 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.464151  7881 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.471952  7732 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:29.473428  7875 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:31.423252  7005 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:02:31.423920  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.437961  7655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:57768
I20260709 13:02:31.438395  7655 raft_consensus.cc:606] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Received request to transfer leadership to TS b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:31.440379  7655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:57768
I20260709 13:02:31.440765  7655 raft_consensus.cc:606] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Received request to transfer leadership to TS b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:31.441618  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:31.441991  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:31.540225  7934 raft_consensus.cc:993] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:31.540696  7881 raft_consensus.cc:1081] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Signalling peer b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:31.542109  7804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:54112
I20260709 13:02:31.542490  7804 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.542712  7804 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.546763  7804 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:31.548190  7804 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 3 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367)
I20260709 13:02:31.548830  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:31.549081  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:31.549335  7732 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.549625  7655 raft_consensus.cc:3055] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.549899  7655 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:31.550525  7655 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:31.551371  7655 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.553639  7732 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 3.
I20260709 13:02:31.554484  7771 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:31.555048  7931 raft_consensus.cc:2804] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.555444  7655 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 3.
I20260709 13:02:31.555910  7931 raft_consensus.cc:697] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:31.557009  7931 consensus_queue.cc:237] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:31.563411  7552 catalog_manager.cc:5697] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 2 to 3, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.972448  7934 raft_consensus.cc:993] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:31.972827  7881 raft_consensus.cc:1081] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Signalling peer b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:31.974125  7804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:54112
I20260709 13:02:31.974543  7804 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.974795  7804 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.980144  7804 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:31.981631  7804 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 3 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:31.982358  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:31.982525  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:31.983263  7655 raft_consensus.cc:3055] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.983321  7732 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.983714  7655 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:31.984511  7655 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:31.985518  7655 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.988551  7732 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 3.
I20260709 13:02:31.989421  7771 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:31.989909  7655 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 3.
I20260709 13:02:31.990195  7931 raft_consensus.cc:2804] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.990634  7931 raft_consensus.cc:697] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:31.991328  7931 consensus_queue.cc:237] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:31.996985  7552 catalog_manager.cc:5697] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 2 to 3, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.073524  7655 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.075012  7931 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.077651  7732 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.079306  7935 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.442690  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:32.452123  7805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:32.452576  7805 raft_consensus.cc:606] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:32.456667  7805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:54132
I20260709 13:02:32.457093  7805 raft_consensus.cc:606] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:32.468082  7732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:02:32.468605  7732 raft_consensus.cc:606] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:32.473448  7732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:02:32.473834  7732 raft_consensus.cc:606] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:32.478179  7732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
mode: GRACEFUL
new_leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:45234
I20260709 13:02:32.478569  7732 raft_consensus.cc:606] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Received request to transfer leadership to TS 6fd9f2199c5548aebf0ea181fcd143b9
I20260709 13:02:32.488642  7655 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.490015  7931 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.496001  7935 raft_consensus.cc:993] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.496690  7931 raft_consensus.cc:1081] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.498477  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:02:32.499032  7656 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:32.499405  7656 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:32.503396  7732 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.504997  7949 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.506310  7656 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.508854  7730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:32.512805  7656 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 4 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:32.512960  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:32.513518  7805 raft_consensus.cc:3055] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:32.513785  7805 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:32.514509  7805 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.515491  7805 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:32.523250  7805 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 4.
I20260709 13:02:32.544305  7620 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: b960ef56844d4093aa3a3963cf68e717
I20260709 13:02:32.550238  7934 raft_consensus.cc:2804] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:32.551218  7934 raft_consensus.cc:697] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:32.552753  7934 consensus_queue.cc:237] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.562322  7931 raft_consensus.cc:993] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.562978  7949 raft_consensus.cc:1081] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.564688  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:02:32.565433  7656 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:32.565826  7656 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:32.565302  7555 catalog_manager.cc:5697] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 3 to 4, leader changed from b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 4 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.572715  7656 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:32.575528  7656 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 4 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:32.575889  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:32.576256  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:32.576589  7732 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:32.577176  7805 raft_consensus.cc:3055] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:32.577498  7805 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:32.578178  7805 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:32.579380  7805 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:32.581610  7732 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 4.
I20260709 13:02:32.582656  7622 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b960ef56844d4093aa3a3963cf68e717; no voters: 
I20260709 13:02:32.583284  7934 raft_consensus.cc:2804] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:32.583743  7934 raft_consensus.cc:697] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:32.584630  7805 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 4.
I20260709 13:02:32.584682  7934 consensus_queue.cc:237] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:32.591424  7555 catalog_manager.cc:5697] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 3 to 4, leader changed from b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 4 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.942175  7947 raft_consensus.cc:993] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.942674  7927 raft_consensus.cc:1081] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.943956  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57764
I20260709 13:02:32.944361  7656 raft_consensus.cc:493] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:32.944626  7656 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:32.948763  7656 raft_consensus.cc:515] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.950474  7656 leader_election.cc:290] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 3 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:32.951057  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:32.951499  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:32.951627  7732 raft_consensus.cc:3055] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:32.951987  7732 raft_consensus.cc:740] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:32.952054  7805 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:32.952792  7732 consensus_queue.cc:260] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.954082  7732 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:32.958891  7805 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 3.
I20260709 13:02:32.959888  7620 leader_election.cc:304] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:32.959990  7732 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 3.
I20260709 13:02:32.960659  7934 raft_consensus.cc:2804] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:32.961161  7934 raft_consensus.cc:697] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:32.962045  7934 consensus_queue.cc:237] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.969142  7555 catalog_manager.cc:5697] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 2 to 3, leader changed from b960ef56844d4093aa3a3963cf68e717 (127.6.215.66) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.978945  7947 raft_consensus.cc:993] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.979313  7927 raft_consensus.cc:1081] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:32.980657  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57764
I20260709 13:02:32.981060  7656 raft_consensus.cc:493] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:32.981312  7656 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:32.985541  7656 raft_consensus.cc:515] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.986965  7656 leader_election.cc:290] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 3 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:32.987732  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:32.988014  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd71891f0a418eb3aee1e0f3b8c809" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:32.988339  7732 raft_consensus.cc:3055] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:32.988559  7805 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:32.988652  7732 raft_consensus.cc:740] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:32.989789  7732 consensus_queue.cc:260] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:32.991331  7732 raft_consensus.cc:3060] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:32.996048  7805 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 3.
I20260709 13:02:32.997078  7732 raft_consensus.cc:2468] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 3.
I20260709 13:02:32.997066  7620 leader_election.cc:304] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:32.997879  7934 raft_consensus.cc:2804] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:32.998226  7934 raft_consensus.cc:697] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:32.999065  7934 consensus_queue.cc:237] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:33.005208  7555 catalog_manager.cc:5697] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 2 to 3, leader changed from b960ef56844d4093aa3a3963cf68e717 (127.6.215.66) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.011520  7805 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:33.012969  7934 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.022480  7732 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:33.028406  7732 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:33.029546  7881 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.061841  7947 raft_consensus.cc:993] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: : Instructing follower 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:33.062196  7927 raft_consensus.cc:1081] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Signalling peer 6fd9f2199c5548aebf0ea181fcd143b9 to start an election
I20260709 13:02:33.063531  7656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
 from {username='slave'} at 127.0.0.1:57764
I20260709 13:02:33.064002  7656 raft_consensus.cc:493] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:33.064252  7656 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.068477  7656 raft_consensus.cc:515] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:33.070036  7656 leader_election.cc:290] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 3 election: Requested vote from peers b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:33.071036  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:33.071038  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ae2e17985b46ea8187f2b2a7ed948f" candidate_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:33.071442  7732 raft_consensus.cc:3055] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:33.071547  7805 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.071694  7732 raft_consensus.cc:740] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:33.072335  7732 consensus_queue.cc:260] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:33.073122  7732 raft_consensus.cc:3060] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.075755  7805 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 3.
I20260709 13:02:33.076562  7620 leader_election.cc:304] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd9f2199c5548aebf0ea181fcd143b9, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:33.076680  7732 raft_consensus.cc:2468] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fd9f2199c5548aebf0ea181fcd143b9 in term 3.
I20260709 13:02:33.077188  7881 raft_consensus.cc:2804] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:33.077576  7881 raft_consensus.cc:697] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Becoming Leader. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:33.078233  7881 consensus_queue.cc:237] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:33.082521  7805 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:33.083577  7881 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.084868  7553 catalog_manager.cc:5697] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 reported cstate change: term changed from 2 to 3, leader changed from b960ef56844d4093aa3a3963cf68e717 (127.6.215.66) to 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.093143  7732 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:33.094537  7961 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:33.391197  7805 raft_consensus.cc:1275] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.392385  7961 consensus_queue.cc:1048] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.400645  7732 raft_consensus.cc:1275] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.402237  7964 consensus_queue.cc:1048] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:33.479751  7805 raft_consensus.cc:1275] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.480742  7934 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.488866  7732 raft_consensus.cc:1275] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.490139  7964 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.497362  7805 raft_consensus.cc:1275] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.498481  7934 consensus_queue.cc:1048] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.509336  7732 raft_consensus.cc:1275] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Refusing update from remote peer 6fd9f2199c5548aebf0ea181fcd143b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.510689  7964 consensus_queue.cc:1048] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:35.485281  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:35.492193  7656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:57768
I20260709 13:02:35.492717  7656 raft_consensus.cc:606] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Received request to transfer leadership to TS b960ef56844d4093aa3a3963cf68e717
I20260709 13:02:35.494971  7656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:57768
I20260709 13:02:35.495347  7656 raft_consensus.cc:606] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Received request to transfer leadership to TS b960ef56844d4093aa3a3963cf68e717
I20260709 13:02:35.497370  7656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:57768
I20260709 13:02:35.497745  7656 raft_consensus.cc:606] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Received request to transfer leadership to TS b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:35.499771  7656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80"
dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
mode: GRACEFUL
new_leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:57768
I20260709 13:02:35.500154  7656 raft_consensus.cc:606] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Received request to transfer leadership to TS b9da8d26218947d3bbe14ca6ea03fc37
I20260709 13:02:35.501057  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:35.501470  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:35.727842  7881 raft_consensus.cc:993] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:35.728256  7970 raft_consensus.cc:1081] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Signalling peer b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:35.729570  7805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:54112
I20260709 13:02:35.729952  7805 raft_consensus.cc:493] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:35.730176  7805 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.733860  7805 raft_consensus.cc:515] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:35.735133  7805 leader_election.cc:290] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 5 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:35.735898  7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:35.736069  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca814b458364fba8f76dd3bcb536893" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:35.736415  7656 raft_consensus.cc:3055] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:35.736478  7732 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.736685  7656 raft_consensus.cc:740] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:35.737265  7656 consensus_queue.cc:260] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:35.738039  7656 raft_consensus.cc:3060] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.740101  7732 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 5.
I20260709 13:02:35.741030  7771 leader_election.cc:304] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:35.741953  7656 raft_consensus.cc:2468] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 5.
I20260709 13:02:35.741775  7949 raft_consensus.cc:2804] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:35.743062  7949 raft_consensus.cc:697] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:35.743924  7949 consensus_queue.cc:237] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:35.749709  7555 catalog_manager.cc:5697] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 4 to 5, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.899439  7970 raft_consensus.cc:993] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:35.899865  7970 raft_consensus.cc:1081] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Signalling peer b9da8d26218947d3bbe14ca6ea03fc37 to start an election
I20260709 13:02:35.901461  7805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80"
dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
 from {username='slave'} at 127.0.0.1:54112
I20260709 13:02:35.901976  7805 raft_consensus.cc:493] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:35.902278  7805 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.907886  7805 raft_consensus.cc:515] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:35.909806  7805 leader_election.cc:290] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 4 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b960ef56844d4093aa3a3963cf68e717 (127.6.215.66:44257)
I20260709 13:02:35.910698  7732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
I20260709 13:02:35.910943  7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86660ee624e4c3c956beafdb41d1e80" candidate_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:35.911239  7732 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.911381  7656 raft_consensus.cc:3055] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:35.911674  7656 raft_consensus.cc:740] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:35.912253  7656 consensus_queue.cc:260] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:35.912917  7656 raft_consensus.cc:3060] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.916632  7732 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 4.
I20260709 13:02:35.917524  7771 leader_election.cc:304] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:35.917634  7656 raft_consensus.cc:2468] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9da8d26218947d3bbe14ca6ea03fc37 in term 4.
I20260709 13:02:35.918334  7949 raft_consensus.cc:2804] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:35.918748  7949 raft_consensus.cc:697] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 LEADER]: Becoming Leader. State: Replica: b9da8d26218947d3bbe14ca6ea03fc37, State: Running, Role: LEADER
I20260709 13:02:35.919488  7949 consensus_queue.cc:237] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:35.925284  7555 catalog_manager.cc:5697] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 reported cstate change: term changed from 3 to 4, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.967559  7881 raft_consensus.cc:993] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:35.968021  7970 raft_consensus.cc:1081] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Signalling peer b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:35.969377  7732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:45232
I20260709 13:02:35.969755  7732 raft_consensus.cc:493] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:35.969995  7732 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.973738  7732 raft_consensus.cc:515] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:35.975180  7732 leader_election.cc:290] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 5 election: Requested vote from peers b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611), 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367)
I20260709 13:02:35.975885  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:35.976132  7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4d427579bf4788a9b4d6d101732c3c" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:35.976397  7805 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.976573  7656 raft_consensus.cc:3055] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:35.976864  7656 raft_consensus.cc:740] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:35.977531  7656 consensus_queue.cc:260] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:35.978554  7656 raft_consensus.cc:3060] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.982082  7805 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 5.
I20260709 13:02:35.983268  7695 leader_election.cc:304] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:35.984146  7927 raft_consensus.cc:2804] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:35.984166  7656 raft_consensus.cc:2468] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 5.
I20260709 13:02:35.985229  7927 raft_consensus.cc:697] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 5 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:35.986050  7927 consensus_queue.cc:237] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } }
I20260709 13:02:35.993095  7555 catalog_manager.cc:5697] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 4 to 5, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 5 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.013813  7881 raft_consensus.cc:993] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: : Instructing follower b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:36.014163  7970 raft_consensus.cc:1081] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Signalling peer b960ef56844d4093aa3a3963cf68e717 to start an election
I20260709 13:02:36.015362  7732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239"
dest_uuid: "b960ef56844d4093aa3a3963cf68e717"
 from {username='slave'} at 127.0.0.1:45232
I20260709 13:02:36.015743  7732 raft_consensus.cc:493] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.015997  7732 raft_consensus.cc:3060] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.020972  7732 raft_consensus.cc:515] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:36.022212  7732 leader_election.cc:290] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Requested vote from peers 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367), b9da8d26218947d3bbe14ca6ea03fc37 (127.6.215.67:42611)
I20260709 13:02:36.022960  7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fd9f2199c5548aebf0ea181fcd143b9"
I20260709 13:02:36.023303  7805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58123953cef94ce2b27fecff7f81e239" candidate_uuid: "b960ef56844d4093aa3a3963cf68e717" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9da8d26218947d3bbe14ca6ea03fc37"
I20260709 13:02:36.023507  7656 raft_consensus.cc:3055] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:36.023810  7805 raft_consensus.cc:3060] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.023836  7656 raft_consensus.cc:740] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fd9f2199c5548aebf0ea181fcd143b9, State: Running, Role: LEADER
I20260709 13:02:36.024678  7656 consensus_queue.cc:260] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:36.025772  7656 raft_consensus.cc:3060] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.028267  7805 raft_consensus.cc:2468] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:36.029086  7695 leader_election.cc:304] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b960ef56844d4093aa3a3963cf68e717, b9da8d26218947d3bbe14ca6ea03fc37; no voters: 
I20260709 13:02:36.029651  7656 raft_consensus.cc:2468] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b960ef56844d4093aa3a3963cf68e717 in term 2.
I20260709 13:02:36.029695  7927 raft_consensus.cc:2804] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:36.030146  7927 raft_consensus.cc:697] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Becoming Leader. State: Replica: b960ef56844d4093aa3a3963cf68e717, State: Running, Role: LEADER
I20260709 13:02:36.030862  7927 consensus_queue.cc:237] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } }
I20260709 13:02:36.036993  7555 catalog_manager.cc:5697] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 reported cstate change: term changed from 1 to 2, leader changed from 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65) to b960ef56844d4093aa3a3963cf68e717 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "b960ef56844d4093aa3a3963cf68e717" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.124681  7656 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:36.125759  7949 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.134774  7732 raft_consensus.cc:1275] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:36.136181  7971 consensus_queue.cc:1048] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.334447  7656 raft_consensus.cc:1275] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:36.335642  7949 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:36.342797  7732 raft_consensus.cc:1275] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Refusing update from remote peer b9da8d26218947d3bbe14ca6ea03fc37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:36.344334  7971 consensus_queue.cc:1048] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b960ef56844d4093aa3a3963cf68e717" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:36.467691  7805 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:36.469103  7927 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.471971  7656 raft_consensus.cc:1275] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:36.473466  7927 consensus_queue.cc:1048] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.490746  7656 raft_consensus.cc:1275] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.491947  7978 consensus_queue.cc:1048] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd9f2199c5548aebf0ea181fcd143b9" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.502146  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:36.509723  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
W20260709 13:02:36.513549  7695 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:36.514017  7805 raft_consensus.cc:1275] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Refusing update from remote peer b960ef56844d4093aa3a3963cf68e717: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.515420  7978 consensus_queue.cc:1048] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9da8d26218947d3bbe14ca6ea03fc37" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:36.516670  7695 consensus_peers.cc:597] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 -> Peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Couldn't send request to peer 6fd9f2199c5548aebf0ea181fcd143b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.546962  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:36.547607  7005 tablet_replica.cc:333] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.548144  7005 raft_consensus.cc:2243] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.548534  7005 raft_consensus.cc:2272] T a86660ee624e4c3c956beafdb41d1e80 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.550773  7005 tablet_replica.cc:333] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.551286  7005 raft_consensus.cc:2243] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.551661  7005 raft_consensus.cc:2272] T 35ec56b03c9047cd94b86a821ed22fdb P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.554162  7005 tablet_replica.cc:333] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.554754  7005 raft_consensus.cc:2243] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.555143  7005 raft_consensus.cc:2272] T 4af3294904f146e0a3c1dd4995a02c57 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.556820  7005 tablet_replica.cc:333] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.557307  7005 raft_consensus.cc:2243] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.557979  7005 raft_consensus.cc:2272] T 59ae2e17985b46ea8187f2b2a7ed948f P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.559432  7005 tablet_replica.cc:333] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.559880  7005 raft_consensus.cc:2243] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.560221  7005 raft_consensus.cc:2272] T 9ca814b458364fba8f76dd3bcb536893 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.562052  7005 tablet_replica.cc:333] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.562501  7005 raft_consensus.cc:2243] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.563164  7005 raft_consensus.cc:2272] T 504d0ec746714fa89adcac1ef4849bad P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.564651  7005 tablet_replica.cc:333] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.565201  7005 raft_consensus.cc:2243] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.565616  7005 raft_consensus.cc:2272] T 8a4d427579bf4788a9b4d6d101732c3c P 6fd9f2199c5548aebf0ea181fcd143b9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.567781  7005 tablet_replica.cc:333] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.568215  7005 raft_consensus.cc:2243] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.568828  7005 raft_consensus.cc:2272] T 12dd71891f0a418eb3aee1e0f3b8c809 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.570338  7005 tablet_replica.cc:333] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.570755  7005 raft_consensus.cc:2243] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.571341  7005 raft_consensus.cc:2272] T 318ad11941004771b6f7ec05d8919358 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.572883  7005 tablet_replica.cc:333] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: stopping tablet replica
I20260709 13:02:36.573282  7005 raft_consensus.cc:2243] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.573627  7005 pending_rounds.cc:70] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: Trying to abort 1 pending ops.
I20260709 13:02:36.573832  7005 pending_rounds.cc:77] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634431108521984 op_type: NO_OP noop_request { }
I20260709 13:02:36.574116  7005 raft_consensus.cc:2889] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:36.574371  7005 raft_consensus.cc:2272] T 58123953cef94ce2b27fecff7f81e239 P 6fd9f2199c5548aebf0ea181fcd143b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.591711  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
I20260709 13:02:36.611079  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
I20260709 13:02:36.634892  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:36.634857  7695 consensus_peers.cc:597] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 -> Peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Couldn't send request to peer 6fd9f2199c5548aebf0ea181fcd143b9. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:42367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.635653  7005 tablet_replica.cc:333] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.636178  7005 raft_consensus.cc:2243] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.636586  7005 raft_consensus.cc:2272] T 35ec56b03c9047cd94b86a821ed22fdb P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.638427  7005 tablet_replica.cc:333] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.638909  7005 raft_consensus.cc:2243] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.639274  7005 raft_consensus.cc:2272] T a86660ee624e4c3c956beafdb41d1e80 P b960ef56844d4093aa3a3963cf68e717 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.641108  7005 tablet_replica.cc:333] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.641607  7005 raft_consensus.cc:2243] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.642282  7005 raft_consensus.cc:2272] T 4af3294904f146e0a3c1dd4995a02c57 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.644187  7005 tablet_replica.cc:333] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.644852  7005 raft_consensus.cc:2243] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.645289  7005 raft_consensus.cc:2272] T 59ae2e17985b46ea8187f2b2a7ed948f P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.646961  7005 tablet_replica.cc:333] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.647378  7005 raft_consensus.cc:2243] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.647697  7005 raft_consensus.cc:2272] T 318ad11941004771b6f7ec05d8919358 P b960ef56844d4093aa3a3963cf68e717 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.649185  7005 tablet_replica.cc:333] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.649665  7005 raft_consensus.cc:2243] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.650326  7005 raft_consensus.cc:2272] T 58123953cef94ce2b27fecff7f81e239 P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.652462  7005 tablet_replica.cc:333] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.652869  7005 raft_consensus.cc:2243] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.653273  7005 raft_consensus.cc:2272] T 12dd71891f0a418eb3aee1e0f3b8c809 P b960ef56844d4093aa3a3963cf68e717 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.654948  7005 tablet_replica.cc:333] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.655652  7005 raft_consensus.cc:2243] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.656555  7005 raft_consensus.cc:2272] T 8a4d427579bf4788a9b4d6d101732c3c P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.658793  7005 tablet_replica.cc:333] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.659240  7005 raft_consensus.cc:2243] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.659617  7005 raft_consensus.cc:2272] T 504d0ec746714fa89adcac1ef4849bad P b960ef56844d4093aa3a3963cf68e717 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.661123  7005 tablet_replica.cc:333] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717: stopping tablet replica
I20260709 13:02:36.661545  7005 raft_consensus.cc:2243] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.661876  7005 raft_consensus.cc:2272] T 9ca814b458364fba8f76dd3bcb536893 P b960ef56844d4093aa3a3963cf68e717 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.680281  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
I20260709 13:02:36.698443  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
I20260709 13:02:36.719071  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:36.719688  7005 tablet_replica.cc:333] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.720279  7005 raft_consensus.cc:2243] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.721002  7005 raft_consensus.cc:2272] T 35ec56b03c9047cd94b86a821ed22fdb P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.722718  7005 tablet_replica.cc:333] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.723336  7005 raft_consensus.cc:2243] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.724109  7005 raft_consensus.cc:2272] T a86660ee624e4c3c956beafdb41d1e80 P b9da8d26218947d3bbe14ca6ea03fc37 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.727600  7005 tablet_replica.cc:333] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.728276  7005 raft_consensus.cc:2243] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.728718  7005 raft_consensus.cc:2272] T 318ad11941004771b6f7ec05d8919358 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.730424  7005 tablet_replica.cc:333] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.731020  7005 raft_consensus.cc:2243] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:36.731434  7769 consensus_peers.cc:597] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 -> Peer 6fd9f2199c5548aebf0ea181fcd143b9 (127.6.215.65:42367): Couldn't send request to peer 6fd9f2199c5548aebf0ea181fcd143b9. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:42367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.731451  7005 raft_consensus.cc:2272] T 4af3294904f146e0a3c1dd4995a02c57 P b9da8d26218947d3bbe14ca6ea03fc37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.733098  7005 tablet_replica.cc:333] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.733596  7005 raft_consensus.cc:2243] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.733949  7005 raft_consensus.cc:2272] T 59ae2e17985b46ea8187f2b2a7ed948f P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.735353  7005 tablet_replica.cc:333] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.735791  7005 raft_consensus.cc:2243] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.736135  7005 raft_consensus.cc:2272] T 8a4d427579bf4788a9b4d6d101732c3c P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.737967  7005 tablet_replica.cc:333] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.738415  7005 raft_consensus.cc:2243] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.738778  7005 raft_consensus.cc:2272] T 12dd71891f0a418eb3aee1e0f3b8c809 P b9da8d26218947d3bbe14ca6ea03fc37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.740135  7005 tablet_replica.cc:333] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.740536  7005 raft_consensus.cc:2243] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.740860  7005 raft_consensus.cc:2272] T 504d0ec746714fa89adcac1ef4849bad P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.742261  7005 tablet_replica.cc:333] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.742659  7005 raft_consensus.cc:2243] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.742985  7005 raft_consensus.cc:2272] T 58123953cef94ce2b27fecff7f81e239 P b9da8d26218947d3bbe14ca6ea03fc37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.744668  7005 tablet_replica.cc:333] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37: stopping tablet replica
I20260709 13:02:36.745209  7005 raft_consensus.cc:2243] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.745868  7005 raft_consensus.cc:2272] T 9ca814b458364fba8f76dd3bcb536893 P b9da8d26218947d3bbe14ca6ea03fc37 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.770902  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
I20260709 13:02:36.787146  7005 master.cc:562] Master@127.6.215.126:45489 shutting down...
I20260709 13:02:36.803728  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.804210  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.804497  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6945cd928595473ba6e2efb02067991d: stopping tablet replica
I20260709 13:02:36.823052  7005 master.cc:584] Master@127.6.215.126:45489 shutdown complete.
6fd9f2199c5548aebf0ea181fcd143b9  5
b960ef56844d4093aa3a3963cf68e717  4
b9da8d26218947d3bbe14ca6ea03fc37  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10072 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:02:36.859400  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:41935
I20260709 13:02:36.860447  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:36.865332  7998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.866104  7999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.866557  8001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.867412  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:36.868130  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:36.868304  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:36.868450  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602156868435 us; error 0 us; skew 500 ppm
I20260709 13:02:36.868923  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:36.871141  7005 webserver.cc:533] Webserver started at http://127.6.215.126:35845/ using document root <none> and password file <none>
I20260709 13:02:36.871600  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:36.871757  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:36.871989  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:36.873004  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "b6992e613c544a1db779b61d07fa6870"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-r31z"
I20260709 13:02:36.876926  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:02:36.880239  8006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.880963  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:36.881214  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "b6992e613c544a1db779b61d07fa6870"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-r31z"
I20260709 13:02:36.881517  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:36.914134  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:36.915289  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:36.955348  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:41935
I20260709 13:02:36.955468  8057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:41935 every 8 connection(s)
I20260709 13:02:36.959295  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.968562  8058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Bootstrap starting.
I20260709 13:02:36.972793  8058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.976600  8058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: No bootstrap required, opened a new log
I20260709 13:02:36.978550  8058 raft_consensus.cc:359] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6992e613c544a1db779b61d07fa6870" member_type: VOTER }
I20260709 13:02:36.978883  8058 raft_consensus.cc:385] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.979092  8058 raft_consensus.cc:740] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6992e613c544a1db779b61d07fa6870, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.979636  8058 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6992e613c544a1db779b61d07fa6870" member_type: VOTER }
I20260709 13:02:36.980052  8058 raft_consensus.cc:399] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:36.980253  8058 raft_consensus.cc:493] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:36.980496  8058 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.984442  8058 raft_consensus.cc:515] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6992e613c544a1db779b61d07fa6870" member_type: VOTER }
I20260709 13:02:36.984879  8058 leader_election.cc:304] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6992e613c544a1db779b61d07fa6870; no voters: 
I20260709 13:02:36.986052  8058 leader_election.cc:290] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:36.986171  8061 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.987432  8061 raft_consensus.cc:697] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 1 LEADER]: Becoming Leader. State: Replica: b6992e613c544a1db779b61d07fa6870, State: Running, Role: LEADER
I20260709 13:02:36.988062  8061 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6992e613c544a1db779b61d07fa6870" member_type: VOTER }
I20260709 13:02:36.989522  8058 sys_catalog.cc:565] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:36.992118  8063 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6992e613c544a1db779b61d07fa6870" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6992e613c544a1db779b61d07fa6870" member_type: VOTER } }
I20260709 13:02:36.992666  8063 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:36.992477  8062 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6992e613c544a1db779b61d07fa6870. Latest consensus state: current_term: 1 leader_uuid: "b6992e613c544a1db779b61d07fa6870" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6992e613c544a1db779b61d07fa6870" member_type: VOTER } }
I20260709 13:02:36.993040  8062 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:36.995468  8067 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:37.000190  8067 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:37.003995  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:37.008476  8067 catalog_manager.cc:1383] Generated new cluster ID: 1f147596954946ac9dc5b4739d690c1c
I20260709 13:02:37.008694  8067 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:37.025134  8067 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:37.026734  8067 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:37.044670  8067 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Generated new TSK 0
I20260709 13:02:37.045217  8067 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:37.070251  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.075632  8079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.076488  8080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.078840  8082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.078917  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:37.080026  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:37.080241  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.080408  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602157080390 us; error 0 us; skew 500 ppm
I20260709 13:02:37.080914  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.083155  7005 webserver.cc:533] Webserver started at http://127.6.215.65:39231/ using document root <none> and password file <none>
I20260709 13:02:37.083606  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.083777  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.084041  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.085024  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "65d66cd655cd4400b079b4427061ca5e"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-r31z"
I20260709 13:02:37.090150  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.002s
I20260709 13:02:37.093542  8087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.094440  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:37.094803  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "65d66cd655cd4400b079b4427061ca5e"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-r31z"
I20260709 13:02:37.095196  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.110837  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.112031  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.114112  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:37.116516  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:37.116709  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.117000  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:37.117290  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.160861  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:38095
I20260709 13:02:37.160938  8149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:38095 every 8 connection(s)
I20260709 13:02:37.165509  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.172930  8154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.175834  8155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.176131  7005 server_base.cc:1061] running on GCE node
W20260709 13:02:37.177175  8157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.177953  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:37.178144  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.178298  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602157178284 us; error 0 us; skew 500 ppm
I20260709 13:02:37.178777  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.180776  7005 webserver.cc:533] Webserver started at http://127.6.215.66:35545/ using document root <none> and password file <none>
I20260709 13:02:37.181203  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.181401  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.181632  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.182812  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "afd11cff97554063a80d743fdf2b934d"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-r31z"
I20260709 13:02:37.186111  8150 heartbeater.cc:344] Connected to a master server at 127.6.215.126:41935
I20260709 13:02:37.186661  8150 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:37.187532  8150 heartbeater.cc:507] Master 127.6.215.126:41935 requested a full tablet report, sending...
I20260709 13:02:37.188180  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:02:37.189780  8023 ts_manager.cc:194] Registered new tserver with Master: 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:02:37.192094  8023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38666
I20260709 13:02:37.192464  8162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.193334  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:37.193653  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "afd11cff97554063a80d743fdf2b934d"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-r31z"
I20260709 13:02:37.193893  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.212278  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.213503  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.214880  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:37.217044  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:37.217216  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.217474  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:37.217612  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.259187  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:37313
I20260709 13:02:37.259315  8224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:37313 every 8 connection(s)
I20260709 13:02:37.263484  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.270303  8228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.271206  8229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.273393  8231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.274716  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:37.275636  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:02:37.275743  8225 heartbeater.cc:344] Connected to a master server at 127.6.215.126:41935
W20260709 13:02:37.275905  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.276134  8225 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:37.276141  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602157276123 us; error 0 us; skew 500 ppm
I20260709 13:02:37.276829  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.276916  8225 heartbeater.cc:507] Master 127.6.215.126:41935 requested a full tablet report, sending...
I20260709 13:02:37.279351  8023 ts_manager.cc:194] Registered new tserver with Master: afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:37.279839  7005 webserver.cc:533] Webserver started at http://127.6.215.67:35641/ using document root <none> and password file <none>
I20260709 13:02:37.280524  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.280782  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.281133  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.281491  8023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38674
I20260709 13:02:37.282845  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-r31z"
I20260709 13:02:37.287266  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:37.290272  8236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.291185  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:37.291473  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-r31z"
I20260709 13:02:37.291755  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.306313  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.307385  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.308717  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:37.310756  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:37.311017  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.311291  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:37.311445  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.350579  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:43007
I20260709 13:02:37.350752  8298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:43007 every 8 connection(s)
I20260709 13:02:37.364346  8299 heartbeater.cc:344] Connected to a master server at 127.6.215.126:41935
I20260709 13:02:37.364676  8299 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:37.365295  8299 heartbeater.cc:507] Master 127.6.215.126:41935 requested a full tablet report, sending...
I20260709 13:02:37.367033  8023 ts_manager.cc:194] Registered new tserver with Master: 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:37.367686  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013396643s
I20260709 13:02:37.368548  8023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38688
I20260709 13:02:37.391909  8023 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38696:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:37.397810  8023 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:37.603217  8190 tablet_service.cc:1511] Processing CreateTablet for tablet 446d688479d34112bfc4ab0afb09d6f5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:37.604602  8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446d688479d34112bfc4ab0afb09d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.605098  8264 tablet_service.cc:1511] Processing CreateTablet for tablet 446d688479d34112bfc4ab0afb09d6f5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:37.606335  8264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446d688479d34112bfc4ab0afb09d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.606446  8186 tablet_service.cc:1511] Processing CreateTablet for tablet 79c1b3089e984aa991014bbd831e7bfc (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:37.607194  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 446d688479d34112bfc4ab0afb09d6f5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:37.607705  8186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1b3089e984aa991014bbd831e7bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.608366  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446d688479d34112bfc4ab0afb09d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.608840  8262 tablet_service.cc:1511] Processing CreateTablet for tablet e052a7e080bb4a1e9a5ae52b54c2408b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:37.610430  8187 tablet_service.cc:1511] Processing CreateTablet for tablet 09b5bde69aba40fd84e97b20005e3997 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:37.611001  8261 tablet_service.cc:1511] Processing CreateTablet for tablet 09b5bde69aba40fd84e97b20005e3997 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:37.611608  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b5bde69aba40fd84e97b20005e3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.613029  8260 tablet_service.cc:1511] Processing CreateTablet for tablet 79c1b3089e984aa991014bbd831e7bfc (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:37.614647  8188 tablet_service.cc:1511] Processing CreateTablet for tablet e052a7e080bb4a1e9a5ae52b54c2408b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:37.615049  8114 tablet_service.cc:1511] Processing CreateTablet for tablet 621c07aa07044d69b33dead0af7e7fd9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:37.615904  8188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e052a7e080bb4a1e9a5ae52b54c2408b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.616263  8114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621c07aa07044d69b33dead0af7e7fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.617717  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e052a7e080bb4a1e9a5ae52b54c2408b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.618652  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 621c07aa07044d69b33dead0af7e7fd9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:37.619835  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621c07aa07044d69b33dead0af7e7fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.621713  8261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b5bde69aba40fd84e97b20005e3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.622937  8113 tablet_service.cc:1511] Processing CreateTablet for tablet e052a7e080bb4a1e9a5ae52b54c2408b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:37.624166  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e052a7e080bb4a1e9a5ae52b54c2408b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.625721  8260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1b3089e984aa991014bbd831e7bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.628233  8112 tablet_service.cc:1511] Processing CreateTablet for tablet 09b5bde69aba40fd84e97b20005e3997 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:37.629935  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b5bde69aba40fd84e97b20005e3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.607652  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 621c07aa07044d69b33dead0af7e7fd9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:37.631678  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621c07aa07044d69b33dead0af7e7fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.633385  8111 tablet_service.cc:1511] Processing CreateTablet for tablet 79c1b3089e984aa991014bbd831e7bfc (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:37.634590  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1b3089e984aa991014bbd831e7bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.644505  8185 tablet_service.cc:1511] Processing CreateTablet for tablet 07a2d8845b23413289268a178d97a8ea (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:37.646220  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2d8845b23413289268a178d97a8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.646127  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 07a2d8845b23413289268a178d97a8ea (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:37.647042  8110 tablet_service.cc:1511] Processing CreateTablet for tablet 07a2d8845b23413289268a178d97a8ea (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:37.647507  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2d8845b23413289268a178d97a8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.648388  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2d8845b23413289268a178d97a8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.660550  8109 tablet_service.cc:1511] Processing CreateTablet for tablet 729f99fd4567469babdeb05f3b4b3d27 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:37.661877  8109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f99fd4567469babdeb05f3b4b3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.679186  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 729f99fd4567469babdeb05f3b4b3d27 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:37.680477  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f99fd4567469babdeb05f3b4b3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.710958  8258 tablet_service.cc:1511] Processing CreateTablet for tablet 729f99fd4567469babdeb05f3b4b3d27 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:37.712313  8258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f99fd4567469babdeb05f3b4b3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.742285  8315 tablet_bootstrap.cc:492] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:37.750272  8112 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:37.754235  8314 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:37.754776  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.765588  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:37.766825  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.766587  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:37.767767  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.768177  8314 tablet_bootstrap.cc:654] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.771996  8316 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:37.776929  8113 tablet_service.cc:1511] Processing CreateTablet for tablet 13dada18d63642d99cf497f978999d7a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:37.778167  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13dada18d63642d99cf497f978999d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.778890  8115 tablet_service.cc:1511] Processing CreateTablet for tablet e8843c2ad2d543b89354e114ebd9d638 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:37.779341  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 13dada18d63642d99cf497f978999d7a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:37.780473  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13dada18d63642d99cf497f978999d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.780047  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8843c2ad2d543b89354e114ebd9d638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.781147  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 13dada18d63642d99cf497f978999d7a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:37.782315  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13dada18d63642d99cf497f978999d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.784233  8190 tablet_service.cc:1511] Processing CreateTablet for tablet e8843c2ad2d543b89354e114ebd9d638 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:37.785429  8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8843c2ad2d543b89354e114ebd9d638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.807448  8258 tablet_service.cc:1511] Processing CreateTablet for tablet e8843c2ad2d543b89354e114ebd9d638 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:37.808683  8258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8843c2ad2d543b89354e114ebd9d638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.812620  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 26e50e42ace14a4db7be14613c771220 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:37.813807  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e50e42ace14a4db7be14613c771220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.815271  8315 tablet_bootstrap.cc:654] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.818753  8314 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:37.821710  8314 ts_tablet_manager.cc:1403] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.013s
I20260709 13:02:37.823392  8262 tablet_service.cc:1511] Processing CreateTablet for tablet 26e50e42ace14a4db7be14613c771220 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:37.809965  8316 tablet_bootstrap.cc:654] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.824582  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e50e42ace14a4db7be14613c771220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.824561  8314 raft_consensus.cc:359] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.828059  8314 raft_consensus.cc:385] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.828377  8314 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.828202  8109 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0b25b4cb7b4ba18663e77cdacc4dbb (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:37.829448  8109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0b25b4cb7b4ba18663e77cdacc4dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.832855  8314 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.842674  8316 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:37.843053  8316 ts_tablet_manager.cc:1403] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.003s
I20260709 13:02:37.845465  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0b25b4cb7b4ba18663e77cdacc4dbb (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:37.845618  8316 raft_consensus.cc:359] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.846254  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 26e50e42ace14a4db7be14613c771220 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:37.846413  8113 tablet_service.cc:1511] Processing CreateTablet for tablet b3e62d20a8d54072882e6b574cdddee5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:37.846361  8316 raft_consensus.cc:385] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.847218  8316 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.847484  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e62d20a8d54072882e6b574cdddee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.848260  8315 tablet_bootstrap.cc:492] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:37.848367  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0b25b4cb7b4ba18663e77cdacc4dbb (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:37.848762  8315 ts_tablet_manager.cc:1403] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.003s
I20260709 13:02:37.848544  8316 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.847481  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e50e42ace14a4db7be14613c771220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.853152  8315 raft_consensus.cc:359] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.853938  8315 raft_consensus.cc:385] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.854359  8315 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.854357  8190 tablet_service.cc:1511] Processing CreateTablet for tablet b3e62d20a8d54072882e6b574cdddee5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:37.855195  8315 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.856089  8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e62d20a8d54072882e6b574cdddee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.856799  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0b25b4cb7b4ba18663e77cdacc4dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.858609  8225 heartbeater.cc:499] Master 127.6.215.126:41935 was elected leader, sending a full tablet report...
I20260709 13:02:37.860720  8262 tablet_service.cc:1511] Processing CreateTablet for tablet b3e62d20a8d54072882e6b574cdddee5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:37.862576  8314 ts_tablet_manager.cc:1434] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 13:02:37.862771  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e62d20a8d54072882e6b574cdddee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.863513  8314 tablet_bootstrap.cc:492] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:37.866333  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0b25b4cb7b4ba18663e77cdacc4dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.870067  8187 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2628cd0cb14e318af904dd53421357 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:37.871307  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2628cd0cb14e318af904dd53421357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.875398  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2628cd0cb14e318af904dd53421357 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:37.876587  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2628cd0cb14e318af904dd53421357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.887835  8316 ts_tablet_manager.cc:1434] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.004s
I20260709 13:02:37.887650  8109 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2628cd0cb14e318af904dd53421357 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:37.887966  8299 heartbeater.cc:499] Master 127.6.215.126:41935 was elected leader, sending a full tablet report...
I20260709 13:02:37.889498  8316 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:37.893653  8109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2628cd0cb14e318af904dd53421357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.894232  8150 heartbeater.cc:499] Master 127.6.215.126:41935 was elected leader, sending a full tablet report...
I20260709 13:02:37.906021  8316 tablet_bootstrap.cc:654] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.897492  8315 ts_tablet_manager.cc:1434] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.004s
I20260709 13:02:37.910056  8315 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:37.916518  8109 tablet_service.cc:1511] Processing CreateTablet for tablet 327bf050c29d49408e736f7e8fda9e6b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:37.917196  8314 tablet_bootstrap.cc:654] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.918006  8109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bf050c29d49408e736f7e8fda9e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.919379  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 327bf050c29d49408e736f7e8fda9e6b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:37.920501  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bf050c29d49408e736f7e8fda9e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.921226  8113 tablet_service.cc:1511] Processing CreateTablet for tablet 55917afdf34f4dd3985df6ff71c4d019 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:37.922415  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55917afdf34f4dd3985df6ff71c4d019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.923415  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 327bf050c29d49408e736f7e8fda9e6b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:37.923666  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 55917afdf34f4dd3985df6ff71c4d019 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:37.924654  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bf050c29d49408e736f7e8fda9e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.925228  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55917afdf34f4dd3985df6ff71c4d019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.939534  8316 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:37.939996  8316 ts_tablet_manager.cc:1403] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 13:02:37.942708  8316 raft_consensus.cc:359] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.943364  8316 raft_consensus.cc:385] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.943656  8316 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.944350  8316 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.946874  8314 tablet_bootstrap.cc:492] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:37.947330  8314 ts_tablet_manager.cc:1403] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 13:02:37.954430  8316 ts_tablet_manager.cc:1434] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:37.955111  8316 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:37.959652  8262 tablet_service.cc:1511] Processing CreateTablet for tablet 55917afdf34f4dd3985df6ff71c4d019 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:37.960279  8316 tablet_bootstrap.cc:654] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.961062  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55917afdf34f4dd3985df6ff71c4d019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.962075  8109 tablet_service.cc:1511] Processing CreateTablet for tablet 89c4577341fc4203869bd3f8476d9c43 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:37.963222  8109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4577341fc4203869bd3f8476d9c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.959635  8314 raft_consensus.cc:359] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.965940  8314 raft_consensus.cc:385] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.966295  8314 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.967048  8314 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:37.976349  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 89c4577341fc4203869bd3f8476d9c43 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:37.976775  8113 tablet_service.cc:1511] Processing CreateTablet for tablet e7922a990c04422aa6d20dbef2f00976 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:37.977792  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4577341fc4203869bd3f8476d9c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.978048  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7922a990c04422aa6d20dbef2f00976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.980803  8190 tablet_service.cc:1511] Processing CreateTablet for tablet 89c4577341fc4203869bd3f8476d9c43 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:37.981905  8315 tablet_bootstrap.cc:654] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.987109  8314 ts_tablet_manager.cc:1434] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:02:37.990479  8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4577341fc4203869bd3f8476d9c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.996784  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3d4a04ded8480c86cbdcb830e8fd57 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:37.999472  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3d4a04ded8480c86cbdcb830e8fd57 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 13:02:37.999967  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:38.000620  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3d4a04ded8480c86cbdcb830e8fd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.000835  8258 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3d4a04ded8480c86cbdcb830e8fd57 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:38.001411  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3d4a04ded8480c86cbdcb830e8fd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.001962  8258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3d4a04ded8480c86cbdcb830e8fd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.994895  8263 tablet_service.cc:1511] Processing CreateTablet for tablet e7922a990c04422aa6d20dbef2f00976 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:38.005733  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7922a990c04422aa6d20dbef2f00976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.990087  8187 tablet_service.cc:1511] Processing CreateTablet for tablet e7922a990c04422aa6d20dbef2f00976 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:38.018096  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7922a990c04422aa6d20dbef2f00976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.022298  8314 tablet_bootstrap.cc:492] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:38.025079  8322 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.025569  8322 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.029724  8322 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.039134  8186 tablet_service.cc:1511] Processing CreateTablet for tablet d4d62387bcf94eaaaf201aeca2c2a48f (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:38.040397  8186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d62387bcf94eaaaf201aeca2c2a48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.041055  8314 tablet_bootstrap.cc:654] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.041744  8316 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:38.042224  8316 ts_tablet_manager.cc:1403] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.087s	user 0.004s	sys 0.025s
I20260709 13:02:38.042953  8112 tablet_service.cc:1511] Processing CreateTablet for tablet d4d62387bcf94eaaaf201aeca2c2a48f (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:38.044140  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d62387bcf94eaaaf201aeca2c2a48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.055179  8262 tablet_service.cc:1511] Processing CreateTablet for tablet d4d62387bcf94eaaaf201aeca2c2a48f (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:38.057004  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d62387bcf94eaaaf201aeca2c2a48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.045028  8316 raft_consensus.cc:359] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.066046  8320 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.066522  8316 raft_consensus.cc:385] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.073293  8316 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.074174  8320 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.092896  8185 tablet_service.cc:1511] Processing CreateTablet for tablet d6579e4214554536b3727b869a8aedfa (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:38.094326  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6579e4214554536b3727b869a8aedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.094919  8315 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:38.095397  8315 ts_tablet_manager.cc:1403] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.186s	user 0.030s	sys 0.022s
I20260709 13:02:38.099205  8320 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:38.079826  8114 tablet_service.cc:1511] Processing CreateTablet for tablet 607b372ee65444fb8187089e3657ab3b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:38.089178  8258 tablet_service.cc:1511] Processing CreateTablet for tablet 607b372ee65444fb8187089e3657ab3b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:38.088936  8110 tablet_service.cc:1511] Processing CreateTablet for tablet d6579e4214554536b3727b869a8aedfa (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:38.125916  8258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607b372ee65444fb8187089e3657ab3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.126099  8114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607b372ee65444fb8187089e3657ab3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.127125  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6579e4214554536b3727b869a8aedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.126796  8259 tablet_service.cc:1511] Processing CreateTablet for tablet d6579e4214554536b3727b869a8aedfa (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:38.107820  8316 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.130324  8316 ts_tablet_manager.cc:1434] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:02:38.131269  8316 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:38.132942  8188 tablet_service.cc:1511] Processing CreateTablet for tablet 587b9bcf479d417dbc213189e328a0f8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:38.134132  8188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b9bcf479d417dbc213189e328a0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.135512  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 607b372ee65444fb8187089e3657ab3b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:38.136663  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607b372ee65444fb8187089e3657ab3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.137732  8315 raft_consensus.cc:359] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.138430  8315 raft_consensus.cc:385] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.138298  8113 tablet_service.cc:1511] Processing CreateTablet for tablet 587b9bcf479d417dbc213189e328a0f8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:38.138710  8315 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.139421  8315 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.143728  8315 ts_tablet_manager.cc:1434] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 13:02:38.144671  8315 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:38.145255  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6579e4214554536b3727b869a8aedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.156000  8261 tablet_service.cc:1511] Processing CreateTablet for tablet 587b9bcf479d417dbc213189e328a0f8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:38.157230  8261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b9bcf479d417dbc213189e328a0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.161242  8183 tablet_service.cc:1511] Processing CreateTablet for tablet 8f66db9a2fdf400a9046121a4b3b1b3b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:38.162597  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:38.163249  8260 tablet_service.cc:1511] Processing CreateTablet for tablet 8f66db9a2fdf400a9046121a4b3b1b3b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:38.163352  8200 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:38.163606  8322 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.164444  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 8f66db9a2fdf400a9046121a4b3b1b3b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:38.164700  8322 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.163270  8183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f66db9a2fdf400a9046121a4b3b1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.166620  8182 tablet_service.cc:1511] Processing CreateTablet for tablet 363112022a444c2f8b7cf6e11c7c1c36 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:38.167989  8182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363112022a444c2f8b7cf6e11c7c1c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.168540  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:38.168637  8264 tablet_service.cc:1511] Processing CreateTablet for tablet 363112022a444c2f8b7cf6e11c7c1c36 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:38.164899  8111 tablet_service.cc:1511] Processing CreateTablet for tablet 363112022a444c2f8b7cf6e11c7c1c36 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:38.169833  8264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363112022a444c2f8b7cf6e11c7c1c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.139436  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b9bcf479d417dbc213189e328a0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.172209  8108 tablet_service.cc:1511] Processing CreateTablet for tablet db7845485d6b4a86b219eae83659a36e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:38.173285  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363112022a444c2f8b7cf6e11c7c1c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.176163  8260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f66db9a2fdf400a9046121a4b3b1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.176746  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7845485d6b4a86b219eae83659a36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.166941  8322 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.182770  8181 tablet_service.cc:1511] Processing CreateTablet for tablet db7845485d6b4a86b219eae83659a36e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:38.187325  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f66db9a2fdf400a9046121a4b3b1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.187520  8257 tablet_service.cc:1511] Processing CreateTablet for tablet db7845485d6b4a86b219eae83659a36e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:38.191175  8107 tablet_service.cc:1511] Processing CreateTablet for tablet b9f91b8425044826becb1f4ae12269f8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:38.191700  8181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7845485d6b4a86b219eae83659a36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.196442  8107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f91b8425044826becb1f4ae12269f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.196252  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:02:38.197554  8238 leader_election.cc:343] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.198127  8322 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.198473  8322 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.198770  8322 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.201725  8257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7845485d6b4a86b219eae83659a36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.202512  8184 tablet_service.cc:1511] Processing CreateTablet for tablet b9f91b8425044826becb1f4ae12269f8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:38.203783  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f91b8425044826becb1f4ae12269f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.213254  8263 tablet_service.cc:1511] Processing CreateTablet for tablet b9f91b8425044826becb1f4ae12269f8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:38.215129  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f91b8425044826becb1f4ae12269f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.216742  8316 tablet_bootstrap.cc:654] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.219887  8315 tablet_bootstrap.cc:654] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.220489  8322 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.224342  8322 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.224548  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:38.225152  8199 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.234575  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:38.236076  8163 leader_election.cc:343] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.233209  8199 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:38.237704  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:38.238556  8322 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.245056  8112 tablet_service.cc:1511] Processing CreateTablet for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:38.246374  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.247056  8185 tablet_service.cc:1511] Processing CreateTablet for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:38.248224  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.258452  8262 tablet_service.cc:1511] Processing CreateTablet for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:38.259785  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.263230  8314 tablet_bootstrap.cc:492] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:38.263718  8314 ts_tablet_manager.cc:1403] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.276s	user 0.033s	sys 0.009s
I20260709 13:02:38.266490  8314 raft_consensus.cc:359] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.267411  8314 raft_consensus.cc:385] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.267697  8314 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.272550  8314 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.274623  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:38.275182  8314 ts_tablet_manager.cc:1434] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:38.276295  8314 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:38.283318  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:38.285254  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:02:38.286741  8237 leader_election.cc:343] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:38.287598  8237 leader_election.cc:343] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.288592  8320 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.289203  8320 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.292618  8320 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:38.293337  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:38.294986  8163 leader_election.cc:343] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.270558  8322 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:38.296666  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:38.297470  8322 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.311270  8336 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.316219  8112 tablet_service.cc:1511] Processing CreateTablet for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:38.317508  8321 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.317948  8321 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.320413  8321 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:38.311124  8188 tablet_service.cc:1511] Processing CreateTablet for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:38.327652  8314 tablet_bootstrap.cc:654] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.337623  8188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.343369  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.352855  8315 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:38.353332  8315 ts_tablet_manager.cc:1403] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.209s	user 0.008s	sys 0.005s
I20260709 13:02:38.357960  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5168daf09c45b4accfa213d5b29a43 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:38.359211  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5168daf09c45b4accfa213d5b29a43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:38.364040  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 76457.9us
I20260709 13:02:38.365028  8315 raft_consensus.cc:359] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.365765  8315 raft_consensus.cc:385] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.366088  8315 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
W20260709 13:02:38.365921  8237 leader_election.cc:343] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.366875  8315 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.368944  8315 ts_tablet_manager.cc:1434] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:02:38.369532  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:38.371332  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:38.374701  8261 tablet_service.cc:1511] Processing CreateTablet for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:38.375586  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:38.376094  8261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.376695  8320 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.381335  8111 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5168daf09c45b4accfa213d5b29a43 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:38.382550  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5168daf09c45b4accfa213d5b29a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.384451  8315 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:38.386405  8316 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:38.386843  8316 ts_tablet_manager.cc:1403] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.256s	user 0.040s	sys 0.016s
I20260709 13:02:38.386629  8257 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5168daf09c45b4accfa213d5b29a43 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:38.387859  8257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5168daf09c45b4accfa213d5b29a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.390329  8316 raft_consensus.cc:359] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.391088  8316 raft_consensus.cc:385] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.391408  8316 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.392160  8316 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.393410  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:38.393787  8166 leader_election.cc:343] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.394752  8316 ts_tablet_manager.cc:1434] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:38.394550  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:38.395931  8320 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.394086  8199 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:38.397560  8089 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:38.398722  8316 tablet_bootstrap.cc:492] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:38.398643  8321 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.399088  8321 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.399428  8321 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.400491  8340 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.400934  8340 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.402989  8340 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.404037  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:38.404624  8125 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:38.405691  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:38.405797  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:38.406575  8115 tablet_service.cc:1511] Processing CreateTablet for tablet e577a5a5d0ab4664ab92aed9a58cfb2d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:38.407435  8184 tablet_service.cc:1511] Processing CreateTablet for tablet e577a5a5d0ab4664ab92aed9a58cfb2d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:38.408004  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e577a5a5d0ab4664ab92aed9a58cfb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.408638  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e577a5a5d0ab4664ab92aed9a58cfb2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:38.410847  8238 leader_election.cc:343] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.412711  8340 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.413136  8340 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.413738  8340 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.416796  8262 tablet_service.cc:1511] Processing CreateTablet for tablet e577a5a5d0ab4664ab92aed9a58cfb2d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:38.419225  8315 tablet_bootstrap.cc:654] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.423123  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:02:38.424638  8091 leader_election.cc:343] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.412887  8321 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.425643  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e577a5a5d0ab4664ab92aed9a58cfb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.429219  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:38.429751  8199 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.433923  8316 tablet_bootstrap.cc:654] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.433856  8113 tablet_service.cc:1511] Processing CreateTablet for tablet fe00257dce7d4bb38119184a1572ed9e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:38.435178  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe00257dce7d4bb38119184a1572ed9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.434762  8021 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.435532  8321 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:38.435736  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:02:38.437114  8091 leader_election.cc:343] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.425581  8340 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.442289  8185 tablet_service.cc:1511] Processing CreateTablet for tablet fe00257dce7d4bb38119184a1572ed9e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:38.442718  8340 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.443482  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe00257dce7d4bb38119184a1572ed9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.452279  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:38.452867  8125 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.453647  8259 tablet_service.cc:1511] Processing CreateTablet for tablet fe00257dce7d4bb38119184a1572ed9e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:38.454236  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:02:38.455618  8238 leader_election.cc:343] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.456543  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe00257dce7d4bb38119184a1572ed9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.450752  8199 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:38.464591  8089 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:38.464804  8125 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:38.465816  8321 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.466212  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:38.466410  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 60fac097ca0e444dbe442019479fc818 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:38.468060  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fac097ca0e444dbe442019479fc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.477512  8340 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.481815  8340 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:38.482681  8340 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.487108  8181 tablet_service.cc:1511] Processing CreateTablet for tablet 60fac097ca0e444dbe442019479fc818 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:38.488695  8181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fac097ca0e444dbe442019479fc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.491338  8314 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:38.492172  8314 ts_tablet_manager.cc:1403] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.003s
I20260709 13:02:38.496912  8321 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:38.498733  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 60fac097ca0e444dbe442019479fc818 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:38.498982  8321 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.499924  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fac097ca0e444dbe442019479fc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.501068  8314 raft_consensus.cc:359] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.506244  8112 tablet_service.cc:1511] Processing CreateTablet for tablet 45f9d10e30d545a18e699e9ccaea3e4e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:38.507421  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9d10e30d545a18e699e9ccaea3e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.507592  8316 tablet_bootstrap.cc:492] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:38.508039  8316 ts_tablet_manager.cc:1403] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.000s
I20260709 13:02:38.502589  8314 raft_consensus.cc:385] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.508491  8314 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.509475  8314 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.518390  8315 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:38.518844  8315 ts_tablet_manager.cc:1403] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.037s
I20260709 13:02:38.522254  8260 tablet_service.cc:1511] Processing CreateTablet for tablet 45f9d10e30d545a18e699e9ccaea3e4e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:38.523427  8260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9d10e30d545a18e699e9ccaea3e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.523998  8185 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2c54c9c07a444898c0a63f323dfd5d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:38.525099  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2c54c9c07a444898c0a63f323dfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.526317  8264 tablet_service.cc:1511] Processing CreateTablet for tablet 19747a1b37df480faebc96d93689cda5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:38.526559  8315 raft_consensus.cc:359] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.527268  8315 raft_consensus.cc:385] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.527542  8315 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.528229  8315 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.526319  8188 tablet_service.cc:1511] Processing CreateTablet for tablet 19747a1b37df480faebc96d93689cda5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:38.530694  8188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19747a1b37df480faebc96d93689cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.527519  8314 ts_tablet_manager.cc:1434] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:02:38.532284  8314 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:38.527480  8264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19747a1b37df480faebc96d93689cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.539330  8111 tablet_service.cc:1511] Processing CreateTablet for tablet 19747a1b37df480faebc96d93689cda5 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:38.540557  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19747a1b37df480faebc96d93689cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.542336  8315 ts_tablet_manager.cc:1434] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:02:38.542466  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 45f9d10e30d545a18e699e9ccaea3e4e (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:38.543277  8315 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:38.543735  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9d10e30d545a18e699e9ccaea3e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.550597  8113 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2c54c9c07a444898c0a63f323dfd5d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:38.552443  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2c54c9c07a444898c0a63f323dfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.554667  8315 tablet_bootstrap.cc:654] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.511466  8316 raft_consensus.cc:359] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.576431  8316 raft_consensus.cc:385] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.576766  8316 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.577724  8316 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.556216  8022 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.558943  8314 tablet_bootstrap.cc:654] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.564373  8107 tablet_service.cc:1511] Processing CreateTablet for tablet 05f6533c9e4149aa9b528e746b4052b3 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:38.580199  8107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f6533c9e4149aa9b528e746b4052b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.580484  8108 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9a86475338460da550bd2a16b10c49 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:38.581633  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9a86475338460da550bd2a16b10c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.566542  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 05f6533c9e4149aa9b528e746b4052b3 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:38.566749  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 05f6533c9e4149aa9b528e746b4052b3 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:38.569115  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 0862042002d04bcbb6dd1a4c89ed990c (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:38.569854  8183 tablet_service.cc:1511] Processing CreateTablet for tablet 0862042002d04bcbb6dd1a4c89ed990c (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:38.585274  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f6533c9e4149aa9b528e746b4052b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.585209  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f6533c9e4149aa9b528e746b4052b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.587634  8322 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.588088  8322 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.589803  8111 tablet_service.cc:1511] Processing CreateTablet for tablet 8339f0f377ff4af7947c4a11b4aea010 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:38.590929  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8339f0f377ff4af7947c4a11b4aea010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.583832  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9a86475338460da550bd2a16b10c49 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:38.583957  8182 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9a86475338460da550bd2a16b10c49 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:38.591427  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:38.556226  8261 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2c54c9c07a444898c0a63f323dfd5d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:38.595502  8183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0862042002d04bcbb6dd1a4c89ed990c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.596319  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9a86475338460da550bd2a16b10c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.596777  8199 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:38.592824  8322 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.598093  8238 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:38.596122  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:38.598193  8187 tablet_service.cc:1511] Processing CreateTablet for tablet 8339f0f377ff4af7947c4a11b4aea010 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:38.599064  8125 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:38.599685  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8339f0f377ff4af7947c4a11b4aea010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.601291  8261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2c54c9c07a444898c0a63f323dfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.602332  8262 tablet_service.cc:1511] Processing CreateTablet for tablet 8339f0f377ff4af7947c4a11b4aea010 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:38.603473  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8339f0f377ff4af7947c4a11b4aea010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.603747  8322 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.604146  8322 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.604521  8322 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.606263  8257 tablet_service.cc:1511] Processing CreateTablet for tablet 0862042002d04bcbb6dd1a4c89ed990c (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:38.607460  8257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0862042002d04bcbb6dd1a4c89ed990c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.608467  8182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9a86475338460da550bd2a16b10c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.614251  8316 ts_tablet_manager.cc:1434] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.002s
I20260709 13:02:38.615252  8316 tablet_bootstrap.cc:492] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:38.617763  8322 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.619011  8110 tablet_service.cc:1511] Processing CreateTablet for tablet ff5d69caf66c468aa9766af3b02649b0 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:38.623556  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:38.624120  8125 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.630537  8125 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:38.631739  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:38.632520  8336 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.636929  8186 tablet_service.cc:1511] Processing CreateTablet for tablet ff5d69caf66c468aa9766af3b02649b0 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:38.638195  8186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5d69caf66c468aa9766af3b02649b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.658367  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5d69caf66c468aa9766af3b02649b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.660043  8259 tablet_service.cc:1511] Processing CreateTablet for tablet ff5d69caf66c468aa9766af3b02649b0 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:38.661100  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5d69caf66c468aa9766af3b02649b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.663363  8316 tablet_bootstrap.cc:654] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.667785  8336 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:38.675475  8322 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.679757  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:38.680307  8199 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.680339  8258 tablet_service.cc:1511] Processing CreateTablet for tablet c788fd48c46f4ede898fe663e6cf64cc (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:38.681614  8258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788fd48c46f4ede898fe663e6cf64cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.676376  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0862042002d04bcbb6dd1a4c89ed990c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.684859  8181 tablet_service.cc:1511] Processing CreateTablet for tablet f86e3e4c37f4426b821f0af0b5b1c516 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:38.686061  8181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86e3e4c37f4426b821f0af0b5b1c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.690137  8184 tablet_service.cc:1511] Processing CreateTablet for tablet c788fd48c46f4ede898fe663e6cf64cc (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:38.691018  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788fd48c46f4ede898fe663e6cf64cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.708992  8112 tablet_service.cc:1511] Processing CreateTablet for tablet c788fd48c46f4ede898fe663e6cf64cc (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:38.710381  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788fd48c46f4ede898fe663e6cf64cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.711345  8263 tablet_service.cc:1511] Processing CreateTablet for tablet f86e3e4c37f4426b821f0af0b5b1c516 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:38.712472  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86e3e4c37f4426b821f0af0b5b1c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.713590  8108 tablet_service.cc:1511] Processing CreateTablet for tablet f86e3e4c37f4426b821f0af0b5b1c516 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:38.714773  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86e3e4c37f4426b821f0af0b5b1c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.719867  8107 tablet_service.cc:1511] Processing CreateTablet for tablet a4e63fd519e64f52b42bde9b044f1a9d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:38.721019  8107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e63fd519e64f52b42bde9b044f1a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.717514  8336 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.746039  8184 tablet_service.cc:1511] Processing CreateTablet for tablet a4e63fd519e64f52b42bde9b044f1a9d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:38.747309  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e63fd519e64f52b42bde9b044f1a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.729981  8199 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:38.771519  8314 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:38.772023  8314 ts_tablet_manager.cc:1403] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.004s
I20260709 13:02:38.774883  8315 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:38.775367  8315 ts_tablet_manager.cc:1403] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.017s
I20260709 13:02:38.775023  8314 raft_consensus.cc:359] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.791484  8110 tablet_service.cc:1511] Processing CreateTablet for tablet 6b269caef5384838a52bcedc78464607 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:38.792794  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b269caef5384838a52bcedc78464607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.793736  8315 raft_consensus.cc:359] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.797959  8315 raft_consensus.cc:385] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.787261  8264 tablet_service.cc:1511] Processing CreateTablet for tablet a4e63fd519e64f52b42bde9b044f1a9d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:38.798318  8315 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.784253  8314 raft_consensus.cc:385] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.799031  8314 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.799273  8315 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.799737  8314 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.799512  8022 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.801144  8022 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.796979  8316 tablet_bootstrap.cc:492] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:38.802553  8316 ts_tablet_manager.cc:1403] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.024s
I20260709 13:02:38.805088  8186 tablet_service.cc:1511] Processing CreateTablet for tablet 6b269caef5384838a52bcedc78464607 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:38.805456  8316 raft_consensus.cc:359] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.806180  8316 raft_consensus.cc:385] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.806306  8186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b269caef5384838a52bcedc78464607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.807303  8314 ts_tablet_manager.cc:1434] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.005s
I20260709 13:02:38.808459  8314 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:38.810506  8264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e63fd519e64f52b42bde9b044f1a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.810793  8257 tablet_service.cc:1511] Processing CreateTablet for tablet 6b269caef5384838a52bcedc78464607 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:38.811934  8257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b269caef5384838a52bcedc78464607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.812062  8315 ts_tablet_manager.cc:1434] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.004s
I20260709 13:02:38.814148  8315 tablet_bootstrap.cc:492] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:38.819789  8107 tablet_service.cc:1511] Processing CreateTablet for tablet c8addb0a61b24a3fa8f4700e78ac3a48 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:38.822160  8107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8addb0a61b24a3fa8f4700e78ac3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.806488  8316 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.824182  8181 tablet_service.cc:1511] Processing CreateTablet for tablet c8addb0a61b24a3fa8f4700e78ac3a48 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:38.825376  8181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8addb0a61b24a3fa8f4700e78ac3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.831944  8314 tablet_bootstrap.cc:654] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.836762  8263 tablet_service.cc:1511] Processing CreateTablet for tablet c8addb0a61b24a3fa8f4700e78ac3a48 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:38.837826  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8addb0a61b24a3fa8f4700e78ac3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.839426  8316 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.841648  8316 ts_tablet_manager.cc:1434] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:02:38.842573  8316 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:38.845501  8187 tablet_service.cc:1511] Processing CreateTablet for tablet bd9e13ff887048ca88ba20c2768182d3 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:38.846917  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9e13ff887048ca88ba20c2768182d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.849464  8315 tablet_bootstrap.cc:654] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.842262  8111 tablet_service.cc:1511] Processing CreateTablet for tablet bd9e13ff887048ca88ba20c2768182d3 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:38.857908  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9e13ff887048ca88ba20c2768182d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.864233  8316 tablet_bootstrap.cc:654] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.868705  8314 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:38.869149  8314 ts_tablet_manager.cc:1403] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.004s
I20260709 13:02:38.872731  8263 tablet_service.cc:1511] Processing CreateTablet for tablet bd9e13ff887048ca88ba20c2768182d3 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:38.873944  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9e13ff887048ca88ba20c2768182d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.875514  8316 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:38.875948  8316 ts_tablet_manager.cc:1403] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:02:38.877580  8314 raft_consensus.cc:359] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.878300  8314 raft_consensus.cc:385] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.878589  8314 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.879288  8314 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.881421  8110 tablet_service.cc:1511] Processing CreateTablet for tablet 157272e89e0f4099b4d825211d7d823a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:38.883924  8314 ts_tablet_manager.cc:1434] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:02:38.884831  8314 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:38.885519  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157272e89e0f4099b4d825211d7d823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.885777  8181 tablet_service.cc:1511] Processing CreateTablet for tablet 157272e89e0f4099b4d825211d7d823a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:38.886896  8181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157272e89e0f4099b4d825211d7d823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.878564  8316 raft_consensus.cc:359] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.890015  8316 raft_consensus.cc:385] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.890295  8316 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.891042  8316 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.895082  8316 ts_tablet_manager.cc:1434] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:38.895977  8316 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:38.896304  8257 tablet_service.cc:1511] Processing CreateTablet for tablet 157272e89e0f4099b4d825211d7d823a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:38.897480  8257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157272e89e0f4099b4d825211d7d823a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.897924  8107 tablet_service.cc:1511] Processing CreateTablet for tablet 76f64012d7a146ddb8774cc4299a38e8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:38.899408  8107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f64012d7a146ddb8774cc4299a38e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.900924  8314 tablet_bootstrap.cc:654] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.903577  8186 tablet_service.cc:1511] Processing CreateTablet for tablet 76f64012d7a146ddb8774cc4299a38e8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:38.904723  8186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f64012d7a146ddb8774cc4299a38e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.904759  8321 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.905897  8316 tablet_bootstrap.cc:654] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.914156  8125 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.922026  8336 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.922935  8264 tablet_service.cc:1511] Processing CreateTablet for tablet 76f64012d7a146ddb8774cc4299a38e8 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:38.924232  8264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f64012d7a146ddb8774cc4299a38e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.927997  8108 tablet_service.cc:1511] Processing CreateTablet for tablet d0ae8ee6216f434eb7857a29d9b682d9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:38.929169  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ae8ee6216f434eb7857a29d9b682d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.930104  8187 tablet_service.cc:1511] Processing CreateTablet for tablet d0ae8ee6216f434eb7857a29d9b682d9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:38.931299  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ae8ee6216f434eb7857a29d9b682d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.932296  8336 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.942044  8112 tablet_service.cc:1511] Processing CreateTablet for tablet ccbf67588374458ebbd07bc5aeeb3b5a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:38.942492  8263 tablet_service.cc:1511] Processing CreateTablet for tablet d0ae8ee6216f434eb7857a29d9b682d9 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:38.943269  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf67588374458ebbd07bc5aeeb3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.943596  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ae8ee6216f434eb7857a29d9b682d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.954005  8336 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.954495  8336 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.956954  8315 tablet_bootstrap.cc:492] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:38.957284  8336 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:38.958470  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:38.988377  8238 leader_election.cc:343] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.988773  8189 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:38.989210  8315 ts_tablet_manager.cc:1403] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.009s
I20260709 13:02:38.959082  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:38.963479  8188 tablet_service.cc:1511] Processing CreateTablet for tablet ccbf67588374458ebbd07bc5aeeb3b5a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:38.989444  8110 tablet_service.cc:1511] Processing CreateTablet for tablet 292514be4a7b4f768913b094de3d5d6d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:38.964332  8320 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.988420  8321 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.989929  8261 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:38.990372  8320 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.990947  8108 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:38.990489  8321 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.969161  8262 tablet_service.cc:1511] Processing CreateTablet for tablet ccbf67588374458ebbd07bc5aeeb3b5a (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:38.974517  8111 tablet_service.cc:1511] Processing CreateTablet for tablet bc9f1ca41df6462b902893527ceb3878 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:38.992468  8320 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:38.977763  8183 tablet_service.cc:1511] Processing CreateTablet for tablet bc9f1ca41df6462b902893527ceb3878 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:38.981205  8184 tablet_service.cc:1511] Processing CreateTablet for tablet e848f577948c470fb4c95fcc2b55b7ef (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:38.989989  8189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.994794  8188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf67588374458ebbd07bc5aeeb3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.994577  8107 tablet_service.cc:1511] Processing CreateTablet for tablet 7685faa95b5f44629fc266055fc278aa (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:38.994917  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:38.995677  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848f577948c470fb4c95fcc2b55b7ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.995739  8123 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:38.996618  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:38.997195  8273 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:38.998117  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:39.000396  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:38.984417  8258 tablet_service.cc:1511] Processing CreateTablet for tablet e848f577948c470fb4c95fcc2b55b7ef (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:39.001775  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:38.967525  8316 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.002918  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:39.003324  8183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9f1ca41df6462b902893527ceb3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.003504  8198 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:39.002957  8316 ts_tablet_manager.cc:1403] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.010s
I20260709 13:02:39.006707  8316 raft_consensus.cc:359] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:38.991181  8261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:39.003075  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:38.971344  8314 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:39.007579  8320 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.007936  8314 ts_tablet_manager.cc:1403] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.014s
I20260709 13:02:39.008073  8262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf67588374458ebbd07bc5aeeb3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.008810  8258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848f577948c470fb4c95fcc2b55b7ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.010545  8314 raft_consensus.cc:359] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.011235  8314 raft_consensus.cc:385] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.011634  8314 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.013216  8314 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.014516  8182 tablet_service.cc:1511] Processing CreateTablet for tablet 7685faa95b5f44629fc266055fc278aa (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:39.015619  8314 ts_tablet_manager.cc:1434] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:39.015682  8182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685faa95b5f44629fc266055fc278aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.016595  8314 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:39.006800  8187 tablet_service.cc:1511] Processing CreateTablet for tablet 292514be4a7b4f768913b094de3d5d6d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:39.007447  8316 raft_consensus.cc:385] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.025774  8316 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.025447  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 7685faa95b5f44629fc266055fc278aa (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:39.027066  8316 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.027921  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685faa95b5f44629fc266055fc278aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.029060  8316 ts_tablet_manager.cc:1434] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 13:02:38.991216  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292514be4a7b4f768913b094de3d5d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.029928  8111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9f1ca41df6462b902893527ceb3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.030329  8321 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.031674  8316 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.033628  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.036671  8107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685faa95b5f44629fc266055fc278aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.040426  8345 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.040882  8345 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.041256  8345 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.024734  8187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292514be4a7b4f768913b094de3d5d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.051311  8351 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.051573  8112 tablet_service.cc:1511] Processing CreateTablet for tablet e848f577948c470fb4c95fcc2b55b7ef (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:39.051780  8351 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.052753  8112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848f577948c470fb4c95fcc2b55b7ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.054159  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 22c63c7039644c089bf014466158ac6b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:39.055152  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c63c7039644c089bf014466158ac6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.055363  8351 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.056833  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:39.057502  8198 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:39.058765  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:39.059299  8316 tablet_bootstrap.cc:654] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.059577  8351 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.060669  8351 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.061038  8351 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.067305  8315 raft_consensus.cc:359] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.068222  8315 raft_consensus.cc:385] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.068599  8315 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.069332  8315 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.071527  8315 ts_tablet_manager.cc:1434] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260709 13:02:39.072436  8315 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:39.073037  8351 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.075342  8185 tablet_service.cc:1511] Processing CreateTablet for tablet 22c63c7039644c089bf014466158ac6b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:39.074681  8345 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.076256  8314 tablet_bootstrap.cc:654] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.076498  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c63c7039644c089bf014466158ac6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.078804  8351 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.079787  8345 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.024659  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 292514be4a7b4f768913b094de3d5d6d (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:39.082093  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292514be4a7b4f768913b094de3d5d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.082190  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:39.082875  8257 tablet_service.cc:1511] Processing CreateTablet for tablet 22c63c7039644c089bf014466158ac6b (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:39.084352  8257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c63c7039644c089bf014466158ac6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.086336  8115 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca6717bd9844d668ee0a2fff3b530f4 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:39.087347  8115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca6717bd9844d668ee0a2fff3b530f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.082741  8197 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.089823  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:39.090368  8198 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.090832  8316 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.091254  8316 ts_tablet_manager.cc:1403] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 13:02:39.093747  8316 raft_consensus.cc:359] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.094446  8316 raft_consensus.cc:385] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.094702  8316 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.095477  8316 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.096469  8264 tablet_service.cc:1511] Processing CreateTablet for tablet bc9f1ca41df6462b902893527ceb3878 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:39.097433  8316 ts_tablet_manager.cc:1434] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:39.102308  8259 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca6717bd9844d668ee0a2fff3b530f4 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:39.106527  8190 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca6717bd9844d668ee0a2fff3b530f4 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:39.107672  8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca6717bd9844d668ee0a2fff3b530f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.119848  8259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca6717bd9844d668ee0a2fff3b530f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.120023  8316 tablet_bootstrap.cc:492] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.124377  8320 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.126674  8113 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc42e8321e24c91a3684956eeb796b7 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:39.117174  8197 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:39.130035  8264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9f1ca41df6462b902893527ceb3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.130169  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:39.131376  8351 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.131821  8351 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:39.133630  8336 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.132618  8351 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.150429  8316 tablet_bootstrap.cc:654] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.127672  8315 tablet_bootstrap.cc:654] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.127748  8113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc42e8321e24c91a3684956eeb796b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.171002  8184 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc42e8321e24c91a3684956eeb796b7 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:39.172097  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc42e8321e24c91a3684956eeb796b7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:39.170346  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 170013us
I20260709 13:02:39.183852  8274 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:39.185302  8237 leader_election.cc:343] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.185755  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:39.191318  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:39.192034  8273 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.209429  8314 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:39.209879  8314 ts_tablet_manager.cc:1403] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.193s	user 0.016s	sys 0.009s
I20260709 13:02:39.212639  8263 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc42e8321e24c91a3684956eeb796b7 (DEFAULT_TABLE table=test-workload [id=c9876b25242c426292b7284a80fd52e1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:39.213747  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc42e8321e24c91a3684956eeb796b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.214967  8314 raft_consensus.cc:359] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.215596  8314 raft_consensus.cc:385] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.216013  8314 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.216686  8314 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.201411  8336 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.222890  8314 ts_tablet_manager.cc:1434] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:39.223767  8314 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:39.243775  8314 tablet_bootstrap.cc:654] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.255800  8351 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.257885  8351 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.276479  8351 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.254643  8336 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.277225  8336 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.279229  8336 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.282689  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:39.284133  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:39.293948  8368 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:39.289311  8238 leader_election.cc:343] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.298673  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:39.299325  8316 tablet_bootstrap.cc:492] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.299752  8316 ts_tablet_manager.cc:1403] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.180s	user 0.022s	sys 0.018s
I20260709 13:02:39.300033  8315 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:39.300451  8315 ts_tablet_manager.cc:1403] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.228s	user 0.031s	sys 0.023s
I20260709 13:02:39.302131  8316 raft_consensus.cc:359] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.297247  8198 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:39.302929  8315 raft_consensus.cc:359] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.303567  8315 raft_consensus.cc:385] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.303848  8315 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.304807  8316 raft_consensus.cc:385] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.304563  8315 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.305085  8316 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.299263  8124 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:39.306049  8316 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.306720  8315 ts_tablet_manager.cc:1434] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:39.307214  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:39.307716  8124 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.308895  8376 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.309780  8315 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:39.311034  8316 ts_tablet_manager.cc:1434] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:02:39.311858  8316 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.303809  8089 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:39.321529  8368 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.322000  8368 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:39.326700  8368 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.332091  8320 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.332557  8320 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.334753  8320 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.338514  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:39.339152  8272 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:39.316038  8273 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:39.340859  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:39.341483  8123 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:39.345798  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:39.346349  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:39.347291  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:39.352207  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:39.354079  8379 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.354485  8379 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.355738  8379 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.357036  8237 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:02:39.355074  8163 leader_election.cc:343] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.358846  8320 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.358919  8376 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.359309  8320 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.359635  8320 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.364768  8377 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:39.374477  8124 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:39.376318  8320 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.378448  8320 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.384894  8379 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.387811  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:39.388180  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:39.392949  8379 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.392306  8322 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.399645  8322 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.402531  8322 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.388402  8273 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.426967  8315 tablet_bootstrap.cc:654] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.432353  8314 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:39.432794  8314 ts_tablet_manager.cc:1403] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.209s	user 0.004s	sys 0.015s
I20260709 13:02:39.435201  8316 tablet_bootstrap.cc:654] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.435681  8314 raft_consensus.cc:359] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.436331  8314 raft_consensus.cc:385] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.436582  8314 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.437804  8314 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.439756  8314 ts_tablet_manager.cc:1434] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:39.440593  8314 tablet_bootstrap.cc:492] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:39.445780  8314 tablet_bootstrap.cc:654] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.449376  8273 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:39.457227  8315 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:39.457773  8315 ts_tablet_manager.cc:1403] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.148s	user 0.024s	sys 0.001s
I20260709 13:02:39.462196  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:39.711202  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:39.736188  8316 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.736596  8316 ts_tablet_manager.cc:1403] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.425s	user 0.010s	sys 0.002s
I20260709 13:02:39.739161  8316 raft_consensus.cc:359] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.739828  8316 raft_consensus.cc:385] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.740087  8316 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.740658  8316 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:39.741731  8238 leader_election.cc:343] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.743767  8238 leader_election.cc:343] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.742825  8316 ts_tablet_manager.cc:1434] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:02:39.744588  8379 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.745429  8316 tablet_bootstrap.cc:492] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.751305  8316 tablet_bootstrap.cc:654] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.756093  8340 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.758760  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:39.759322  8125 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:39.765295  8163 leader_election.cc:343] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.766152  8125 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:39.766535  8367 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.766969  8367 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.767457  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:39.767944  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:39.768253  8322 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.768718  8322 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:39.769410  8322 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.774605  8367 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.774922  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:39.764370  8316 tablet_bootstrap.cc:492] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.776008  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:39.776507  8316 ts_tablet_manager.cc:1403] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.000s
I20260709 13:02:39.776579  8274 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
W20260709 13:02:39.776738  8237 leader_election.cc:343] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.777148  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:39.777761  8322 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.779300  8316 raft_consensus.cc:359] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.779925  8316 raft_consensus.cc:385] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.780190  8316 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.783267  8023 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.783895  8316 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.785862  8316 ts_tablet_manager.cc:1434] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:39.786669  8316 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.791886  8316 tablet_bootstrap.cc:654] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.794641  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:39.795811  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:39.796605  8367 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.797132  8320 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.797478  8320 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.797778  8320 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.798480  8315 raft_consensus.cc:359] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.799099  8315 raft_consensus.cc:385] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.799348  8315 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.799927  8315 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.803612  8351 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.807672  8320 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.809121  8314 tablet_bootstrap.cc:492] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:39.810271  8314 ts_tablet_manager.cc:1403] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.370s	user 0.012s	sys 0.007s
I20260709 13:02:39.810391  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:39.810958  8123 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.817399  8123 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:39.827140  8320 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.824110  8369 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:02:39.818701  8316 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.817889  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:39.839828  8316 ts_tablet_manager.cc:1403] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.009s
I20260709 13:02:39.839848  8273 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.840816  8163 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:39.841624  8320 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.813263  8314 raft_consensus.cc:359] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.834583  8315 ts_tablet_manager.cc:1434] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.377s	user 0.013s	sys 0.000s
I20260709 13:02:39.843922  8315 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:39.842911  8314 raft_consensus.cc:385] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.849714  8314 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.850441  8314 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.854682  8314 ts_tablet_manager.cc:1434] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:02:39.857453  8314 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:39.856331  8125 raft_consensus.cc:2376] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1. Re-sending same reply.
I20260709 13:02:39.842293  8316 raft_consensus.cc:359] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.861397  8345 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.861946  8316 raft_consensus.cc:385] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.862282  8316 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.865825  8316 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.867286  8315 tablet_bootstrap.cc:654] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.869791  8316 ts_tablet_manager.cc:1434] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:02:39.873736  8316 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.872318  8367 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:39.871914  8320 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:39.881947  8320 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.882948  8273 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:39.881134  8367 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.883939  8022 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.886593  8314 tablet_bootstrap.cc:654] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.890050  8315 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:39.890488  8315 ts_tablet_manager.cc:1403] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 13:02:39.892864  8315 raft_consensus.cc:359] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.893507  8315 raft_consensus.cc:385] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.893767  8315 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.896601  8316 tablet_bootstrap.cc:654] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.898867  8315 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.900250  8023 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.904886  8315 ts_tablet_manager.cc:1434] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:39.905834  8315 tablet_bootstrap.cc:492] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:39.912456  8314 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:39.912608  8315 tablet_bootstrap.cc:654] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.914011  8316 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.914702  8316 ts_tablet_manager.cc:1403] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.002s
I20260709 13:02:39.917480  8316 raft_consensus.cc:359] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.918093  8316 raft_consensus.cc:385] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.918347  8316 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.919075  8314 ts_tablet_manager.cc:1403] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.001s
I20260709 13:02:39.921622  8314 raft_consensus.cc:359] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.922286  8314 raft_consensus.cc:385] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.922550  8314 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.923146  8314 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.925025  8314 ts_tablet_manager.cc:1434] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:39.932471  8315 tablet_bootstrap.cc:492] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:39.933120  8315 ts_tablet_manager.cc:1403] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 13:02:39.933707  8316 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.935668  8316 ts_tablet_manager.cc:1434] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:02:39.936511  8316 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.936124  8315 raft_consensus.cc:359] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.936932  8315 raft_consensus.cc:385] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.937263  8315 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.937947  8315 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.940253  8315 ts_tablet_manager.cc:1434] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:39.941210  8315 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:39.941869  8314 tablet_bootstrap.cc:492] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:39.944643  8320 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.945076  8320 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.946734  8315 tablet_bootstrap.cc:654] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.947113  8320 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:39.950063  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:39.951212  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:39.951403  8166 leader_election.cc:343] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.952500  8163 leader_election.cc:343] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.952930  8163 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:39.954095  8320 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.954636  8314 tablet_bootstrap.cc:654] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.954044  8316 tablet_bootstrap.cc:654] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.961148  8314 tablet_bootstrap.cc:492] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:39.961565  8314 ts_tablet_manager.cc:1403] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 13:02:39.963922  8314 raft_consensus.cc:359] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.964516  8314 raft_consensus.cc:385] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.964754  8314 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.965440  8023 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.965871  8314 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.966777  8316 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:39.978915  8316 ts_tablet_manager.cc:1403] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.011s
I20260709 13:02:39.981376  8316 raft_consensus.cc:359] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.982136  8316 raft_consensus.cc:385] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.982404  8316 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.983147  8316 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:39.985193  8316 ts_tablet_manager.cc:1434] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:39.986019  8316 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:39.986814  8314 ts_tablet_manager.cc:1434] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:02:39.987689  8314 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:39.992769  8316 tablet_bootstrap.cc:654] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.995479  8023 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.998847  8315 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:39.999310  8315 ts_tablet_manager.cc:1403] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.014s
I20260709 13:02:40.001034  8351 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.001494  8351 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.003559  8351 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:39.992769  8314 tablet_bootstrap.cc:654] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.005659  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.006244  8199 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.005388  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.009579  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.003576  8315 raft_consensus.cc:359] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.010236  8315 raft_consensus.cc:385] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.010571  8315 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.012259  8315 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.013046  8316 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.010711  8351 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.013522  8316 ts_tablet_manager.cc:1403] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.011s
I20260709 13:02:40.013722  8351 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.014103  8351 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.014612  8315 ts_tablet_manager.cc:1434] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:02:40.016364  8316 raft_consensus.cc:359] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.016992  8316 raft_consensus.cc:385] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.017113  8315 tablet_bootstrap.cc:492] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.017254  8316 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.017884  8316 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:40.010481  8237 leader_election.cc:343] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.023345  8316 ts_tablet_manager.cc:1434] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:40.023517  8315 tablet_bootstrap.cc:654] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.024201  8316 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.028767  8351 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.031553  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.036612  8351 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.037575  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:40.038121  8199 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.039683  8314 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.040100  8314 ts_tablet_manager.cc:1403] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.002s
I20260709 13:02:40.041318  8316 tablet_bootstrap.cc:654] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:40.041080  8237 leader_election.cc:343] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.044335  8314 raft_consensus.cc:359] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.045017  8314 raft_consensus.cc:385] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.045301  8314 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.046170  8314 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.048153  8314 ts_tablet_manager.cc:1434] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:40.049012  8314 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.049221  8199 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.053969  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.055958  8340 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.056432  8340 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.058452  8315 tablet_bootstrap.cc:492] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
W20260709 13:02:40.056052  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:40.058948  8315 ts_tablet_manager.cc:1403] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.008s
I20260709 13:02:40.059051  8340 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.059589  8340 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.060151  8314 tablet_bootstrap.cc:654] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.062427  8315 raft_consensus.cc:359] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.062664  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.063057  8315 raft_consensus.cc:385] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.063357  8315 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.063616  8340 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:40.064009  8315 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.064445  8340 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.061954  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:40.066470  8237 leader_election.cc:343] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.063243  8199 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.073930  8314 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.074385  8314 ts_tablet_manager.cc:1403] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:02:40.074239  8238 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.075350  8336 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.075683  8336 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.075982  8336 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.062176  8316 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.081730  8316 ts_tablet_manager.cc:1403] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.003s
I20260709 13:02:40.083426  8315 ts_tablet_manager.cc:1434] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:02:40.084380  8316 raft_consensus.cc:359] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.085613  8316 raft_consensus.cc:385] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.085942  8316 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.086710  8316 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.090977  8315 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.090935  8314 raft_consensus.cc:359] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.092545  8314 raft_consensus.cc:385] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.091526  8023 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.092746  8314 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.094954  8314 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.097958  8314 ts_tablet_manager.cc:1434] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.005s
I20260709 13:02:40.099690  8315 tablet_bootstrap.cc:654] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.094996  8336 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.106061  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:40.106587  8199 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.107736  8316 ts_tablet_manager.cc:1434] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 13:02:40.108057  8336 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.108336  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.109333  8316 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
W20260709 13:02:40.109642  8237 leader_election.cc:343] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.113168  8199 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.108353  8314 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.114290  8238 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.115146  8316 tablet_bootstrap.cc:654] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.115355  8336 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.115804  8336 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:40.116604  8336 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.119577  8314 tablet_bootstrap.cc:654] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.125084  8315 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.125579  8315 ts_tablet_manager.cc:1403] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.007s
I20260709 13:02:40.128604  8314 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.128328  8315 raft_consensus.cc:359] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.128711  8316 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.128938  8315 raft_consensus.cc:385] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.129029  8314 ts_tablet_manager.cc:1403] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:02:40.129375  8315 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.130060  8315 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.130959  8316 ts_tablet_manager.cc:1403] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:02:40.131945  8314 raft_consensus.cc:359] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.132550  8314 raft_consensus.cc:385] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.132820  8314 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.136118  8316 raft_consensus.cc:359] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.136814  8316 raft_consensus.cc:385] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.137362  8367 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.137609  8369 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.137861  8367 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.139390  8369 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.139848  8367 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.140697  8023 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.141525  8369 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.141700  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.142473  8122 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:40.142671  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.137154  8316 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.144507  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.144613  8316 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.133533  8314 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.146368  8166 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:40.147207  8314 ts_tablet_manager.cc:1434] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:02:40.147547  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.149111  8367 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.149528  8316 ts_tablet_manager.cc:1434] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:02:40.150309  8314 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.150766  8316 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.145221  8198 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:40.156504  8314 tablet_bootstrap.cc:654] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.156811  8316 tablet_bootstrap.cc:654] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.156687  8089 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.157465  8369 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.161608  8367 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.163317  8315 ts_tablet_manager.cc:1434] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:02:40.164230  8315 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.168206  8316 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.168700  8316 ts_tablet_manager.cc:1403] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:02:40.170535  8369 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.171505  8316 raft_consensus.cc:359] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.172258  8316 raft_consensus.cc:385] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.172551  8316 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.173318  8316 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.175225  8336 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.175638  8336 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.178516  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.179109  8122 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.180315  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:40.181098  8340 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.181447  8340 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.181751  8340 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.185755  8336 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.186596  8314 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.187000  8314 ts_tablet_manager.cc:1403] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.006s
I20260709 13:02:40.187748  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.188422  8198 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.189563  8314 raft_consensus.cc:359] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.190167  8314 raft_consensus.cc:385] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.190390  8315 tablet_bootstrap.cc:654] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.190431  8314 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.190747  8340 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.191308  8314 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.193759  8314 ts_tablet_manager.cc:1434] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:40.194466  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.194690  8314 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.195052  8122 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.200840  8314 tablet_bootstrap.cc:654] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.202344  8315 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.202956  8315 ts_tablet_manager.cc:1403] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.006s
I20260709 13:02:40.203670  8340 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.202418  8122 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.204780  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:40.205384  8198 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.205446  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:40.204275  8316 ts_tablet_manager.cc:1434] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:02:40.206290  8340 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.206748  8340 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:40.207401  8316 tablet_bootstrap.cc:492] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.207513  8340 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.212440  8314 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.212853  8314 ts_tablet_manager.cc:1403] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:02:40.213759  8316 tablet_bootstrap.cc:654] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.215236  8314 raft_consensus.cc:359] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.216005  8314 raft_consensus.cc:385] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.216265  8314 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.217031  8314 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.222364  8314 ts_tablet_manager.cc:1434] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:40.223239  8314 tablet_bootstrap.cc:492] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.224962  8336 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.225478  8336 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.227602  8336 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.228907  8314 tablet_bootstrap.cc:654] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.229287  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.231105  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.231727  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.233057  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.233978  8336 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.234599  8336 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.235020  8336 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:40.238652  8237 leader_election.cc:343] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.239699  8369 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.240132  8369 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.240687  8198 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.242039  8369 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.243062  8367 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.243477  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.238409  8315 raft_consensus.cc:359] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.244171  8315 raft_consensus.cc:385] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.243502  8367 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.246752  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.247635  8199 raft_consensus.cc:2393] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:40.247828  8367 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.248865  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.250012  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.250005  8369 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.250638  8273 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.252179  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.253379  8367 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.253767  8367 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.254086  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.254730  8122 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.254106  8367 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.262691  8351 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.262861  8369 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.266732  8322 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.266745  8351 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.271309  8020 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.272511  8351 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.273363  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.273277  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.273928  8199 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.275091  8351 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.275143  8238 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:02:40.277835  8237 leader_election.cc:343] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.275647  8351 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.278162  8340 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.278847  8340 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.279173  8340 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.280241  8351 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.280464  8315 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.282217  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.288802  8315 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.284364  8316 tablet_bootstrap.cc:492] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.245708  8336 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.289912  8199 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:40.291456  8315 ts_tablet_manager.cc:1434] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:02:40.291689  8336 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.293118  8315 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.280352  8367 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.295337  8367 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.296214  8314 tablet_bootstrap.cc:492] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.303301  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.304705  8314 ts_tablet_manager.cc:1403] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.039s
I20260709 13:02:40.304864  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:40.305295  8367 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.305444  8273 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.305751  8367 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.307214  8314 raft_consensus.cc:359] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.307819  8314 raft_consensus.cc:385] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.308061  8314 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.308112  8367 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.308297  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.299649  8238 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:02:40.309548  8163 leader_election.cc:343] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.304736  8123 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.311038  8351 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.311520  8351 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.311859  8351 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.286406  8340 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.315513  8314 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.287544  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.317368  8340 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.317917  8314 ts_tablet_manager.cc:1434] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.004s
I20260709 13:02:40.318823  8314 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.318660  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:40.319245  8200 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.304315  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.321724  8125 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:40.323273  8237 leader_election.cc:343] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.323398  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.324038  8200 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.324575  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.324837  8314 tablet_bootstrap.cc:654] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.324930  8238 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.325151  8274 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.326490  8123 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
W20260709 13:02:40.326074  8237 leader_election.cc:343] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.329429  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.330430  8367 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.330740  8367 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.331043  8367 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.333284  8273 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.299304  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:40.337154  8199 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.337236  8367 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.338040  8316 ts_tablet_manager.cc:1403] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.005s
I20260709 13:02:40.339093  8315 tablet_bootstrap.cc:654] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.338934  8336 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.343163  8336 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:40.339835  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:40.343954  8336 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.344924  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.345677  8320 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.346000  8340 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.346150  8320 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:40.346428  8340 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.347301  8320 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.348402  8340 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.342590  8125 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.345736  8322 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.351475  8322 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:40.353284  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.353272  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.357331  8314 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.357885  8314 ts_tablet_manager.cc:1403] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.016s
I20260709 13:02:40.359171  8322 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.359730  8367 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:40.359702  8237 leader_election.cc:343] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.361187  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:40.361687  8273 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.353237  8351 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.365021  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:02:40.365392  8238 leader_election.cc:343] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.372512  8316 raft_consensus.cc:359] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.373785  8316 raft_consensus.cc:385] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.374032  8316 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
W20260709 13:02:40.377513  8163 leader_election.cc:343] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.373668  8345 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.378551  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.378780  8345 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:40.379631  8237 leader_election.cc:343] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.380560  8345 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.381568  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.382443  8274 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:40.381518  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.384125  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.384909  8345 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.390345  8316 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.375069  8238 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.392984  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.393409  8273 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.394496  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.395763  8320 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.396473  8320 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:40.396883  8345 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.397289  8320 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.397657  8023 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.400568  8377 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.401188  8316 ts_tablet_manager.cc:1434] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.002s
I20260709 13:02:40.402107  8316 tablet_bootstrap.cc:492] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.402992  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:40.403543  8199 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.398800  8434 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:02:40.406267  8351 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.409911  8020 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.415803  8316 tablet_bootstrap.cc:654] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.416946  8199 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:40.418076  8238 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.419066  8351 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.419562  8351 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:40.419663  8022 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.420358  8351 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.411100  8314 raft_consensus.cc:359] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.423857  8314 raft_consensus.cc:385] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.424105  8314 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.424790  8314 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.426692  8314 ts_tablet_manager.cc:1434] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.000s
I20260709 13:02:40.429901  8314 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.425889  8315 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.433637  8315 ts_tablet_manager.cc:1403] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.008s
I20260709 13:02:40.436299  8315 raft_consensus.cc:359] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.436949  8315 raft_consensus.cc:385] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.437615  8316 tablet_bootstrap.cc:492] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.438009  8316 ts_tablet_manager.cc:1403] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.004s
I20260709 13:02:40.441716  8316 raft_consensus.cc:359] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.442351  8316 raft_consensus.cc:385] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.442663  8316 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.437194  8315 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.443421  8316 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.445600  8316 ts_tablet_manager.cc:1434] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:40.445649  8314 tablet_bootstrap.cc:654] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.443933  8315 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.449146  8316 tablet_bootstrap.cc:492] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.449246  8315 ts_tablet_manager.cc:1434] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:40.452757  8315 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.455735  8316 tablet_bootstrap.cc:654] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.457412  8320 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.459590  8022 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.460311  8315 tablet_bootstrap.cc:654] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.466472  8320 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.467039  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080008afc0 after lost signal to thread 7008
W20260709 13:02:40.468189  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080019ed40 after lost signal to thread 8057
W20260709 13:02:40.469220  8054 debug-util.cc:398] Leaking SignalData structure 0x7b0800200760 after lost signal to thread 8149
W20260709 13:02:40.470219  8054 debug-util.cc:398] Leaking SignalData structure 0x7b0800203840 after lost signal to thread 8224
I20260709 13:02:40.467231  8320 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.471189  8367 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:40.471161  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca120 after lost signal to thread 8298
I20260709 13:02:40.486198  8393 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.494702  8393 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.501642  8022 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.531126  8340 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.541373  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:40.542773  8163 leader_election.cc:343] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.558081  8393 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.558693  8393 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.561277  8393 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.561967  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:40.563380  8163 leader_election.cc:343] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.564162  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.564750  8273 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.565759  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.566893  8393 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.567158  8316 tablet_bootstrap.cc:492] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.567756  8316 ts_tablet_manager.cc:1403] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.119s	user 0.033s	sys 0.025s
I20260709 13:02:40.567230  8393 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.569880  8393 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.570029  8314 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.570526  8314 ts_tablet_manager.cc:1403] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.141s	user 0.023s	sys 0.039s
I20260709 13:02:40.571969  8336 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.574249  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.574818  8273 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.576327  8320 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.576962  8166 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.578603  8368 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.579874  8368 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.581758  8368 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.582152  8393 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.584843  8314 raft_consensus.cc:359] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.585223  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.585577  8367 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.585582  8314 raft_consensus.cc:385] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.586158  8314 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.585950  8367 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.586704  8367 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.588014  8314 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.585963  8273 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:40.589824  8316 raft_consensus.cc:359] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.590494  8316 raft_consensus.cc:385] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.590749  8316 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.591703  8316 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.593114  8316 ts_tablet_manager.cc:1434] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:02:40.585233  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.594158  8316 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.595515  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.596602  8368 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.598194  8393 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.594885  8367 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.602161  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.602603  8314 ts_tablet_manager.cc:1434] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.005s
W20260709 13:02:40.603645  8163 leader_election.cc:343] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.603845  8314 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.604360  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:40.604859  8273 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.609668  8314 tablet_bootstrap.cc:654] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.610288  8316 tablet_bootstrap.cc:654] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.611879  8315 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.612269  8315 ts_tablet_manager.cc:1403] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.160s	user 0.061s	sys 0.081s
I20260709 13:02:40.614624  8315 raft_consensus.cc:359] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.615206  8315 raft_consensus.cc:385] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.615458  8315 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.616040  8315 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.617923  8315 ts_tablet_manager.cc:1434] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:02:40.618717  8315 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.602399  8368 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.622787  8314 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.623210  8314 ts_tablet_manager.cc:1403] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:02:40.627416  8314 raft_consensus.cc:359] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.628425  8314 raft_consensus.cc:385] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.628683  8314 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.629374  8316 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.629279  8314 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.629786  8316 ts_tablet_manager.cc:1403] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.007s
I20260709 13:02:40.630637  8315 tablet_bootstrap.cc:654] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.637100  8316 raft_consensus.cc:359] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.637769  8316 raft_consensus.cc:385] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.638022  8316 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.641028  8316 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.642259  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:40.642830  8272 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.643013  8367 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.645473  8316 ts_tablet_manager.cc:1434] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:02:40.646309  8316 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.648356  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:02:40.650144  8163 leader_election.cc:343] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.652302  8314 ts_tablet_manager.cc:1434] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:02:40.653287  8314 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.658180  8340 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.642757  8273 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.665048  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.666276  8367 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.668855  8367 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:40.670063  8367 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.671428  8315 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.674932  8272 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.675303  8315 ts_tablet_manager.cc:1403] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.029s
I20260709 13:02:40.677843  8315 raft_consensus.cc:359] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.678452  8315 raft_consensus.cc:385] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.678690  8315 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.680213  8315 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.680567  8351 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.681329  8166 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:40.682070  8320 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.682690  8320 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:40.683809  8315 ts_tablet_manager.cc:1434] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:40.683444  8320 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.684712  8315 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.697610  8336 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.698093  8316 tablet_bootstrap.cc:654] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.697669  8314 tablet_bootstrap.cc:654] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.697813  8315 tablet_bootstrap.cc:654] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.714749  8340 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.731513  8340 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.732023  8340 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.732514  8021 catalog_manager.cc:5697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.734465  8340 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.735008  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:40.736205  8238 leader_election.cc:343] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.737614  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:40.738924  8237 leader_election.cc:343] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.739452  8315 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.739403  8237 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.740036  8315 ts_tablet_manager.cc:1403] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.008s
I20260709 13:02:40.741094  8351 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.754407  8315 raft_consensus.cc:359] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.755599  8315 raft_consensus.cc:385] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.755963  8315 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.756765  8315 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.760792  8315 ts_tablet_manager.cc:1434] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:40.764350  8022 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.767179  8315 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.771626  8316 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.772074  8316 ts_tablet_manager.cc:1403] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.006s
I20260709 13:02:40.775274  8314 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.775709  8314 ts_tablet_manager.cc:1403] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.123s	user 0.031s	sys 0.016s
I20260709 13:02:40.775828  8315 tablet_bootstrap.cc:654] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.776031  8123 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.779278  8316 raft_consensus.cc:359] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.779915  8316 raft_consensus.cc:385] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.780169  8316 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.780788  8316 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.781617  8367 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.782051  8367 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.783988  8367 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.785014  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.785591  8272 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.786890  8166 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.788874  8316 ts_tablet_manager.cc:1434] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:02:40.787725  8367 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.789672  8367 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.790060  8316 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.790174  8367 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.797004  8340 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.797510  8340 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.799916  8315 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.800052  8340 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.800458  8315 ts_tablet_manager.cc:1403] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.006s
I20260709 13:02:40.801530  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:40.801700  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.802136  8122 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:40.803408  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:40.803886  8238 leader_election.cc:343] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.803828  8315 raft_consensus.cc:359] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:40.804950  8237 leader_election.cc:343] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.805114  8315 raft_consensus.cc:385] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.805418  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.805565  8315 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.808319  8351 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.778095  8314 raft_consensus.cc:359] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.810716  8367 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.812783  8367 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.813668  8315 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.814272  8434 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.815176  8314 raft_consensus.cc:385] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.815084  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:40.815549  8314 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.815716  8272 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.816320  8314 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.819286  8314 ts_tablet_manager.cc:1434] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.000s
I20260709 13:02:40.820108  8314 tablet_bootstrap.cc:492] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:40.822106  8272 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.815090  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:40.823278  8166 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:40.824106  8367 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.824528  8367 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:40.816722  8315 ts_tablet_manager.cc:1434] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:02:40.823293  8122 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.825280  8367 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.826488  8315 tablet_bootstrap.cc:492] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.828897  8316 tablet_bootstrap.cc:654] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.829531  8340 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.837191  8122 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:40.837972  8314 tablet_bootstrap.cc:654] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.848013  8351 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.859376  8316 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:40.859835  8316 ts_tablet_manager.cc:1403] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.018s
I20260709 13:02:40.873458  8315 tablet_bootstrap.cc:654] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.881443  8320 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.881718  8316 raft_consensus.cc:359] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.882337  8316 raft_consensus.cc:385] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.882540  8316 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.882872  8368 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.883240  8316 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.884614  8368 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.889518  8368 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:40.891057  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:40.891862  8272 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:40.890923  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.895896  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.897747  8022 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.898617  8345 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.901779  8320 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.903879  8377 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.904233  8322 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.904695  8322 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.906551  8316 ts_tablet_manager.cc:1434] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.005s
I20260709 13:02:40.907505  8316 tablet_bootstrap.cc:492] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:40.910085  8314 tablet_bootstrap.cc:492] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:40.910532  8314 ts_tablet_manager.cc:1403] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.015s
I20260709 13:02:40.910355  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:40.923184  8237 leader_election.cc:343] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.926641  8315 tablet_bootstrap.cc:492] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:40.927026  8315 ts_tablet_manager.cc:1403] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.004s
I20260709 13:02:40.936435  8345 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.937966  8314 raft_consensus.cc:359] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.938535  8314 raft_consensus.cc:385] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.938732  8314 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.929981  8322 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:40.945901  8320 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.946980  8315 raft_consensus.cc:359] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.947477  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:40.948029  8315 raft_consensus.cc:385] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.950057  8315 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.950676  8315 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.951578  8336 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.953045  8315 ts_tablet_manager.cc:1434] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.003s
I20260709 13:02:40.953500  8367 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.954137  8315 tablet_bootstrap.cc:492] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:40.948074  8314 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:40.958052  8314 ts_tablet_manager.cc:1434] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:02:40.960207  8314 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
W20260709 13:02:40.964669  8238 leader_election.cc:343] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.965149  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:40.970435  8336 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.976316  8345 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.976851  8345 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.009675  8367 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.010260  8367 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.039085  8316 tablet_bootstrap.cc:654] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.013927  8124 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.034260  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.043517  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:41.044798  8089 leader_election.cc:343] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:41.052170  8163 leader_election.cc:343] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.052743  8345 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.054345  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.054935  8274 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:41.052362  8315 tablet_bootstrap.cc:654] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.058223  8314 tablet_bootstrap.cc:654] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.057566  8367 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.066305  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.078275  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:41.099077  8367 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.102674  8345 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.105029  8345 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.105309  8345 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.101734  8274 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:41.114120  8340 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.115931  8340 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.118587  8340 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:41.122076  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:41.128679  8238 leader_election.cc:343] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.129370  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.131404  8345 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.137300  8345 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:41.137774  8237 leader_election.cc:343] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.138120  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:41.133241  8479 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.141088  8479 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.138185  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:02:41.141714  8089 leader_election.cc:343] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.138985  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.142381  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.144898  8274 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.146306  8340 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.148937  8367 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.149302  8367 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.149655  8367 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.150838  8434 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.151790  8434 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.159523  8474 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.161770  8474 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.164119  8340 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:41.167135  8434 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:41.194880  8320 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.203374  8474 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.170197  8367 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.204882  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.205495  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.198935  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.209030  8367 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:41.210148  8238 leader_election.cc:343] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.195189  8274 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:41.215369  8314 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.215731  8314 ts_tablet_manager.cc:1403] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.256s	user 0.016s	sys 0.031s
I20260709 13:02:41.216132  8315 tablet_bootstrap.cc:492] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.216624  8315 ts_tablet_manager.cc:1403] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.263s	user 0.011s	sys 0.019s
I20260709 13:02:41.219116  8315 raft_consensus.cc:359] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:41.219463  8163 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.219762  8315 raft_consensus.cc:385] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.213541  8320 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.220039  8315 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.220808  8315 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.221421  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:41.221817  8320 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.222164  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.223141  8315 ts_tablet_manager.cc:1434] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:41.224057  8315 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.221375  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:02:41.229513  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:41.230206  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.230695  8089 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:41.226100  8314 raft_consensus.cc:359] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.232215  8314 raft_consensus.cc:385] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.232403  8345 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.232849  8314 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
W20260709 13:02:41.235962  8163 leader_election.cc:343] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:41.236749  8163 leader_election.cc:343] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.246240  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.241571  8345 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:41.247406  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.224872  8484 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:02:41.247714  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.248119  8273 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.247885  8345 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.249024  8272 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
W20260709 13:02:41.250284  8163 leader_election.cc:343] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.249265  8314 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.252362  8367 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.252758  8367 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.254992  8314 ts_tablet_manager.cc:1434] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:02:41.255398  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.260839  8314 tablet_bootstrap.cc:492] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.265182  8316 tablet_bootstrap.cc:492] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:41.265726  8316 ts_tablet_manager.cc:1403] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.358s	user 0.048s	sys 0.053s
W20260709 13:02:41.267328  8237 leader_election.cc:343] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:41.273689  8163 leader_election.cc:343] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.275470  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:41.280619  8474 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.281416  8320 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.282980  8273 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:41.286839  8367 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.290258  8316 raft_consensus.cc:359] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.290980  8316 raft_consensus.cc:385] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.291239  8316 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.291903  8316 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.292483  8368 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.286273  8434 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.292968  8368 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.296733  8368 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.296830  8479 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.298097  8316 ts_tablet_manager.cc:1434] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:02:41.299191  8316 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:41.297811  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.301003  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.311578  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:41.312775  8368 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.321925  8166 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.323498  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.325762  8367 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.326246  8367 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:41.326473  8315 tablet_bootstrap.cc:654] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.327237  8367 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.328748  8479 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.329093  8479 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.329435  8479 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.338802  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.340335  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.340870  8273 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:41.343356  8314 tablet_bootstrap.cc:654] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.344579  8020 catalog_manager.cc:5697] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.345515  8479 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.366412  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:02:41.367897  8163 leader_election.cc:343] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.373050  8316 tablet_bootstrap.cc:654] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.372560  8479 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:41.376737  8166 leader_election.cc:343] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.377821  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:41.378878  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.378871  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.379014  8367 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.380753  8367 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.381088  8367 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.381404  8367 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.379487  8274 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.387841  8479 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.390252  8274 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:41.392692  8166 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.395174  8315 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.395566  8479 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.395617  8315 ts_tablet_manager.cc:1403] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.008s
I20260709 13:02:41.396984  8479 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:41.397687  8479 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.394531  8020 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.481954  8314 tablet_bootstrap.cc:492] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.398607  8315 raft_consensus.cc:359] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.482520  8314 ts_tablet_manager.cc:1403] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.227s	user 0.020s	sys 0.014s
I20260709 13:02:41.482729  8315 raft_consensus.cc:385] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.483016  8315 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.483726  8315 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.485128  8315 ts_tablet_manager.cc:1434] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.089s	user 0.038s	sys 0.046s
I20260709 13:02:41.485991  8315 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.431402  8451 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:02:41.491701  8315 tablet_bootstrap.cc:654] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.493850  8314 raft_consensus.cc:359] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.494513  8314 raft_consensus.cc:385] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.494768  8314 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.502449  8314 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.504418  8314 ts_tablet_manager.cc:1434] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:02:41.505206  8314 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.506260  8315 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.506680  8315 ts_tablet_manager.cc:1403] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.009s
I20260709 13:02:41.509039  8315 raft_consensus.cc:359] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.511757  8315 raft_consensus.cc:385] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.512131  8315 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.434409  8367 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.512763  8315 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.514565  8314 tablet_bootstrap.cc:654] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.514653  8315 ts_tablet_manager.cc:1434] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:02:41.515513  8315 tablet_bootstrap.cc:492] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.519958  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:41.520892  8315 tablet_bootstrap.cc:654] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:41.521116  8163 leader_election.cc:343] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.522703  8314 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.523138  8314 ts_tablet_manager.cc:1403] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:02:41.525491  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.525449  8314 raft_consensus.cc:359] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.526122  8273 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.526191  8314 raft_consensus.cc:385] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.526540  8314 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.527175  8314 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.529069  8314 ts_tablet_manager.cc:1434] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:41.530539  8314 tablet_bootstrap.cc:492] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.533710  8316 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:41.534170  8316 ts_tablet_manager.cc:1403] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.235s	user 0.011s	sys 0.001s
I20260709 13:02:41.537333  8316 raft_consensus.cc:359] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.538028  8316 raft_consensus.cc:385] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.538324  8316 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.539374  8316 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.530385  8367 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.547667  8316 ts_tablet_manager.cc:1434] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:41.548595  8316 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:41.550904  8273 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:41.552956  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.553920  8479 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.554436  8479 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:41.555227  8479 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.556416  8022 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.570092  8316 tablet_bootstrap.cc:654] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.567673  8479 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.575213  8315 tablet_bootstrap.cc:492] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.575642  8315 ts_tablet_manager.cc:1403] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.060s	user 0.005s	sys 0.017s
I20260709 13:02:41.576925  8021 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.579304  8315 raft_consensus.cc:359] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.570785  8479 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.580013  8315 raft_consensus.cc:385] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.580300  8315 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.580991  8315 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.581524  8479 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.582485  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.582883  8273 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:41.584282  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:41.585067  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.585611  8479 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.585970  8479 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.586285  8479 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:41.587646  8163 leader_election.cc:343] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.590103  8314 tablet_bootstrap.cc:654] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.590157  8340 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.590909  8315 ts_tablet_manager.cc:1434] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:02:41.590651  8340 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.591840  8315 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.591581  8479 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.592957  8340 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:41.593943  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.594285  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:41.594708  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.594982  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.595193  8273 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.595549  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
W20260709 13:02:41.596066  8238 leader_election.cc:343] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.596652  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:41.597787  8340 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.598122  8340 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.598451  8340 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.600312  8273 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:41.600924  8479 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.601387  8315 tablet_bootstrap.cc:654] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:41.595516  8163 leader_election.cc:343] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.601953  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.602919  8479 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.603269  8479 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:41.603988  8479 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.604931  8340 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.608084  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:41.608642  8125 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.612804  8022 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.614459  8340 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:41.614825  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:41.617117  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:41.624011  8124 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.624843  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:02:41.625767  8238 leader_election.cc:343] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.626192  8314 tablet_bootstrap.cc:492] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.626577  8434 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.627019  8314 ts_tablet_manager.cc:1403] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.004s
I20260709 13:02:41.627040  8434 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:41.629467  8434 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.629689  8314 raft_consensus.cc:359] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.630278  8314 raft_consensus.cc:385] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.619807  8316 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:41.630848  8314 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.631157  8316 ts_tablet_manager.cc:1403] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.006s
I20260709 13:02:41.631533  8314 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.632678  8315 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.633143  8315 ts_tablet_manager.cc:1403] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.005s
I20260709 13:02:41.636626  8316 raft_consensus.cc:359] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.637522  8314 ts_tablet_manager.cc:1434] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:41.638818  8316 raft_consensus.cc:385] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.639406  8314 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.639828  8316 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.639115  8315 raft_consensus.cc:359] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.640657  8315 raft_consensus.cc:385] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.641816  8315 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.642495  8315 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.644486  8315 ts_tablet_manager.cc:1434] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:02:41.641115  8316 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.645336  8315 tablet_bootstrap.cc:492] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.645571  8314 tablet_bootstrap.cc:654] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.648926  8479 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.649391  8479 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.651378  8479 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.653422  8315 tablet_bootstrap.cc:654] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.653817  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.655166  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.655984  8273 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 1: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:02:41.646757  8316 ts_tablet_manager.cc:1434] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:41.659406  8020 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.662057  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:41.662845  8316 tablet_bootstrap.cc:492] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:41.663847  8367 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.672046  8316 tablet_bootstrap.cc:654] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.673525  8367 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.675267  8314 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.678391  8314 ts_tablet_manager.cc:1403] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:02:41.680330  8314 raft_consensus.cc:359] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.680779  8314 raft_consensus.cc:385] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.680969  8314 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.681522  8314 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.682848  8315 tablet_bootstrap.cc:492] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.683300  8315 ts_tablet_manager.cc:1403] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.016s
I20260709 13:02:41.685812  8315 raft_consensus.cc:359] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.686473  8315 raft_consensus.cc:385] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.686764  8315 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.687578  8315 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.689327  8434 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.689772  8434 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.691601  8434 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:41.691835  8314 ts_tablet_manager.cc:1434] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:02:41.693189  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.693421  8315 ts_tablet_manager.cc:1434] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:41.693768  8200 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:41.693956  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:41.694272  8315 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.694536  8124 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:41.695199  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:41.696163  8340 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.696512  8340 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.696833  8340 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.700742  8315 tablet_bootstrap.cc:654] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.701375  8314 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.708899  8340 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.712850  8368 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.704594  8316 tablet_bootstrap.cc:492] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:41.714447  8316 ts_tablet_manager.cc:1403] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.005s
I20260709 13:02:41.714933  8314 tablet_bootstrap.cc:654] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.717504  8316 raft_consensus.cc:359] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.718271  8316 raft_consensus.cc:385] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.718598  8316 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.719312  8316 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.721376  8316 ts_tablet_manager.cc:1434] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:41.722959  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:41.723047  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:41.723553  8198 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.723730  8124 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.728119  8368 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.728624  8368 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.730497  8198 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:41.730762  8368 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.730988  8340 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:41.732214  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:41.733229  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.733840  8197 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:41.735757  8314 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.737239  8314 ts_tablet_manager.cc:1403] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 13:02:41.739704  8434 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.740162  8124 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:41.740290  8434 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:41.739686  8314 raft_consensus.cc:359] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.741092  8434 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.741562  8314 raft_consensus.cc:385] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.741952  8314 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.742549  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:41.743237  8314 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.743809  8345 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.744161  8345 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.744468  8345 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.753428  8314 ts_tablet_manager.cc:1434] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:41.753504  8474 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.754866  8474 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.757388  8345 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.757877  8474 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.761870  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:41.778152  8314 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.798573  8316 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:41.799750  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.808514  8315 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.808543  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:41.809932  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:41.810539  8198 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.811127  8314 tablet_bootstrap.cc:654] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.808733  8345 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.813973  8315 ts_tablet_manager.cc:1403] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.020s
I20260709 13:02:41.827134  8198 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:41.828387  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:41.828456  8315 raft_consensus.cc:359] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.829150  8315 raft_consensus.cc:385] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.829231  8345 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.829434  8315 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.829772  8345 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:41.830186  8315 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.830577  8345 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.831764  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.832412  8315 ts_tablet_manager.cc:1434] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
I20260709 13:02:41.832496  8270 raft_consensus.cc:2393] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:41.833307  8315 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.843237  8124 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.846480  8316 tablet_bootstrap.cc:654] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.847169  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.853072  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:41.853730  8474 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.853983  8368 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.857972  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.858553  8269 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.857265  8451 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:41.860786  8314 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.867870  8314 ts_tablet_manager.cc:1403] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.109s	user 0.002s	sys 0.021s
I20260709 13:02:41.875113  8020 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.877074  8314 raft_consensus.cc:359] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.877720  8314 raft_consensus.cc:385] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.877995  8314 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.875140  8479 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.879869  8315 tablet_bootstrap.cc:654] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.879772  8479 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.881486  8314 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.884367  8479 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.870846  8269 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:41.889678  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:41.893142  8163 leader_election.cc:343] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.901748  8316 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:41.902626  8316 ts_tablet_manager.cc:1403] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.004s
I20260709 13:02:41.904975  8316 raft_consensus.cc:359] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.908268  8489 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.909833  8314 ts_tablet_manager.cc:1434] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:02:41.912943  8314 tablet_bootstrap.cc:492] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:41.918247  8314 tablet_bootstrap.cc:654] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.905709  8316 raft_consensus.cc:385] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.902485  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:41.911659  8315 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:41.918980  8316 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.919406  8315 ts_tablet_manager.cc:1403] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.001s
I20260709 13:02:41.920933  8316 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.922278  8315 raft_consensus.cc:359] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.922876  8315 raft_consensus.cc:385] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.922935  8316 ts_tablet_manager.cc:1434] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:02:41.923203  8315 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.923862  8316 tablet_bootstrap.cc:492] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:41.924131  8272 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:41.926263  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.927335  8393 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.927662  8393 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.928094  8393 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.929510  8316 tablet_bootstrap.cc:654] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.935420  8122 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.923822  8315 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.937719  8315 ts_tablet_manager.cc:1434] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:41.938979  8315 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:41.934983  8393 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.942778  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:41.942973  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:41.943625  8272 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:41.944051  8163 leader_election.cc:343] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.945886  8489 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.955032  8315 tablet_bootstrap.cc:654] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.955410  8393 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:41.956595  8272 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:41.958164  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:41.958575  8124 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.959228  8393 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.959906  8393 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:41.960762  8393 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.972386  8314 tablet_bootstrap.cc:492] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:41.972538  8316 tablet_bootstrap.cc:492] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:41.972998  8316 ts_tablet_manager.cc:1403] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.006s
I20260709 13:02:41.979027  8451 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.972944  8314 ts_tablet_manager.cc:1403] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.000s
I20260709 13:02:41.986095  8021 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.995476  8314 raft_consensus.cc:359] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.996171  8314 raft_consensus.cc:385] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.996537  8314 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.997323  8314 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:41.999290  8314 ts_tablet_manager.cc:1434] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.004s
I20260709 13:02:42.007839  8314 tablet_bootstrap.cc:492] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.022055  8393 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.022560  8316 raft_consensus.cc:359] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.023363  8316 raft_consensus.cc:385] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.023661  8316 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.024350  8316 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.026373  8316 ts_tablet_manager.cc:1434] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:02:42.026626  8315 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.027398  8316 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.028855  8315 ts_tablet_manager.cc:1403] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.013s
I20260709 13:02:42.030537  8314 tablet_bootstrap.cc:654] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.039672  8315 raft_consensus.cc:359] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.040374  8315 raft_consensus.cc:385] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.040624  8315 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.042025  8315 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.043864  8316 tablet_bootstrap.cc:654] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.043962  8315 ts_tablet_manager.cc:1434] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:02:42.044834  8315 tablet_bootstrap.cc:492] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.056305  8316 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.056842  8315 tablet_bootstrap.cc:654] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.057130  8316 ts_tablet_manager.cc:1403] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:02:42.061141  8316 raft_consensus.cc:359] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.061272  8367 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.054833  8314 tablet_bootstrap.cc:492] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.066118  8314 ts_tablet_manager.cc:1403] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.006s
I20260709 13:02:42.068347  8314 raft_consensus.cc:359] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.068783  8314 raft_consensus.cc:385] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.069001  8314 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.065630  8316 raft_consensus.cc:385] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.069200  8368 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.069519  8316 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.069662  8368 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.070180  8316 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.071583  8316 ts_tablet_manager.cc:1434] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 13:02:42.072607  8451 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.073035  8451 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.073644  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.074339  8269 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:42.071595  8368 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.080648  8316 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.083910  8198 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.084582  8314 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.086560  8314 ts_tablet_manager.cc:1434] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 13:02:42.087383  8314 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.080485  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.089941  8124 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:42.091691  8340 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.092123  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.093901  8316 tablet_bootstrap.cc:654] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.093677  8089 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:42.094993  8368 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.097815  8314 tablet_bootstrap.cc:654] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.117735  8451 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.120724  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.125133  8166 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:42.131487  8451 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.135456  8368 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.136987  8316 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.137859  8316 ts_tablet_manager.cc:1403] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.001s
I20260709 13:02:42.138561  8314 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.138963  8314 ts_tablet_manager.cc:1403] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.008s
I20260709 13:02:42.141137  8315 tablet_bootstrap.cc:492] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.140756  8316 raft_consensus.cc:359] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.141566  8315 ts_tablet_manager.cc:1403] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.000s
I20260709 13:02:42.141414  8314 raft_consensus.cc:359] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.141752  8316 raft_consensus.cc:385] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.142079  8314 raft_consensus.cc:385] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.142201  8316 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.142400  8314 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.143019  8314 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.143913  8315 raft_consensus.cc:359] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.144455  8315 raft_consensus.cc:385] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.144656  8315 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.143023  8316 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.145097  8314 ts_tablet_manager.cc:1434] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:42.145205  8315 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.146070  8314 tablet_bootstrap.cc:492] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.151744  8314 tablet_bootstrap.cc:654] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.154711  8316 ts_tablet_manager.cc:1434] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:02:42.155483  8316 tablet_bootstrap.cc:492] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.159650  8434 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.160369  8315 ts_tablet_manager.cc:1434] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:02:42.160709  8316 tablet_bootstrap.cc:654] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.161195  8315 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.166949  8315 tablet_bootstrap.cc:654] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.170923  8451 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.174948  8451 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.177481  8451 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.178428  8314 tablet_bootstrap.cc:492] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.178534  8434 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.179323  8314 ts_tablet_manager.cc:1403] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.006s
I20260709 13:02:42.179041  8434 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.180995  8434 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.182636  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.183277  8198 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:42.183804  8316 tablet_bootstrap.cc:492] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.184257  8316 ts_tablet_manager.cc:1403] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.006s
I20260709 13:02:42.184587  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.185511  8434 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.185897  8434 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.186311  8434 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.186532  8316 raft_consensus.cc:359] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.190201  8316 raft_consensus.cc:385] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.186766  8451 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.190940  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.187263  8314 raft_consensus.cc:359] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.191681  8122 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:42.191977  8314 raft_consensus.cc:385] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.192327  8314 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.190582  8316 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.194155  8316 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.192909  8314 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.197389  8314 ts_tablet_manager.cc:1434] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:02:42.198441  8314 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.202282  8316 ts_tablet_manager.cc:1434] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:42.203795  8315 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.204136  8315 ts_tablet_manager.cc:1403] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.002s
I20260709 13:02:42.213207  8316 tablet_bootstrap.cc:492] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.214740  8368 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.218290  8314 tablet_bootstrap.cc:654] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.219699  8451 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.219861  8434 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.220366  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.219574  8315 raft_consensus.cc:359] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.223047  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.227730  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:42.227823  8434 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.228295  8272 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:42.228791  8315 raft_consensus.cc:385] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.230225  8315 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.230872  8315 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.231643  8123 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:42.232092  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.234701  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:42.235272  8122 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.240371  8315 ts_tablet_manager.cc:1434] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.002s
I20260709 13:02:42.241338  8315 tablet_bootstrap.cc:492] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.228310  8197 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.260953  8475 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.248448  8316 tablet_bootstrap.cc:654] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.264709  8336 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.245533  8451 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.265749  8451 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.266080  8451 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.273907  8451 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.275815  8451 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.276486  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:42.276907  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:42.277097  8124 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.277663  8272 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.287168  8124 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:42.288393  8163 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.289182  8451 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.289855  8451 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:42.290740  8451 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.292907  8197 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:42.297606  8489 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.296438  8272 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:42.298061  8489 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.313925  8489 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.315505  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.317366  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:02:42.317749  8163 leader_election.cc:343] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.318954  8340 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:42.319123  8166 leader_election.cc:343] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.320179  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:42.323413  8314 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.324126  8314 ts_tablet_manager.cc:1403] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.126s	user 0.021s	sys 0.022s
I20260709 13:02:42.324651  8315 tablet_bootstrap.cc:654] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.324612  8489 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.324065  8122 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:42.333741  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.336180  8340 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.336611  8340 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:42.337306  8340 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:42.341704  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:42.349309  8314 raft_consensus.cc:359] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.350400  8314 raft_consensus.cc:385] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.350648  8314 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.351586  8316 tablet_bootstrap.cc:492] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.351998  8316 ts_tablet_manager.cc:1403] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.139s	user 0.020s	sys 0.018s
I20260709 13:02:42.354422  8549 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.353359  8314 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.357302  8314 ts_tablet_manager.cc:1434] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:02:42.358143  8314 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.364921  8434 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.365401  8434 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.372701  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.360854  8549 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.377645  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:42.385957  8238 leader_election.cc:343] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.390070  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.390148  8020 catalog_manager.cc:5697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.395704  8549 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.379407  8316 raft_consensus.cc:359] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.381987  8393 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.382423  8434 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.396270  8316 raft_consensus.cc:385] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.397009  8393 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.400053  8197 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:42.399403  8316 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.401670  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.402267  8393 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.403236  8314 tablet_bootstrap.cc:654] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.405260  8345 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.405716  8345 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.407755  8345 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:42.408406  8163 leader_election.cc:343] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:42.411890  8237 leader_election.cc:343] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.404462  8316 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.416365  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.421073  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:42.426147  8336 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.426584  8336 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.427062  8336 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.434322  8021 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.445775  8315 tablet_bootstrap.cc:492] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.446241  8315 ts_tablet_manager.cc:1403] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.205s	user 0.031s	sys 0.019s
I20260709 13:02:42.451668  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.451969  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.452768  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.449790  8434 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.454056  8434 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.454444  8434 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.453470  8270 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:42.457476  8434 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.456298  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.458326  8315 raft_consensus.cc:359] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.459167  8315 raft_consensus.cc:385] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.459367  8316 ts_tablet_manager.cc:1434] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.002s
I20260709 13:02:42.459445  8315 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.460100  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.460139  8315 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.460803  8197 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:42.461822  8238 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.462635  8122 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:42.463472  8315 ts_tablet_manager.cc:1434] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:02:42.464341  8315 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.464463  8434 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.465090  8434 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.465426  8434 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.466228  8336 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.460264  8316 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.469792  8272 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:42.470364  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.477553  8166 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:42.472034  8553 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.478519  8367 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.478766  8553 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.479367  8393 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.480731  8553 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:02:42.481415  8237 leader_election.cc:343] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.481912  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.482491  8199 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:42.483489  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.483614  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.486083  8549 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:42.486793  8237 leader_election.cc:343] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.487607  8367 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.488279  8549 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.488642  8549 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.470368  8091 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:42.490339  8345 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.501947  8336 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.519698  8316 tablet_bootstrap.cc:654] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.520788  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:42.521040  8315 tablet_bootstrap.cc:654] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.524272  8314 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.524770  8314 ts_tablet_manager.cc:1403] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.011s
I20260709 13:02:42.524384  8549 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.526947  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:42.531535  8122 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.531425  8314 raft_consensus.cc:359] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.534251  8314 raft_consensus.cc:385] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.534564  8314 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.538376  8314 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.540532  8314 ts_tablet_manager.cc:1434] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:02:42.541960  8314 tablet_bootstrap.cc:492] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.548581  8345 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.532891  8434 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.561378  8451 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.562256  8549 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.568050  8199 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:42.570261  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:42.570574  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:42.564636  8434 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:02:42.584466  8237 leader_election.cc:343] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:42.585093  8237 leader_election.cc:343] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.593237  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:42.593822  8199 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.595510  8315 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.596073  8315 ts_tablet_manager.cc:1403] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.132s	user 0.004s	sys 0.012s
I20260709 13:02:42.596635  8451 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.597272  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:42.598711  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:42.599244  8197 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.599665  8314 tablet_bootstrap.cc:654] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.597078  8451 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.601876  8122 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:42.603438  8560 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.603986  8451 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.604631  8315 raft_consensus.cc:359] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.605165  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:02:42.608566  8166 leader_election.cc:343] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.608744  8560 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:42.608979  8315 raft_consensus.cc:385] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.609339  8315 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.609956  8315 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.613442  8560 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.609505  8199 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:42.617714  8315 ts_tablet_manager.cc:1434] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:02:42.618858  8315 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.623353  8316 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.623786  8316 ts_tablet_manager.cc:1403] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.017s
I20260709 13:02:42.627099  8316 raft_consensus.cc:359] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.627715  8315 tablet_bootstrap.cc:654] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.627717  8316 raft_consensus.cc:385] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.628214  8316 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.628788  8316 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.630312  8316 ts_tablet_manager.cc:1434] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:02:42.630980  8314 tablet_bootstrap.cc:492] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.630985  8316 tablet_bootstrap.cc:492] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.631541  8314 ts_tablet_manager.cc:1403] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.007s
I20260709 13:02:42.634459  8314 raft_consensus.cc:359] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.635067  8314 raft_consensus.cc:385] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.635318  8314 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.635618  8315 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.635927  8316 tablet_bootstrap.cc:654] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.636015  8315 ts_tablet_manager.cc:1403] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:02:42.635928  8314 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.675225  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.677245  8315 raft_consensus.cc:359] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.678841  8315 raft_consensus.cc:385] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:42.678782  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 60732.6us
I20260709 13:02:42.679349  8315 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.680285  8315 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.701618  8315 ts_tablet_manager.cc:1434] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:02:42.702255  8336 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.709988  8336 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:42.710776  8163 leader_election.cc:343] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.711537  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:42.713109  8336 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:42.714361  8451 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.723201  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.724747  8314 ts_tablet_manager.cc:1434] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
W20260709 13:02:42.727092  8237 leader_election.cc:343] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.725652  8489 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.742575  8197 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:42.742515  8489 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.743731  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:42.761392  8314 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
W20260709 13:02:42.770413  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 89089.9us
I20260709 13:02:42.772745  8316 tablet_bootstrap.cc:492] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.773366  8316 ts_tablet_manager.cc:1403] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.142s	user 0.025s	sys 0.010s
I20260709 13:02:42.775440  8022 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.777237  8336 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.782188  8315 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.778874  8316 raft_consensus.cc:359] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.787107  8336 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:42.788357  8336 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.793074  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.785952  8316 raft_consensus.cc:385] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.795774  8316 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.796398  8316 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.799479  8316 ts_tablet_manager.cc:1434] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:02:42.804270  8316 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.813045  8320 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.813664  8320 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.816928  8320 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.820127  8238 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:42.821882  8558 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.822436  8558 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:42.823376  8558 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.827226  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.831593  8315 tablet_bootstrap.cc:654] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.831693  8314 tablet_bootstrap.cc:654] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:42.841596  8163 leader_election.cc:343] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.843904  8316 tablet_bootstrap.cc:654] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:42.844712  8238 leader_election.cc:343] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.850289  8238 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:42.851176  8558 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.854075  8558 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.857532  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.858235  8272 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:42.864398  8549 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.869740  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:42.874089  8451 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.874450  8451 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.874751  8451 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.879979  8474 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.880491  8474 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.896387  8474 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.900995  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.904608  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:42.905416  8196 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:42.906709  8451 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.915347  8089 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:42.917608  8474 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.919119  8451 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.914826  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:42.922271  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:42.922714  8272 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:42.930418  8163 leader_election.cc:343] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.930758  8474 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.933419  8314 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:42.933854  8314 ts_tablet_manager.cc:1403] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.018s
I20260709 13:02:42.937435  8316 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:42.937459  8315 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:42.938082  8316 ts_tablet_manager.cc:1403] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.034s
I20260709 13:02:42.938082  8315 ts_tablet_manager.cc:1403] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.011s
I20260709 13:02:42.935079  8022 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.934968  8272 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:42.942188  8314 raft_consensus.cc:359] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.942813  8314 raft_consensus.cc:385] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.943059  8314 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.943670  8314 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.944824  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:42.945483  8314 ts_tablet_manager.cc:1434] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:42.946485  8314 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:42.951254  8315 raft_consensus.cc:359] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.951885  8315 raft_consensus.cc:385] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.952116  8315 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.952744  8315 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.954964  8315 ts_tablet_manager.cc:1434] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:02:42.955940  8315 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:42.957736  8489 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.958223  8489 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:42.959107  8489 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.961570  8315 tablet_bootstrap.cc:654] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.962532  8474 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.962982  8474 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.965021  8474 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:42.966032  8316 raft_consensus.cc:359] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.968428  8314 tablet_bootstrap.cc:654] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.968346  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:42.968696  8316 raft_consensus.cc:385] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.969111  8316 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.967139  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:42.971573  8089 leader_election.cc:343] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:42.972474  8091 leader_election.cc:343] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.972879  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:42.974380  8474 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.975018  8316 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.982189  8316 ts_tablet_manager.cc:1434] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.002s
I20260709 13:02:42.983263  8316 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:42.984515  8021 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.988816  8451 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.989711  8316 tablet_bootstrap.cc:654] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.989365  8451 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:42.998953  8558 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.999032  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:42.999596  8558 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.001724  8558 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:02:43.002028  8163 leader_election.cc:343] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.003314  8451 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.004666  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:43.010396  8238 leader_election.cc:343] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.006263  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:43.011932  8237 leader_election.cc:343] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.012382  8314 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.012267  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.006395  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.012796  8314 ts_tablet_manager.cc:1403] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.007s
I20260709 13:02:43.013589  8558 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:43.013681  8166 leader_election.cc:343] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.014362  8166 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:43.012313  8023 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.017067  8320 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.015813  8314 raft_consensus.cc:359] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.017829  8314 raft_consensus.cc:385] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.018102  8314 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.020185  8314 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.023607  8315 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.024053  8315 ts_tablet_manager.cc:1403] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.007s
I20260709 13:02:43.026364  8315 raft_consensus.cc:359] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.026832  8315 raft_consensus.cc:385] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.027040  8315 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.027617  8315 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.028297  8316 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:43.028723  8316 ts_tablet_manager.cc:1403] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.008s
I20260709 13:02:43.029531  8314 ts_tablet_manager.cc:1434] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:02:43.030501  8314 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.032459  8316 raft_consensus.cc:359] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.033303  8316 raft_consensus.cc:385] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.033603  8316 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.034350  8316 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.035853  8314 tablet_bootstrap.cc:654] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.041826  8315 ts_tablet_manager.cc:1434] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:43.042851  8315 tablet_bootstrap.cc:492] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.047596  8315 tablet_bootstrap.cc:654] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.051712  8315 tablet_bootstrap.cc:492] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.052240  8315 ts_tablet_manager.cc:1403] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:43.054773  8316 ts_tablet_manager.cc:1434] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:02:43.054610  8315 raft_consensus.cc:359] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.055249  8315 raft_consensus.cc:385] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.055536  8315 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.055948  8316 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:43.056208  8315 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.058298  8315 ts_tablet_manager.cc:1434] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:02:43.059062  8314 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.060640  8314 ts_tablet_manager.cc:1403] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:02:43.059298  8315 tablet_bootstrap.cc:492] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.063283  8314 raft_consensus.cc:359] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.064041  8314 raft_consensus.cc:385] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.064340  8314 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.065006  8314 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.067098  8314 ts_tablet_manager.cc:1434] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:02:43.070844  8314 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.073074  8315 tablet_bootstrap.cc:654] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.075055  8316 tablet_bootstrap.cc:654] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.082970  8314 tablet_bootstrap.cc:654] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.084369  8315 tablet_bootstrap.cc:492] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.084790  8315 ts_tablet_manager.cc:1403] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 13:02:43.091229  8475 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.091629  8475 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.091632  8315 raft_consensus.cc:359] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.092664  8315 raft_consensus.cc:385] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.093153  8315 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.094543  8314 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.094565  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.094515  8315 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.095222  8200 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:43.095319  8314 ts_tablet_manager.cc:1403] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.009s
I20260709 13:02:43.096082  8474 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.096647  8315 ts_tablet_manager.cc:1434] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:02:43.096486  8474 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.098213  8314 raft_consensus.cc:359] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.098453  8315 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.098853  8314 raft_consensus.cc:385] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.099189  8314 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.099809  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.100488  8272 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:43.100348  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.101735  8345 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.102082  8345 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.102397  8345 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.104786  8315 tablet_bootstrap.cc:654] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.106480  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.108023  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.098433  8474 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.109234  8474 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.111625  8345 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.114049  8475 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.114884  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:43.115448  8270 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.117702  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.120127  8345 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.120621  8314 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.122100  8315 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.122579  8315 ts_tablet_manager.cc:1403] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.012s
I20260709 13:02:43.125383  8345 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.128629  8314 ts_tablet_manager.cc:1434] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:02:43.137921  8474 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.139560  8316 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:43.139998  8316 ts_tablet_manager.cc:1403] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.002s
I20260709 13:02:43.126837  8345 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.135425  8270 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:43.142388  8314 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.144236  8345 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.144819  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:43.145488  8199 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.145743  8315 raft_consensus.cc:359] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.146373  8315 raft_consensus.cc:385] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.146610  8315 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.153549  8315 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.153957  8320 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.154454  8320 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.155447  8315 ts_tablet_manager.cc:1434] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:02:43.153133  8199 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:43.154008  8091 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:43.160884  8345 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.161332  8345 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:43.161809  8320 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.162628  8315 tablet_bootstrap.cc:492] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.162117  8345 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.164531  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.164626  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.165261  8122 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:43.165438  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.164121  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.167037  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.165381  8200 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:43.167987  8393 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.195719  8393 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.197363  8393 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.195868  8558 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:43.202225  8314 tablet_bootstrap.cc:654] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.199242  8316 raft_consensus.cc:359] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.204408  8316 raft_consensus.cc:385] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.204681  8316 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
W20260709 13:02:43.169744  8166 leader_election.cc:343] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.170012  8336 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:02:43.206825  8558 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.205862  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.210318  8316 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.211400  8345 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.214502  8316 ts_tablet_manager.cc:1434] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.074s	user 0.012s	sys 0.014s
I20260709 13:02:43.215514  8316 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:43.212803  8315 tablet_bootstrap.cc:654] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.222836  8393 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.226222  8023 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.229902  8314 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.230219  8314 ts_tablet_manager.cc:1403] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.001s
I20260709 13:02:43.233975  8549 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.234437  8549 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.235634  8345 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.236296  8549 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:43.240140  8314 raft_consensus.cc:359] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.240855  8314 raft_consensus.cc:385] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.240768  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.241261  8314 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.241420  8199 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:43.241458  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.242112  8125 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:43.242610  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.243325  8558 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.243650  8558 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.244123  8558 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.242139  8314 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.248422  8314 ts_tablet_manager.cc:1434] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:02:43.248335  8549 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.250030  8314 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.253634  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:43.254170  8122 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.260069  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:43.264637  8320 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.266567  8451 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.266444  8320 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.267032  8451 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.258445  8393 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:43.269325  8166 leader_election.cc:343] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.251894  8558 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.276710  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.296808  8558 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:43.297927  8320 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.299022  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:43.299515  8199 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.300181  8549 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.302186  8549 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:43.302999  8163 leader_election.cc:343] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.304075  8549 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:43.304391  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:43.277081  8451 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.306681  8123 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.309949  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.310415  8315 tablet_bootstrap.cc:492] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.309638  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.310812  8315 ts_tablet_manager.cc:1403] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.148s	user 0.007s	sys 0.010s
I20260709 13:02:43.311770  8199 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:43.300410  8122 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:43.308187  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.307802  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.317082  8316 tablet_bootstrap.cc:654] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.319877  8272 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
W20260709 13:02:43.316457  8166 leader_election.cc:343] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.322405  8166 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:43.322957  8393 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.321277  8315 raft_consensus.cc:359] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.324801  8315 raft_consensus.cc:385] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.325074  8315 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.326557  8315 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.315660  8196 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:43.332341  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.333700  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.334198  8434 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.334633  8340 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.335723  8340 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.336007  8340 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.336273  8340 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.338701  8315 ts_tablet_manager.cc:1434] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:02:43.341043  8314 tablet_bootstrap.cc:654] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.330390  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.325373  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.365821  8451 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.366240  8451 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.350461  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:02:43.367074  8237 leader_election.cc:343] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.367183  8320 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.367777  8320 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:02:43.368451  8163 leader_election.cc:343] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.366552  8451 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.368826  8320 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.364992  8340 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.372233  8315 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.388671  8340 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:43.371824  8434 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:02:43.404505  8593 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:43.388372  8549 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:02:43.418512  8315 tablet_bootstrap.cc:654] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.428851  8451 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.433446  8451 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.427984  8123 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:43.404487  8434 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.441563  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:43.444139  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:02:43.447031  8237 leader_election.cc:343] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.452340  8163 leader_election.cc:343] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.466233  8316 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:43.466691  8316 ts_tablet_manager.cc:1403] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.251s	user 0.012s	sys 0.018s
I20260709 13:02:43.478636  8316 raft_consensus.cc:359] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.479297  8316 raft_consensus.cc:385] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.479568  8316 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.480202  8316 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.484776  8316 ts_tablet_manager.cc:1434] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:43.485734  8316 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:43.507091  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:43.507860  8196 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:43.508070  8316 tablet_bootstrap.cc:654] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.549575  8345 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.550107  8345 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.607404  8599 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.611526  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:43.612864  8270 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:43.617702  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.619006  8345 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:43.619109  8089 leader_election.cc:343] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.625092  8022 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.623493  8549 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.630506  8315 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.631114  8315 ts_tablet_manager.cc:1403] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.277s	user 0.032s	sys 0.045s
I20260709 13:02:43.633375  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.634040  8271 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:43.629571  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:43.635924  8314 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.636325  8314 ts_tablet_manager.cc:1403] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.387s	user 0.010s	sys 0.052s
I20260709 13:02:43.636442  8315 raft_consensus.cc:359] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.636747  8451 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.637069  8315 raft_consensus.cc:385] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.637336  8315 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.628744  8549 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.638302  8315 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.639664  8549 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:43.640136  8315 ts_tablet_manager.cc:1434] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:43.641626  8315 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.620829  8599 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.647661  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.648633  8314 raft_consensus.cc:359] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.649632  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.650843  8345 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.651206  8345 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.651528  8345 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.649269  8314 raft_consensus.cc:385] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.652906  8314 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.653529  8314 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.640645  8020 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.654260  8393 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.654985  8314 ts_tablet_manager.cc:1434] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:02:43.656028  8314 tablet_bootstrap.cc:492] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.658854  8316 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:43.659286  8316 ts_tablet_manager.cc:1403] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.000s
I20260709 13:02:43.666216  8316 raft_consensus.cc:359] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.666776  8316 raft_consensus.cc:385] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.667222  8316 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
W20260709 13:02:43.674845  8237 leader_election.cc:343] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.674542  8316 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.678308  8393 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.679177  8316 ts_tablet_manager.cc:1434] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:02:43.680039  8316 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:43.680454  8599 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.683601  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:02:43.683949  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:43.683823  8345 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.684255  8272 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:43.685400  8166 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.686209  8393 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.686667  8393 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.686780  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:43.687522  8345 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.687194  8393 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:43.689787  8089 leader_election.cc:343] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.699747  8315 tablet_bootstrap.cc:654] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.705440  8314 tablet_bootstrap.cc:654] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.734577  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:43.735145  8272 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.729496  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:43.737206  8123 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:43.738886  8345 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.744333  8586 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.741237  8272 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:43.747604  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.748451  8345 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.758122  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.763227  8315 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.763674  8315 ts_tablet_manager.cc:1403] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.011s
I20260709 13:02:43.769498  8549 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.770545  8315 raft_consensus.cc:359] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.771188  8315 raft_consensus.cc:385] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.771440  8315 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.772043  8315 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.774358  8315 ts_tablet_manager.cc:1434] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:02:43.775286  8315 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.780102  8316 tablet_bootstrap.cc:654] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.785663  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.786300  8196 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:43.797960  8345 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:43.816360  8393 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.818758  8393 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.819038  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:43.819628  8119 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.823307  8238 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:43.824298  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:43.825466  8594 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.825848  8594 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.826206  8594 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.825620  8345 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.831032  8269 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.848464  8314 tablet_bootstrap.cc:492] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.848984  8314 ts_tablet_manager.cc:1403] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.193s	user 0.006s	sys 0.029s
I20260709 13:02:43.852980  8119 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:43.854988  8586 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.857455  8586 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.859823  8586 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:43.860002  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:43.860764  8197 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:43.861330  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:43.862042  8270 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:43.865010  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:43.866503  8393 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.863363  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:43.866932  8393 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:43.867720  8393 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.867738  8316 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:43.869592  8316 ts_tablet_manager.cc:1403] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.190s	user 0.007s	sys 0.009s
I20260709 13:02:43.869540  8314 raft_consensus.cc:359] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.870474  8314 raft_consensus.cc:385] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.870690  8314 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.870893  8586 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.871294  8314 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.873371  8020 catalog_manager.cc:5697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.874629  8314 ts_tablet_manager.cc:1434] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:02:43.875334  8314 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.875649  8316 raft_consensus.cc:359] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.876299  8316 raft_consensus.cc:385] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.876549  8316 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
W20260709 13:02:43.877447  8166 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.877158  8316 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.897176  8316 ts_tablet_manager.cc:1434] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.011s
I20260709 13:02:43.898306  8316 tablet_bootstrap.cc:492] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:43.903473  8269 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:43.905200  8320 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.907202  8315 tablet_bootstrap.cc:654] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.918004  8316 tablet_bootstrap.cc:654] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.907478  8586 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.914285  8594 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.931751  8594 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:43.932776  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:43.934211  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:43.933338  8197 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:43.935814  8237 leader_election.cc:343] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.936393  8314 tablet_bootstrap.cc:654] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.943584  8023 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.945565  8197 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:43.968811  8238 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:43.970227  8549 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.970667  8549 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:43.971338  8549 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.979350  8315 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:43.979903  8315 ts_tablet_manager.cc:1403] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.205s	user 0.014s	sys 0.015s
I20260709 13:02:43.984151  8314 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:43.984516  8314 ts_tablet_manager.cc:1403] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.007s
I20260709 13:02:43.985540  8315 raft_consensus.cc:359] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.987481  8315 raft_consensus.cc:385] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.987795  8315 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.988482  8315 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.991114  8315 ts_tablet_manager.cc:1434] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:43.992108  8315 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:43.994495  8314 raft_consensus.cc:359] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.995111  8314 raft_consensus.cc:385] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.995360  8314 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.995936  8314 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:43.997990  8314 ts_tablet_manager.cc:1434] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:02:43.998312  8315 tablet_bootstrap.cc:654] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.998924  8314 tablet_bootstrap.cc:492] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:43.996543  8020 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.004770  8314 tablet_bootstrap.cc:654] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.010596  8314 tablet_bootstrap.cc:492] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.011092  8314 ts_tablet_manager.cc:1403] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:02:44.013857  8314 raft_consensus.cc:359] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.014492  8314 raft_consensus.cc:385] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.014727  8314 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.015272  8314 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.017531  8314 ts_tablet_manager.cc:1434] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:44.018494  8314 tablet_bootstrap.cc:492] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.023922  8314 tablet_bootstrap.cc:654] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.028541  8549 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:44.036736  8594 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.037130  8316 tablet_bootstrap.cc:492] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.037631  8316 ts_tablet_manager.cc:1403] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.011s
I20260709 13:02:44.037288  8594 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.039505  8594 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:44.040283  8316 raft_consensus.cc:359] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.040982  8316 raft_consensus.cc:385] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.042407  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.040927  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.043999  8238 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:44.044968  8594 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.043977  8316 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.046931  8316 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.052317  8315 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.052686  8315 ts_tablet_manager.cc:1403] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.020s
I20260709 13:02:44.054986  8315 raft_consensus.cc:359] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.055557  8315 raft_consensus.cc:385] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.056304  8315 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.056979  8315 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.059692  8434 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.061581  8316 ts_tablet_manager.cc:1434] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:02:44.062525  8316 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:44.063853  8315 ts_tablet_manager.cc:1434] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:44.064833  8315 tablet_bootstrap.cc:492] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.069753  8316 tablet_bootstrap.cc:654] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.070328  8315 tablet_bootstrap.cc:654] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.077490  8314 tablet_bootstrap.cc:492] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.078018  8314 ts_tablet_manager.cc:1403] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.014s
I20260709 13:02:44.081367  8314 raft_consensus.cc:359] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.082072  8314 raft_consensus.cc:385] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.082325  8314 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.083091  8314 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.088397  8314 ts_tablet_manager.cc:1434] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:02:44.093565  8314 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.102084  8315 tablet_bootstrap.cc:492] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.102627  8315 ts_tablet_manager.cc:1403] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.001s
I20260709 13:02:44.105218  8315 raft_consensus.cc:359] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.105914  8315 raft_consensus.cc:385] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.106177  8315 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.106374  8434 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.106807  8315 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.106848  8434 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.111631  8315 ts_tablet_manager.cc:1434] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:02:44.112751  8314 tablet_bootstrap.cc:654] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.111931  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.113788  8124 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:44.114310  8434 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:44.115198  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:44.115445  8367 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.115907  8316 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.116320  8316 ts_tablet_manager.cc:1403] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.024s
I20260709 13:02:44.115818  8367 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.116889  8315 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.116796  8549 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.117236  8549 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.117579  8549 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.117923  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.118244  8367 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.118610  8197 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:44.120309  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.120636  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.120895  8124 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:44.122970  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:44.123680  8345 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.124104  8345 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.125172  8316 raft_consensus.cc:359] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.125872  8316 raft_consensus.cc:385] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.126169  8316 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.126837  8316 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.127282  8320 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.121227  8269 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:44.127604  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.127635  8320 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.129808  8320 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.125809  8345 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:44.128957  8091 leader_election.cc:343] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.133759  8316 ts_tablet_manager.cc:1434] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:02:44.157307  8367 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.157809  8367 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.141786  8549 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.160480  8549 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:44.162652  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.163287  8197 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:44.163767  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:44.164295  8198 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.164980  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.165752  8586 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.166069  8586 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.166379  8586 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.194406  8316 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:44.194641  8320 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.212406  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:44.213071  8122 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.203917  8367 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.219797  8122 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:44.223754  8320 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.223489  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:44.238483  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.236230  8434 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.243220  8434 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:44.244043  8434 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.247350  8314 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.247825  8314 ts_tablet_manager.cc:1403] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.154s	user 0.045s	sys 0.009s
I20260709 13:02:44.254938  8315 tablet_bootstrap.cc:654] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.257043  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:44.258183  8120 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.258239  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:44.273845  8163 leader_election.cc:343] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.274709  8586 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.279069  8198 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:44.279953  8586 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:44.282073  8166 leader_election.cc:343] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.282508  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.283160  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:44.283841  8320 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:44.284479  8091 leader_election.cc:343] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.287285  8316 tablet_bootstrap.cc:654] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.288866  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:44.289404  8197 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.290131  8314 raft_consensus.cc:359] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.290733  8314 raft_consensus.cc:385] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.290977  8314 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.293292  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:44.293923  8270 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.295395  8022 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.296799  8393 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.297252  8393 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.299058  8393 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.300112  8314 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.301083  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.302155  8314 ts_tablet_manager.cc:1434] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
W20260709 13:02:44.302348  8163 leader_election.cc:343] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.303105  8314 tablet_bootstrap.cc:492] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.315536  8271 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.318064  8197 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:44.317071  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.321693  8269 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:44.310564  8120 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:44.323311  8586 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.329185  8166 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:44.330245  8393 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.330595  8393 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.334079  8315 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.331661  8393 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.334460  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.335848  8586 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.334517  8315 ts_tablet_manager.cc:1403] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.221s	user 0.011s	sys 0.029s
I20260709 13:02:44.343217  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:44.345675  8316 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.345880  8320 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.346287  8316 ts_tablet_manager.cc:1403] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.011s
I20260709 13:02:44.337204  8586 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:44.346312  8320 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:44.345618  8315 raft_consensus.cc:359] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.347586  8320 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.350474  8315 raft_consensus.cc:385] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.351183  8315 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.354488  8586 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.350121  8393 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.355765  8315 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.358425  8315 ts_tablet_manager.cc:1434] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:02:44.359534  8315 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.362483  8270 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:44.360093  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:44.363155  8120 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.350515  8316 raft_consensus.cc:359] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.365823  8316 raft_consensus.cc:385] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.366393  8316 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.370754  8316 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.363189  8393 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.372613  8367 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.377626  8367 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.365799  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:44.382800  8316 ts_tablet_manager.cc:1434] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.002s
I20260709 13:02:44.384588  8316 tablet_bootstrap.cc:492] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:44.386770  8314 tablet_bootstrap.cc:654] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.388164  8023 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.388772  8020 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.390270  8367 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.391013  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.394349  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.395196  8198 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.396413  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.403496  8367 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.392134  8270 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.405042  8586 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.414062  8270 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:44.415102  8166 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:44.415773  8320 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.416181  8320 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:44.416880  8320 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.417121  8120 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:44.424816  8367 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.426555  8315 tablet_bootstrap.cc:654] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.457715  8320 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.465853  8316 tablet_bootstrap.cc:654] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.467834  8612 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.468313  8612 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.470302  8612 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.471626  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.473084  8434 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.473480  8200 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 1: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:02:44.478291  8367 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.479161  8367 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.485500  8367 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.494210  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.494380  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:02:44.496047  8166 leader_election.cc:343] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.484670  8023 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.482283  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.504411  8315 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.504875  8315 ts_tablet_manager.cc:1403] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.016s
W20260709 13:02:44.502187  8163 leader_election.cc:343] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.507737  8163 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.509260  8393 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.510033  8124 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.511642  8315 raft_consensus.cc:359] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.512259  8315 raft_consensus.cc:385] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.512504  8315 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.516840  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:44.518671  8336 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.520689  8586 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.519539  8315 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.544956  8315 ts_tablet_manager.cc:1434] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:02:44.548646  8314 tablet_bootstrap.cc:492] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.549392  8314 ts_tablet_manager.cc:1403] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.246s	user 0.014s	sys 0.008s
I20260709 13:02:44.554059  8315 tablet_bootstrap.cc:492] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.570700  8314 raft_consensus.cc:359] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.571362  8314 raft_consensus.cc:385] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.571663  8314 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.571363  8316 tablet_bootstrap.cc:492] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.573259  8316 ts_tablet_manager.cc:1403] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.003s
I20260709 13:02:44.593930  8314 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.602422  8315 tablet_bootstrap.cc:654] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.615291  8314 ts_tablet_manager.cc:1434] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.066s	user 0.019s	sys 0.008s
I20260709 13:02:44.620332  8316 raft_consensus.cc:359] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.624131  8316 raft_consensus.cc:385] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.624485  8316 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.622937  8314 tablet_bootstrap.cc:492] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.625165  8316 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.634658  8314 tablet_bootstrap.cc:654] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.636705  8434 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.637215  8315 tablet_bootstrap.cc:492] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.637152  8434 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.637706  8315 ts_tablet_manager.cc:1403] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.000s
I20260709 13:02:44.640383  8315 raft_consensus.cc:359] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.641007  8315 raft_consensus.cc:385] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.641280  8315 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.643361  8434 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:44.644196  8316 ts_tablet_manager.cc:1434] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.001s
I20260709 13:02:44.645110  8316 tablet_bootstrap.cc:492] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:44.645494  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.648331  8315 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.650198  8315 ts_tablet_manager.cc:1434] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:02:44.645052  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.651117  8315 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.651413  8200 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 1: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:02:44.652873  8238 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:44.654486  8434 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.664985  8434 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.676203  8316 tablet_bootstrap.cc:654] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.682768  8316 tablet_bootstrap.cc:492] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.683168  8316 ts_tablet_manager.cc:1403] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.007s
I20260709 13:02:44.684163  8315 tablet_bootstrap.cc:654] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.685498  8316 raft_consensus.cc:359] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.686146  8316 raft_consensus.cc:385] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.686393  8316 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.687659  8316 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.689514  8316 ts_tablet_manager.cc:1434] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:44.690328  8314 tablet_bootstrap.cc:492] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.690739  8314 ts_tablet_manager.cc:1403] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.028s
I20260709 13:02:44.693282  8314 raft_consensus.cc:359] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.693864  8314 raft_consensus.cc:385] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.694118  8314 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.696926  8316 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:44.700126  8586 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.694674  8314 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.700556  8586 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.705236  8314 ts_tablet_manager.cc:1434] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:44.705448  8586 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.707494  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.708165  8316 tablet_bootstrap.cc:654] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.708073  8200 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:44.709055  8315 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.709489  8315 ts_tablet_manager.cc:1403] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.009s
I20260709 13:02:44.709283  8089 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:44.709637  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.710078  8314 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.710292  8586 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.710644  8586 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.710942  8586 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.712033  8315 raft_consensus.cc:359] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.712632  8315 raft_consensus.cc:385] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.712879  8315 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.713474  8315 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.715593  8315 ts_tablet_manager.cc:1434] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:44.716439  8315 tablet_bootstrap.cc:492] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.717222  8314 tablet_bootstrap.cc:654] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:44.718142  8091 leader_election.cc:343] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.721637  8315 tablet_bootstrap.cc:654] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.726434  8316 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.726828  8316 ts_tablet_manager.cc:1403] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:02:44.729763  8316 raft_consensus.cc:359] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.730366  8316 raft_consensus.cc:385] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.730569  8315 tablet_bootstrap.cc:492] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.731097  8315 ts_tablet_manager.cc:1403] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:02:44.732735  8314 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.733130  8314 ts_tablet_manager.cc:1403] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:02:44.734329  8315 raft_consensus.cc:359] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.735097  8315 raft_consensus.cc:385] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.735349  8315 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.735946  8315 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.730619  8316 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.736599  8320 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.736984  8320 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.737016  8316 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.737880  8315 ts_tablet_manager.cc:1434] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:44.738756  8315 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.739044  8316 ts_tablet_manager.cc:1434] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:02:44.740072  8316 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:44.741303  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.741878  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:02:44.742563  8163 leader_election.cc:343] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:44.743458  8166 leader_election.cc:343] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.743852  8166 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.744459  8315 tablet_bootstrap.cc:654] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.736400  8314 raft_consensus.cc:359] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.745302  8314 raft_consensus.cc:385] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.745589  8314 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.746148  8314 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.748195  8451 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.738816  8320 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.757059  8315 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.757520  8315 ts_tablet_manager.cc:1403] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:02:44.758031  8314 ts_tablet_manager.cc:1434] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:02:44.759339  8314 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.759851  8315 raft_consensus.cc:359] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.760483  8315 raft_consensus.cc:385] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.760732  8315 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.761495  8315 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.763931  8345 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.764307  8345 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.764849  8314 tablet_bootstrap.cc:654] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.765723  8315 ts_tablet_manager.cc:1434] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:44.766036  8345 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.766824  8315 tablet_bootstrap.cc:492] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.767386  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.767984  8272 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:44.768362  8316 tablet_bootstrap.cc:654] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.768957  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:44.769927  8345 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.770301  8345 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.770632  8345 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.770862  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:44.771423  8200 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:44.772912  8315 tablet_bootstrap.cc:654] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.784034  8315 tablet_bootstrap.cc:492] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:44.786495  8314 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.784430  8315 ts_tablet_manager.cc:1403] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
I20260709 13:02:44.789872  8315 raft_consensus.cc:359] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.790469  8315 raft_consensus.cc:385] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.790714  8315 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.791273  8315 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.793051  8434 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.793618  8314 ts_tablet_manager.cc:1403] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:02:44.795111  8315 ts_tablet_manager.cc:1434] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:44.798801  8314 raft_consensus.cc:359] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.799434  8314 raft_consensus.cc:385] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.799685  8314 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.800276  8314 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.804090  8612 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.803197  8586 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.800949  8345 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.808712  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:44.809206  8196 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.815847  8196 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:44.817054  8315 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:44.818264  8089 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:44.819542  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:44.820108  8271 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.816620  8314 ts_tablet_manager.cc:1434] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:02:44.816995  8451 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.822604  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:44.822275  8451 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.824277  8612 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.824611  8451 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.825536  8314 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.825716  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:44.830153  8163 leader_election.cc:343] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.831023  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.835497  8315 tablet_bootstrap.cc:654] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:44.837929  8166 leader_election.cc:343] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.838364  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.838992  8451 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.843125  8314 tablet_bootstrap.cc:654] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.853178  8612 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:44.855350  8434 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.856700  8314 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:44.856312  8612 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.857554  8314 ts_tablet_manager.cc:1403] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.005s
I20260709 13:02:44.828557  8271 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:44.863190  8314 raft_consensus.cc:359] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.864889  8314 raft_consensus.cc:385] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.865491  8314 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.866848  8314 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.868616  8451 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.869032  8451 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.870476  8599 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.872401  8451 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.874341  8314 ts_tablet_manager.cc:1434] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:02:44.875355  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:44.875969  8120 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:44.876863  8314 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:44.877068  8163 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:44.878011  8451 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.878393  8451 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.878753  8451 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.887336  8451 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.889206  8451 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.889758  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:44.890313  8120 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.898928  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:44.901480  8314 tablet_bootstrap.cc:654] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.903841  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:02:44.904891  8166 leader_election.cc:343] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.909442  8451 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:44.912194  8166 leader_election.cc:343] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.912765  8451 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.916574  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:44.917222  8269 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.917982  8586 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.923697  8269 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:44.924708  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:44.953919  8120 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:44.954450  8451 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.954890  8345 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:44.950659  8671 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:44.956650  8163 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:44.957623  8451 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.958237  8451 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:44.959081  8451 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:44.957731  8345 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.961864  8345 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:44.967072  8316 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:44.970667  8316 ts_tablet_manager.cc:1403] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.046s
I20260709 13:02:44.972826  8345 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.008937  8023 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.017141  8022 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.993513  8316 raft_consensus.cc:359] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.025931  8316 raft_consensus.cc:385] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.026242  8316 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.026847  8316 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.030480  8316 ts_tablet_manager.cc:1434] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 13:02:45.033854  8316 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
W20260709 13:02:45.041414  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 178397us
I20260709 13:02:45.043006  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.043605  8200 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.051095  8200 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.057680  8345 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.057868  8664 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.058406  8664 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.060319  8664 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.060601  8345 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.061551  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.062529  8345 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:02:45.063004  8091 leader_election.cc:343] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.064129  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.064713  8272 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:45.065834  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:45.067078  8345 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.067420  8345 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.067726  8345 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.071327  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.071930  8200 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:45.072288  8315 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:45.072691  8315 ts_tablet_manager.cc:1403] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.257s	user 0.052s	sys 0.058s
I20260709 13:02:45.073567  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.074162  8198 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:45.075297  8315 raft_consensus.cc:359] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.075759  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.076000  8315 raft_consensus.cc:385] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.076304  8315 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.076874  8315 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.078663  8666 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.079095  8666 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.079423  8666 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.081575  8315 ts_tablet_manager.cc:1434] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:45.082496  8315 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:45.086093  8316 tablet_bootstrap.cc:654] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.087113  8314 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:45.087766  8314 ts_tablet_manager.cc:1403] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.211s	user 0.021s	sys 0.039s
I20260709 13:02:45.094933  8314 raft_consensus.cc:359] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.095692  8314 raft_consensus.cc:385] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.097556  8345 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.099306  8345 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.100337  8315 tablet_bootstrap.cc:654] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.100904  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.102319  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:45.111912  8271 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.112474  8315 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:45.112915  8315 ts_tablet_manager.cc:1403] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.006s
I20260709 13:02:45.115664  8315 raft_consensus.cc:359] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.116271  8315 raft_consensus.cc:385] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.116504  8315 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.118124  8271 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.095960  8314 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.117108  8315 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.119669  8314 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.119863  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:02:45.120940  8345 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.121340  8345 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:45.121613  8314 ts_tablet_manager.cc:1434] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.001s
I20260709 13:02:45.122012  8345 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.122612  8314 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:45.123277  8315 ts_tablet_manager.cc:1434] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:45.124161  8315 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:45.124977  8666 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.137573  8666 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.138080  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.139106  8558 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.139277  8315 tablet_bootstrap.cc:654] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.138675  8196 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.139613  8558 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.142328  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:45.145174  8558 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:45.145802  8316 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:45.146261  8316 ts_tablet_manager.cc:1403] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.014s
I20260709 13:02:45.147013  8314 tablet_bootstrap.cc:654] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:45.148757  8091 leader_election.cc:343] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.150180  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.152346  8196 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.152665  8316 raft_consensus.cc:359] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.153368  8316 raft_consensus.cc:385] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.153625  8316 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.153648  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.154330  8316 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.155460  8666 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.155925  8666 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:45.156324  8316 ts_tablet_manager.cc:1434] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 13:02:45.156651  8666 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.159026  8316 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:45.160527  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.161254  8120 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 1: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:02:45.164220  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:45.166591  8549 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.147982  8200 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.176338  8022 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.180091  8345 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.180590  8345 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.195140  8315 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:45.195590  8315 ts_tablet_manager.cc:1403] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.022s
I20260709 13:02:45.197006  8345 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.197763  8314 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:45.198067  8314 ts_tablet_manager.cc:1403] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.004s
I20260709 13:02:45.195947  8549 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.199164  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.199417  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:02:45.200696  8091 leader_election.cc:343] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.202236  8315 raft_consensus.cc:359] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.202883  8315 raft_consensus.cc:385] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.203120  8315 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.208554  8315 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.211450  8315 ts_tablet_manager.cc:1434] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:02:45.212177  8316 tablet_bootstrap.cc:654] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.212440  8315 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:45.212483  8314 raft_consensus.cc:359] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.215476  8314 raft_consensus.cc:385] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.215656  8314 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.216174  8393 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.216616  8393 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.216972  8021 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.218887  8021 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.219695  8314 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.220511  8196 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:45.222383  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.225459  8345 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.225833  8345 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.226118  8345 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:45.227442  8226 tablet.cc:2406] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:45.233023  8345 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.236092  8666 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.237751  8666 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.238777  8393 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.239125  8314 ts_tablet_manager.cc:1434] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 13:02:45.239658  8666 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.240029  8314 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:45.241890  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.242564  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.241886  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.243112  8271 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:45.243237  8118 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:45.244215  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:45.245067  8675 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:45.245458  8675 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.245780  8675 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.246317  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:02:45.244982  8091 leader_election.cc:343] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:45.247792  8091 leader_election.cc:343] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.248786  8314 tablet_bootstrap.cc:654] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.252249  8675 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.253088  8345 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.254623  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.255331  8316 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:45.255759  8316 ts_tablet_manager.cc:1403] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.015s
I20260709 13:02:45.255227  8196 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:45.257068  8314 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:45.257475  8314 ts_tablet_manager.cc:1403] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:02:45.259500  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.259706  8314 raft_consensus.cc:359] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.255807  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.260349  8314 raft_consensus.cc:385] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.260636  8314 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.261390  8197 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.261296  8314 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.262832  8314 ts_tablet_manager.cc:1434] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:45.263726  8314 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:45.258272  8316 raft_consensus.cc:359] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.264366  8316 raft_consensus.cc:385] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.264688  8316 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.265463  8316 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.267644  8316 ts_tablet_manager.cc:1434] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:02:45.268628  8316 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:45.269140  8315 tablet_bootstrap.cc:654] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.269245  8314 tablet_bootstrap.cc:654] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.270493  8666 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.270881  8666 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.271193  8666 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.271904  8197 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.277660  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:45.287428  8118 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.278795  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:45.293598  8271 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.294450  8314 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:45.294936  8314 ts_tablet_manager.cc:1403] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.002s
I20260709 13:02:45.295233  8451 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.295665  8451 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.280174  8666 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.277722  8675 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.297653  8314 raft_consensus.cc:359] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.298436  8314 raft_consensus.cc:385] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.298730  8314 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.298787  8666 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.299532  8314 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.300544  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:45.301692  8314 ts_tablet_manager.cc:1434] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:45.302117  8666 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.302671  8314 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:45.299522  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.305508  8271 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
W20260709 13:02:45.306026  8166 leader_election.cc:343] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:45.306383  8091 leader_election.cc:343] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.306648  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:45.297667  8451 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.307794  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.308319  8198 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.308426  8118 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:02:45.309978  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.310148  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.310551  8314 tablet_bootstrap.cc:654] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.310493  8125 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:45.311307  8666 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.312453  8666 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:45.313241  8666 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.316623  8549 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.317054  8549 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.318981  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.319535  8549 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:45.319886  8451 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:45.320329  8451 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:45.285102  8316 tablet_bootstrap.cc:654] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.321841  8393 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.322177  8393 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.322471  8393 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.326386  8198 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.329418  8393 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.331912  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:45.332093  8315 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:45.332389  8125 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.332568  8315 ts_tablet_manager.cc:1403] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.009s
I20260709 13:02:45.333295  8664 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.333475  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.333560  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.334376  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.335157  8196 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 1: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:02:45.337226  8200 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.334538  8664 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.338840  8393 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.340912  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:02:45.344076  8166 leader_election.cc:343] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.345989  8125 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:45.348114  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:45.350704  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.350919  8664 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:45.353485  8393 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.353996  8393 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:45.354943  8393 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.357235  8549 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.321079  8451 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.351814  8664 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.378933  8315 raft_consensus.cc:359] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.379769  8315 raft_consensus.cc:385] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.380065  8315 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.383625  8314 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:45.384136  8314 ts_tablet_manager.cc:1403] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.024s
I20260709 13:02:45.386493  8314 raft_consensus.cc:359] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.387162  8314 raft_consensus.cc:385] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.387450  8314 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.388137  8314 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.390440  8314 ts_tablet_manager.cc:1434] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:45.391469  8314 tablet_bootstrap.cc:492] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Bootstrap starting.
I20260709 13:02:45.403949  8549 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.404971  8668 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.406152  8315 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.405467  8668 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.408636  8668 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.412513  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.413797  8022 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:45.415100  8091 leader_election.cc:343] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.418798  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.419344  8200 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:45.420457  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.421120  8612 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.421491  8612 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.421820  8612 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.426425  8314 tablet_bootstrap.cc:654] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.423319  8021 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 2, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.429208  8675 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.429751  8675 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.432904  8316 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:45.433246  8316 ts_tablet_manager.cc:1403] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.015s
I20260709 13:02:45.433490  8315 ts_tablet_manager.cc:1434] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.101s	user 0.002s	sys 0.005s
I20260709 13:02:45.435846  8675 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.437403  8316 raft_consensus.cc:359] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.438020  8316 raft_consensus.cc:385] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.440891  8612 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.444080  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.446800  8367 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.447086  8316 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.447781  8316 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.448963  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.449663  8125 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:45.450582  8451 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.451025  8451 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.453639  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:02:45.459896  8166 leader_election.cc:343] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.462067  8022 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.463699  8316 ts_tablet_manager.cc:1434] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:02:45.464733  8315 tablet_bootstrap.cc:492] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:45.450706  8612 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.457749  8599 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.467718  8599 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.471415  8451 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.466336  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:45.468477  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.471875  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.470929  8599 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.474426  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.476191  8314 tablet_bootstrap.cc:492] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: No bootstrap required, opened a new log
I20260709 13:02:45.476683  8314 ts_tablet_manager.cc:1403] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.000s
W20260709 13:02:45.482036  8163 leader_election.cc:343] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.476214  8200 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.481545  8271 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 0.
I20260709 13:02:45.487319  8599 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.489372  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:02:45.490263  8393 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.490556  8393 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.490823  8393 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.495595  8316 tablet_bootstrap.cc:492] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:45.497164  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:45.511924  8120 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:45.497781  8091 leader_election.cc:343] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.517556  8120 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:45.498513  8599 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.499881  8393 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.503770  8315 tablet_bootstrap.cc:654] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.519573  8393 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.520859  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:45.521421  8270 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.522683  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:45.524133  8320 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.524507  8320 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:45.525120  8320 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.504498  8314 raft_consensus.cc:359] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.505873  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:02:45.528563  8166 leader_election.cc:343] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.529068  8314 raft_consensus.cc:385] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.529327  8314 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.503101  8200 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:45.510330  8451 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.533106  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.534132  8612 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.534404  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:45.534560  8612 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:45.536247  8612 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.514366  8023 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.539664  8314 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.541252  8314 ts_tablet_manager.cc:1434] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.001s
I20260709 13:02:45.543849  8270 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:02:45.547288  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:45.552423  8675 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.552876  8675 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:02:45.553656  8675 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.558969  8594 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.560040  8594 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.562952  8594 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:45.564357  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:45.564548  8664 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.564945  8200 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 0.
I20260709 13:02:45.566732  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:45.567513  8558 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.568194  8558 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.568540  8558 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.575556  8668 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.585681  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.590230  8662 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:45.599483  8237 leader_election.cc:343] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.611742  8668 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.615842  8316 tablet_bootstrap.cc:654] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:45.670463  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 147042us
I20260709 13:02:45.696933  8451 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.707494  8451 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:45.713852  8163 leader_election.cc:343] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.754558  8451 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:45.755712  8021 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.681756  8558 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.778271  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:45.801229  8315 tablet_bootstrap.cc:492] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:45.801783  8315 ts_tablet_manager.cc:1403] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.341s	user 0.037s	sys 0.061s
W20260709 13:02:45.798650  8163 leader_election.cc:343] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.815690  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:45.822949  8558 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:45.828775  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:45.829485  8196 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.837064  8196 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:02:45.839884  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:02:45.840984  8558 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.841434  8558 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:02:45.842202  8558 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:45.851293  8091 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.857542  8022 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.859328  8022 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 0 to 1, leader changed from <none> to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:45.861809  8091 consensus_peers.cc:597] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.865811  8315 raft_consensus.cc:359] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.875917  8316 tablet_bootstrap.cc:492] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:45.878417  8315 raft_consensus.cc:385] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.878685  8316 ts_tablet_manager.cc:1403] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.383s	user 0.022s	sys 0.046s
I20260709 13:02:45.878749  8315 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.888412  8315 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:02:45.891364  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 95483.1us
I20260709 13:02:45.894109  8717 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:45.896605  8120 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:45.898082  8320 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.899256  8315 ts_tablet_manager.cc:1434] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.097s	user 0.004s	sys 0.002s
I20260709 13:02:45.900187  8315 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
I20260709 13:02:45.905205  8662 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:45.907018  8166 leader_election.cc:343] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.907784  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:45.909020  8320 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.914501  8345 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.916981  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:02:45.918668  8316 raft_consensus.cc:359] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.919322  8316 raft_consensus.cc:385] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.919557  8316 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.919533  8345 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.920935  8316 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:45.942646  8023 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.971063  8274 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:45.988689  8316 ts_tablet_manager.cc:1434] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.109s	user 0.020s	sys 0.004s
W20260709 13:02:46.082659  8237 leader_election.cc:343] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.096731  8434 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.097200  8434 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.099606  8316 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:46.114421  8315 tablet_bootstrap.cc:654] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.117798  8163 consensus_peers.cc:597] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.120282  8675 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.130829  8345 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:46.144317  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 54781.8us
W20260709 13:02:46.146761  8091 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.133155  8705 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:02:46.176522  8166 consensus_peers.cc:597] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.228936  8724 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:46.233570  8675 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:46.247180  8434 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:02:46.281518  8166 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.319849  8315 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:46.320331  8315 ts_tablet_manager.cc:1403] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.420s	user 0.017s	sys 0.008s
I20260709 13:02:46.340900  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:02:46.342306  8701 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.110s	user 0.006s	sys 0.003s
W20260709 13:02:46.347589  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58333.6us
I20260709 13:02:46.354475  8316 tablet_bootstrap.cc:654] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.366611  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 89413.1us
I20260709 13:02:46.371495  8315 raft_consensus.cc:359] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.378844  8315 raft_consensus.cc:385] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.379175  8315 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.366783  8612 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.382752  8315 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.383195  8267 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.384979  8315 ts_tablet_manager.cc:1434] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:02:46.382630  8612 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.401494  8612 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:46.408334  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:46.408913  8199 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 0.
I20260709 13:02:46.411039  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:02:46.419411  8739 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 13:02:46.424767  8735 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.425163  8735 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.425707  8735 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.434955  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:46.436602  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:46.441016  8315 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Bootstrap starting.
W20260709 13:02:46.446578  8091 leader_election.cc:343] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.451220  8735 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.455446  8735 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:46.462237  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:02:46.465384  8675 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:46.468556  8091 leader_election.cc:343] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.472812  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:02:46.473408  8198 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.477907  8198 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:02:46.478854  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:02:46.482586  8734 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.484496  8315 tablet_bootstrap.cc:654] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.484853  8734 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:02:46.488695  8316 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:46.489084  8316 ts_tablet_manager.cc:1403] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.390s	user 0.024s	sys 0.051s
W20260709 13:02:46.492275  8071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:46.487383  8734 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.501395  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:46.508700  8336 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:46.511684  8237 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.513892  8316 raft_consensus.cc:359] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.514547  8316 raft_consensus.cc:385] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.514724  8594 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.514781  8316 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.515859  8316 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.522403  8316 ts_tablet_manager.cc:1434] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:02:46.523912  8316 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:46.529691  8315 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: No bootstrap required, opened a new log
I20260709 13:02:46.530143  8315 ts_tablet_manager.cc:1403] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.019s
I20260709 13:02:46.532560  8316 tablet_bootstrap.cc:654] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.532884  8315 raft_consensus.cc:359] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.534348  8315 raft_consensus.cc:385] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.534613  8315 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.535214  8315 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.537169  8315 ts_tablet_manager.cc:1434] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:46.546334  8274 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.561268  8022 catalog_manager.cc:5697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.614900  8316 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:46.615437  8316 ts_tablet_manager.cc:1403] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.004s
I20260709 13:02:46.636720  8316 raft_consensus.cc:359] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.637411  8316 raft_consensus.cc:385] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.637678  8316 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.638293  8316 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.640178  8316 ts_tablet_manager.cc:1434] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:02:46.641099  8316 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:46.653604  8316 tablet_bootstrap.cc:654] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.666226  8316 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:46.666661  8316 ts_tablet_manager.cc:1403] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.007s
I20260709 13:02:46.669027  8316 raft_consensus.cc:359] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.669696  8316 raft_consensus.cc:385] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.669950  8316 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.670572  8316 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.672593  8316 ts_tablet_manager.cc:1434] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:46.674052  8316 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:46.681051  8118 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.689795  8316 tablet_bootstrap.cc:654] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.695936  8316 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:46.697206  8316 ts_tablet_manager.cc:1403] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:02:46.698251  8735 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.698715  8735 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.699537  8316 raft_consensus.cc:359] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.700138  8316 raft_consensus.cc:385] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.700373  8316 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.700611  8735 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:46.701164  8316 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.703009  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:02:46.703547  8316 ts_tablet_manager.cc:1434] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:46.704860  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:46.707521  8316 tablet_bootstrap.cc:492] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Bootstrap starting.
I20260709 13:02:46.707603  8089 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:46.708838  8594 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.709391  8594 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.711347  8594 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:46.712644  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:46.713274  8316 tablet_bootstrap.cc:654] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.716449  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:46.717648  8734 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.719606  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:46.721195  8737 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.732177  8316 tablet_bootstrap.cc:492] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: No bootstrap required, opened a new log
I20260709 13:02:46.732589  8316 ts_tablet_manager.cc:1403] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:02:46.734299  8316 raft_consensus.cc:359] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.734826  8316 raft_consensus.cc:385] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.735020  8316 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.735524  8316 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.736941  8316 ts_tablet_manager.cc:1434] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:02:46.748842  8118 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.799361  8594 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.799834  8594 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:02:46.802177  8594 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:46.802307  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:02:46.803048  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:02:46.804257  8238 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:02:46.804865  8594 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.804956  8267 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.898916  8274 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.902472  8267 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.035315  8267 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.042793  8734 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.065040  8734 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.754331  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:47.760986  8765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:47.765244  8766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:47.767684  8768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:47.767850  7005 server_base.cc:1061] running on GCE node
I20260709 13:02:47.769868  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:47.770145  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:47.770365  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602167770347 us; error 0 us; skew 500 ppm
I20260709 13:02:47.771117  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:47.777454  7005 webserver.cc:533] Webserver started at http://127.6.215.68:35229/ using document root <none> and password file <none>
I20260709 13:02:47.777951  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:47.778148  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:47.778455  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:47.779778  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-3-root/instance:
uuid: "17c126976afd40d9a398d13a5ddd222f"
format_stamp: "Formatted at 2026-07-09 13:02:47 on dist-test-slave-r31z"
I20260709 13:02:47.791419  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.007s	sys 0.006s
I20260709 13:02:47.799041  8773 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.800431  7005 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:47.801103  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-3-root
uuid: "17c126976afd40d9a398d13a5ddd222f"
format_stamp: "Formatted at 2026-07-09 13:02:47 on dist-test-slave-r31z"
I20260709 13:02:47.801580  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:47.856695  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:47.858464  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:47.860296  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:47.863533  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:47.863855  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:47.864188  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:47.864459  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:47.997793  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.68:34433
I20260709 13:02:47.997900  8835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.68:34433 every 8 connection(s)
I20260709 13:02:48.006686  7005 auto_leader_rebalancer-test.cc:384] add a tserver: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:48.019434  8836 heartbeater.cc:344] Connected to a master server at 127.6.215.126:41935
I20260709 13:02:48.019830  8836 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:48.020491  8836 heartbeater.cc:507] Master 127.6.215.126:41935 requested a full tablet report, sending...
I20260709 13:02:48.022112  8021 ts_manager.cc:194] Registered new tserver with Master: 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:02:48.023547  8021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47912
I20260709 13:02:48.615340  8116 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:48.621276  8270 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.622716  8762 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.624806  8197 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.626302  8743 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.642210  8762 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.644647  8270 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.645982  8193 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.669297  8020 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:02:48.678464  8088 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0ae8ee6216f434eb7857a29d9b682d9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.758483  8193 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:48.770872  8270 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.775615  8714 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.776746  8119 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.779284  8728 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:48.831105  8163 consensus_peers.cc:597] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7922a990c04422aa6d20dbef2f00976. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.833190  8858 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.834977  8270 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.837992  8119 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.851859  8022 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.886546  8267 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:48.895758  8197 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.897862  8840 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.900811  8119 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.903409  8840 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:48.911207  8237 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26e50e42ace14a4db7be14613c771220. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.912395  8737 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.915050  8197 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.927014  8267 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:48.931234  8021 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.932742  8118 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:02:48.949887  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60fac097ca0e444dbe442019479fc818. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.959790  8197 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.959743  8119 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.961333  8846 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.962266  8840 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.974776  8846 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:48.978142  8119 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:49.001822  8021 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.995911  8197 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:49.025873  8836 heartbeater.cc:499] Master 127.6.215.126:41935 was elected leader, sending a full tablet report...
I20260709 13:02:49.096314  8870 ts_tablet_manager.cc:933] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:02:49.102285  8870 tablet_copy_client.cc:323] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:02:49.125626  8135 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet d0ae8ee6216f434eb7857a29d9b682d9 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:02:49.126235  8135 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet d0ae8ee6216f434eb7857a29d9b682d9 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-d0ae8ee6216f434eb7857a29d9b682d9
I20260709 13:02:49.134758  8135 tablet_copy_source_session.cc:215] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:49.138535  8870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ae8ee6216f434eb7857a29d9b682d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:49.156502  8870 tablet_copy_client.cc:806] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:49.157294  8870 tablet_copy_client.cc:670] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:49.161754  8870 tablet_copy_client.cc:538] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:49.173473  8870 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:49.200930  8870 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:49.201905  8870 tablet_bootstrap.cc:492] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:49.202544  8870 ts_tablet_manager.cc:1403] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.010s
I20260709 13:02:49.207471  8870 raft_consensus.cc:359] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.208365  8870 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:49.208982  8870 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.218309  8870 ts_tablet_manager.cc:1434] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:02:49.225553  8135 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-d0ae8ee6216f434eb7857a29d9b682d9 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:02:49.226011  8135 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-d0ae8ee6216f434eb7857a29d9b682d9 on tablet d0ae8ee6216f434eb7857a29d9b682d9 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:49.235277  8870 ts_tablet_manager.cc:933] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:49.309376  8870 tablet_copy_client.cc:323] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:49.325182  8210 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet e7922a990c04422aa6d20dbef2f00976 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:49.325754  8210 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet e7922a990c04422aa6d20dbef2f00976 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-e7922a990c04422aa6d20dbef2f00976
I20260709 13:02:49.332300  8210 tablet_copy_source_session.cc:215] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:49.335347  8870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7922a990c04422aa6d20dbef2f00976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:49.349133  8870 tablet_copy_client.cc:806] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:49.356686  8870 tablet_copy_client.cc:670] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:49.368888  8874 ts_tablet_manager.cc:933] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:49.369102  8870 tablet_copy_client.cc:538] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:49.377308  8870 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:49.408914  8874 tablet_copy_client.cc:323] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:02:49.411504  8870 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:49.412388  8870 tablet_bootstrap.cc:492] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:49.413018  8870 ts_tablet_manager.cc:1403] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.024s
I20260709 13:02:49.415724  8870 raft_consensus.cc:359] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.416566  8870 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:49.417209  8870 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.425311  8870 ts_tablet_manager.cc:1434] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:49.434448  8210 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-e7922a990c04422aa6d20dbef2f00976 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:49.434886  8210 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-e7922a990c04422aa6d20dbef2f00976 on tablet e7922a990c04422aa6d20dbef2f00976 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:49.441717  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 26e50e42ace14a4db7be14613c771220 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:02:49.442255  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 26e50e42ace14a4db7be14613c771220 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-26e50e42ace14a4db7be14613c771220
I20260709 13:02:49.448947  8284 tablet_copy_source_session.cc:215] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:49.452876  8874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e50e42ace14a4db7be14613c771220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:49.480401  8874 tablet_copy_client.cc:806] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:49.484372  8874 tablet_copy_client.cc:670] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:49.487942  8874 tablet_copy_client.cc:538] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:49.498768  8874 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:49.526886  8874 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:49.527793  8874 tablet_bootstrap.cc:492] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:49.528446  8874 ts_tablet_manager.cc:1403] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.014s
I20260709 13:02:49.535310  8811 raft_consensus.cc:1217] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:49.540335  8874 raft_consensus.cc:359] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.541154  8874 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:49.543804  8874 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.551378  8874 ts_tablet_manager.cc:1434] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:02:49.553023  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-26e50e42ace14a4db7be14613c771220 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:02:49.553452  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-26e50e42ace14a4db7be14613c771220 on tablet 26e50e42ace14a4db7be14613c771220 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:49.569223  8870 ts_tablet_manager.cc:933] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:49.583958  8870 tablet_copy_client.cc:323] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:02:49.585564  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 60fac097ca0e444dbe442019479fc818 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:02:49.586079  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 60fac097ca0e444dbe442019479fc818 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-60fac097ca0e444dbe442019479fc818
I20260709 13:02:49.593523  8284 tablet_copy_source_session.cc:215] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:49.598155  8870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fac097ca0e444dbe442019479fc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:49.614741  8870 tablet_copy_client.cc:806] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:49.615311  8870 tablet_copy_client.cc:670] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:49.620231  8870 tablet_copy_client.cc:538] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:49.628283  8870 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:49.648633  8870 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:49.649468  8870 tablet_bootstrap.cc:492] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:49.650028  8870 ts_tablet_manager.cc:1403] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.001s
I20260709 13:02:49.652351  8870 raft_consensus.cc:359] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.653059  8870 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:49.653803  8870 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:49.655745  8870 ts_tablet_manager.cc:1434] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:02:49.657436  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-60fac097ca0e444dbe442019479fc818 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:02:49.657824  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-60fac097ca0e444dbe442019479fc818 on tablet 60fac097ca0e444dbe442019479fc818 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:49.720402  8811 raft_consensus.cc:1217] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:49.872514  8811 raft_consensus.cc:1217] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:50.054396  8811 raft_consensus.cc:1217] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:50.095093  8849 raft_consensus.cc:1064] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:50.097323  8849 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.114769  8811 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.116257  8714 raft_consensus.cc:1064] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:50.118036  8762 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.122275  8714 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.126734  8200 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.129823  8881 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.128405  8274 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.145610  8887 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.172008  8887 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.172997  8271 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:02:50.174950  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47103.2us
I20260709 13:02:50.184746  8811 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.192322  8020 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.217561  8200 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.222007  8811 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.223668  8860 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.226249  8119 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.229872  8728 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.239584  8274 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.256726  8728 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.263556  8897 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.271915  8119 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.277114  8811 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.294729  8271 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.299698  8119 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.308581  8274 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.310046  8881 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.310966  8811 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.313019  8737 raft_consensus.cc:1064] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:50.314432  8881 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.315048  8737 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.317337  8762 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.328624  8197 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.330273  8023 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.331128  8811 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.331836  8116 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.330296  8885 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:50.334254  8274 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.344609  8846 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.345543  8885 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.353011  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0ae8ee6216f434eb7857a29d9b682d9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.352635  8810 raft_consensus.cc:2955] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.364266  8021 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.364266  8197 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.373946  8846 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.385541  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet d0ae8ee6216f434eb7857a29d9b682d9 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:02:50.386590  8811 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.394052  8200 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.402879  8022 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.404518  8119 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.405860  8897 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.409500  8810 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.394014  8116 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.419101  8897 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.421612  8274 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.422706  8118 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.440793  8906 tablet_replica.cc:333] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:02:50.461012  8811 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.461040  8200 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.462661  8840 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.464068  8840 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.468006  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7922a990c04422aa6d20dbef2f00976 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.472012  8840 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.477720  8020 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.486838  8811 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.493424  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26e50e42ace14a4db7be14613c771220 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.501088  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet e7922a990c04422aa6d20dbef2f00976 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:02:50.510413  8020 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.514340  8200 raft_consensus.cc:2955] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.535567  8860 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.540851  8737 raft_consensus.cc:1064] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:50.543361  8737 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.544481  8810 raft_consensus.cc:2955] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.553225  8907 tablet_replica.cc:333] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:02:50.560312  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 26e50e42ace14a4db7be14613c771220 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:50.565615  8906 raft_consensus.cc:2243] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.574239  8906 raft_consensus.cc:2272] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.574644  8910 tablet_replica.cc:333] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:02:50.575585  8910 raft_consensus.cc:2243] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.577695  8906 ts_tablet_manager.cc:1916] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.577781  8910 raft_consensus.cc:2272] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.587431  8910 ts_tablet_manager.cc:1916] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.588662  8907 raft_consensus.cc:2243] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.600966  8907 raft_consensus.cc:2272] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.604880  8907 ts_tablet_manager.cc:1916] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.607321  8200 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.609795  8846 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.616580  8906 ts_tablet_manager.cc:1929] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:50.617156  8906 log.cc:1199] T d0ae8ee6216f434eb7857a29d9b682d9 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/d0ae8ee6216f434eb7857a29d9b682d9
I20260709 13:02:50.621937  8118 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.622810  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet d0ae8ee6216f434eb7857a29d9b682d9 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:50.625388  8737 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.627231  8910 ts_tablet_manager.cc:1929] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:50.627681  8910 log.cc:1199] T 26e50e42ace14a4db7be14613c771220 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/26e50e42ace14a4db7be14613c771220
I20260709 13:02:50.630821  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 26e50e42ace14a4db7be14613c771220 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:50.638118  8810 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.644492  8737 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.659611  8737 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.661087  8197 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.677270  8811 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.681059  8022 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.685621  8117 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.715837  8907 ts_tablet_manager.cc:1929] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:50.716292  8907 log.cc:1199] T e7922a990c04422aa6d20dbef2f00976 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/e7922a990c04422aa6d20dbef2f00976
I20260709 13:02:50.718335  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet e7922a990c04422aa6d20dbef2f00976 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:50.721069  8274 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:50.729650  8811 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.731288  8737 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.733619  8116 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:50.742384  8890 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:50.758173  8885 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.760670  8811 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.762284  8118 raft_consensus.cc:2955] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.785475  8022 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:50.795003  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 60fac097ca0e444dbe442019479fc818 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:02:50.795917  8906 tablet_replica.cc:333] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:02:50.796830  8906 raft_consensus.cc:2243] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.797546  8906 raft_consensus.cc:2272] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.803102  8906 ts_tablet_manager.cc:1916] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.806195  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60fac097ca0e444dbe442019479fc818 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.838212  8906 ts_tablet_manager.cc:1929] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:50.838672  8906 log.cc:1199] T 60fac097ca0e444dbe442019479fc818 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/60fac097ca0e444dbe442019479fc818
I20260709 13:02:50.842763  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 60fac097ca0e444dbe442019479fc818 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:51.855207  8200 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:02:51.860236  8163 consensus_peers.cc:597] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e577a5a5d0ab4664ab92aed9a58cfb2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.861047  8274 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:51.861761  8116 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:51.862363  8916 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.865007  8917 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.874959  8917 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.876662  8274 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.877745  8116 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.893539  8200 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:51.897171  8022 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:51.916971  8163 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89c4577341fc4203869bd3f8476d9c43. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.916971  8274 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:51.917634  8116 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:51.918311  8916 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.919173  8917 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.929711  8714 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.935483  8118 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.945942  8118 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:51.950922  8020 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.952982  8274 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:02:51.965559  8088 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ca6717bd9844d668ee0a2fff3b530f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.966104  8200 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:51.966796  8271 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:51.967512  8908 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.969208  8849 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.977764  8908 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.979393  8200 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.982517  8271 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:51.991855  8193 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:51.996021  8021 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:52.003895  8163 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 729f99fd4567469babdeb05f3b4b3d27. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.005143  8274 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:52.006246  8118 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:52.006747  8916 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.008545  8916 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.019376  8917 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:52.021451  8118 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:52.029786  8274 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:52.047432  8022 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.381835  8934 ts_tablet_manager.cc:933] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:02:52.384047  8934 tablet_copy_client.cc:323] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:02:52.385867  8135 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 3ca6717bd9844d668ee0a2fff3b530f4 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:02:52.386361  8135 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 3ca6717bd9844d668ee0a2fff3b530f4 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-3ca6717bd9844d668ee0a2fff3b530f4
I20260709 13:02:52.391314  8135 tablet_copy_source_session.cc:215] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:52.393558  8934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca6717bd9844d668ee0a2fff3b530f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:52.409056  8934 tablet_copy_client.cc:806] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:52.409760  8934 tablet_copy_client.cc:670] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:52.412678  8936 ts_tablet_manager.cc:933] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:52.435163  8934 tablet_copy_client.cc:538] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:52.444424  8934 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:52.448347  8937 ts_tablet_manager.cc:933] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:52.453033  8939 ts_tablet_manager.cc:933] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:52.457494  8939 tablet_copy_client.cc:323] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:52.459646  8210 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet e577a5a5d0ab4664ab92aed9a58cfb2d from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:52.460134  8210 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet e577a5a5d0ab4664ab92aed9a58cfb2d from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-e577a5a5d0ab4664ab92aed9a58cfb2d
I20260709 13:02:52.464141  8936 tablet_copy_client.cc:323] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:52.465965  8209 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 729f99fd4567469babdeb05f3b4b3d27 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:52.466495  8209 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 729f99fd4567469babdeb05f3b4b3d27 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-729f99fd4567469babdeb05f3b4b3d27
I20260709 13:02:52.477198  8937 tablet_copy_client.cc:323] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:52.479329  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 89c4577341fc4203869bd3f8476d9c43 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:52.479846  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 89c4577341fc4203869bd3f8476d9c43 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-89c4577341fc4203869bd3f8476d9c43
I20260709 13:02:52.480060  8934 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:52.480878  8934 tablet_bootstrap.cc:492] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:52.481503  8934 ts_tablet_manager.cc:1403] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.013s
I20260709 13:02:52.484232  8934 raft_consensus.cc:359] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.485028  8934 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:52.485685  8934 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.489562  8209 tablet_copy_source_session.cc:215] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:52.490569  8210 tablet_copy_source_session.cc:215] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:52.493862  8939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e577a5a5d0ab4664ab92aed9a58cfb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:52.502499  8936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f99fd4567469babdeb05f3b4b3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:52.527779  8939 tablet_copy_client.cc:806] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:52.529928  8936 tablet_copy_client.cc:806] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:52.530817  8936 tablet_copy_client.cc:670] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:52.530308  8939 tablet_copy_client.cc:670] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:52.542981  8939 tablet_copy_client.cc:538] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:52.549422  8936 tablet_copy_client.cc:538] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:52.552757  8208 tablet_copy_source_session.cc:215] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:52.560672  8937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4577341fc4203869bd3f8476d9c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:52.561569  8936 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:52.566057  8939 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:52.567889  8934 ts_tablet_manager.cc:1434] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.086s	user 0.031s	sys 0.026s
I20260709 13:02:52.570689  8135 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-3ca6717bd9844d668ee0a2fff3b530f4 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:02:52.571153  8135 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-3ca6717bd9844d668ee0a2fff3b530f4 on tablet 3ca6717bd9844d668ee0a2fff3b530f4 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:52.580109  8937 tablet_copy_client.cc:806] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:52.580673  8937 tablet_copy_client.cc:670] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:52.583925  8937 tablet_copy_client.cc:538] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:52.592549  8937 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:52.600001  8939 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:52.601012  8939 tablet_bootstrap.cc:492] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:52.601729  8939 ts_tablet_manager.cc:1403] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.001s
I20260709 13:02:52.604827  8939 raft_consensus.cc:359] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.605710  8939 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:52.606395  8939 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.615803  8939 ts_tablet_manager.cc:1434] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:52.624979  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-e577a5a5d0ab4664ab92aed9a58cfb2d received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:52.625447  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-e577a5a5d0ab4664ab92aed9a58cfb2d on tablet e577a5a5d0ab4664ab92aed9a58cfb2d with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:52.631898  8937 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:52.632773  8937 tablet_bootstrap.cc:492] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:52.633442  8937 ts_tablet_manager.cc:1403] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.013s
I20260709 13:02:52.636080  8936 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:52.637540  8936 tablet_bootstrap.cc:492] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:52.637537  8937 raft_consensus.cc:359] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.638419  8937 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:52.638522  8936 ts_tablet_manager.cc:1403] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.077s	user 0.029s	sys 0.008s
I20260709 13:02:52.639119  8937 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.641417  8937 ts_tablet_manager.cc:1434] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:52.641873  8936 raft_consensus.cc:359] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.643203  8936 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:52.643517  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-89c4577341fc4203869bd3f8476d9c43 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:52.643951  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-89c4577341fc4203869bd3f8476d9c43 on tablet 89c4577341fc4203869bd3f8476d9c43 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:52.643872  8936 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:52.646186  8936 ts_tablet_manager.cc:1434] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:02:52.647548  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-729f99fd4567469babdeb05f3b4b3d27 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:52.647845  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-729f99fd4567469babdeb05f3b4b3d27 on tablet 729f99fd4567469babdeb05f3b4b3d27 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:52.796119  8811 raft_consensus.cc:1217] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:52.805889  8810 raft_consensus.cc:1217] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:52.846215  8811 raft_consensus.cc:1217] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:52.886766  8811 raft_consensus.cc:1217] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:53.242992  8714 raft_consensus.cc:1064] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:53.245329  8714 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.253248  8811 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.254925  8274 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.255272  8917 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:53.257906  8897 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.259157  8118 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.261909  8917 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.268368  8916 raft_consensus.cc:1064] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:53.271179  8916 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.306488  8952 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.310974  8274 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.313630  8118 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.330076  8811 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.337374  8267 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.339285  8714 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.349247  8118 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.336201  8810 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.351428  8917 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.336163  8020 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:53.366207  8917 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.370663  8897 raft_consensus.cc:1064] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:53.374153  8897 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.391899  8274 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.398607  8116 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.399981  8917 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.402384  8949 raft_consensus.cc:1064] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:53.404551  8810 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.405129  8949 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.407904  8714 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.409554  8714 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.441776  8897 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.439738  8714 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.451510  8810 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.478564  8914 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:02:53.444298  8811 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.510149  8116 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.525322  8270 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.534564  8908 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:53.445468  8267 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.547137  8200 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:53.551095  8908 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.576109  8271 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.580507  8116 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.583794  8811 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.617223  8950 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.624342  8271 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.643308  8197 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.645606  8811 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.671015  8193 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.677397  8811 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.677922  8116 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.679949  8966 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.681667  8966 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.682711  8022 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.686617  8022 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.688050  8022 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.693269  8952 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.694401  8811 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.695417  8116 raft_consensus.cc:2955] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.718700  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89c4577341fc4203869bd3f8476d9c43 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:53.723860  8197 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.724711  8022 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.731022  8811 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.731920  8271 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.724309  8193 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.733466  8967 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:53.737380  8966 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.743194  8116 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:53.745309  8810 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.748935  8271 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.752245  8810 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.753572  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 89c4577341fc4203869bd3f8476d9c43 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:02:53.753832  8908 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.752872  8917 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.755935  8967 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.759258  8966 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.762928  8810 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.765682  8197 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:53.766922  8949 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:53.770123  8916 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.774559  8950 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.777149  8811 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.780257  8267 raft_consensus.cc:2955] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.781119  8809 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.786556  8200 raft_consensus.cc:2955] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.789542  8266 raft_consensus.cc:2955] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.806540  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e577a5a5d0ab4664ab92aed9a58cfb2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:53.807415  8023 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.816515  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 729f99fd4567469babdeb05f3b4b3d27 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:53.819309  8976 tablet_replica.cc:333] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:02:53.823390  8976 raft_consensus.cc:2243] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:53.824179  8976 raft_consensus.cc:2272] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:53.829371  8976 ts_tablet_manager.cc:1916] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:53.830967  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ca6717bd9844d668ee0a2fff3b530f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:53.833155  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 729f99fd4567469babdeb05f3b4b3d27 with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:53.865712  8021 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.867605  8977 tablet_replica.cc:333] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:02:53.868618  8977 raft_consensus.cc:2243] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:53.869406  8977 raft_consensus.cc:2272] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:53.874423  8977 ts_tablet_manager.cc:1916] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:53.882583  8976 ts_tablet_manager.cc:1929] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:53.882459  8022 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:53.883180  8976 log.cc:1199] T 89c4577341fc4203869bd3f8476d9c43 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/89c4577341fc4203869bd3f8476d9c43
I20260709 13:02:53.885285  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 89c4577341fc4203869bd3f8476d9c43 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:53.885900  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet e577a5a5d0ab4664ab92aed9a58cfb2d with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:53.897606  8977 ts_tablet_manager.cc:1929] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:53.898072  8977 log.cc:1199] T 729f99fd4567469babdeb05f3b4b3d27 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/729f99fd4567469babdeb05f3b4b3d27
I20260709 13:02:53.903579  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ca6717bd9844d668ee0a2fff3b530f4 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:02:53.907362  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 729f99fd4567469babdeb05f3b4b3d27 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:53.907775  8977 tablet_replica.cc:333] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:02:53.908057  8976 tablet_replica.cc:333] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:02:53.908975  8977 raft_consensus.cc:2243] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:53.909646  8977 raft_consensus.cc:2272] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:53.912029  8977 ts_tablet_manager.cc:1916] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:53.912456  8976 raft_consensus.cc:2243] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:53.924969  8977 ts_tablet_manager.cc:1929] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:53.925477  8977 log.cc:1199] T e577a5a5d0ab4664ab92aed9a58cfb2d P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/e577a5a5d0ab4664ab92aed9a58cfb2d
I20260709 13:02:53.927772  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet e577a5a5d0ab4664ab92aed9a58cfb2d (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:53.913398  8976 raft_consensus.cc:2272] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:53.932687  8976 ts_tablet_manager.cc:1916] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:53.943460  8976 ts_tablet_manager.cc:1929] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:53.943743  8976 log.cc:1199] T 3ca6717bd9844d668ee0a2fff3b530f4 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/3ca6717bd9844d668ee0a2fff3b530f4
I20260709 13:02:53.944948  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 3ca6717bd9844d668ee0a2fff3b530f4 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:54.964943  8271 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:54.971112  8200 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:54.972071  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a3d4a04ded8480c86cbdcb830e8fd57. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.972774  8944 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:54.975960  8121 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:54.977555  8981 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:54.980577  8981 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:54.982175  8200 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:54.998755  8271 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.000805  8121 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:54.999745  8022 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.012547  8200 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:55.014415  8970 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.017220  8116 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:55.018334  8970 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:55.019431  8237 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e2628cd0cb14e318af904dd53421357. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.025336  8944 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.026809  8197 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.044888  8116 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.045589  8197 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.069903  8121 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:55.069108  8020 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.072252  8966 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:55.073828  8271 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:55.076056  8163 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 587b9bcf479d417dbc213189e328a0f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.076635  8980 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.085501  8967 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.087174  8116 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.100281  8267 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.115394  8270 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.115608  8022 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.125439  8200 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:55.126647  8993 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:02:55.130139  8237 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c788fd48c46f4ede898fe663e6cf64cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.132715  8116 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:55.133975  8944 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.148521  8970 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.154115  8121 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.154235  8200 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:55.176043  8020 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.407879  9000 ts_tablet_manager.cc:933] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:55.410092  9000 tablet_copy_client.cc:323] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:02:55.411890  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 9e2628cd0cb14e318af904dd53421357 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:02:55.412401  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 9e2628cd0cb14e318af904dd53421357 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-9e2628cd0cb14e318af904dd53421357
I20260709 13:02:55.421077  8284 tablet_copy_source_session.cc:215] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:55.424363  9000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2628cd0cb14e318af904dd53421357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:55.438834  9000 tablet_copy_client.cc:806] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:55.439420  9000 tablet_copy_client.cc:670] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:55.442934  9000 tablet_copy_client.cc:538] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:55.448696  9000 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:55.465655  9000 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.466548  9000 tablet_bootstrap.cc:492] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:55.467207  9000 ts_tablet_manager.cc:1403] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.019s	user 0.020s	sys 0.001s
I20260709 13:02:55.469910  9000 raft_consensus.cc:359] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.470728  9000 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:55.471410  9000 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.475968  9000 ts_tablet_manager.cc:1434] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:55.479398  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-9e2628cd0cb14e318af904dd53421357 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:02:55.479825  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-9e2628cd0cb14e318af904dd53421357 on tablet 9e2628cd0cb14e318af904dd53421357 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:55.519448  9000 ts_tablet_manager.cc:933] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:55.520911  9000 tablet_copy_client.cc:323] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:02:55.522222  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 2a3d4a04ded8480c86cbdcb830e8fd57 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:02:55.522615  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 2a3d4a04ded8480c86cbdcb830e8fd57 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-2a3d4a04ded8480c86cbdcb830e8fd57
I20260709 13:02:55.527905  8284 tablet_copy_source_session.cc:215] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:55.530709  9000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3d4a04ded8480c86cbdcb830e8fd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:55.545202  9000 tablet_copy_client.cc:806] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:55.545776  9000 tablet_copy_client.cc:670] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:55.549079  9000 tablet_copy_client.cc:538] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:55.556970  9000 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:55.572183  9000 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.572793  9000 tablet_bootstrap.cc:492] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:55.573252  9000 ts_tablet_manager.cc:1403] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 13:02:55.576138  9000 raft_consensus.cc:359] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.577528  9000 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:55.578181  9000 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.581944  9006 ts_tablet_manager.cc:933] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:55.582001  9000 ts_tablet_manager.cc:1434] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:02:55.583657  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-2a3d4a04ded8480c86cbdcb830e8fd57 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:02:55.584056  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-2a3d4a04ded8480c86cbdcb830e8fd57 on tablet 2a3d4a04ded8480c86cbdcb830e8fd57 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:55.588929  9006 tablet_copy_client.cc:323] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:02:55.590469  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet c788fd48c46f4ede898fe663e6cf64cc from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:02:55.590940  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet c788fd48c46f4ede898fe663e6cf64cc from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-c788fd48c46f4ede898fe663e6cf64cc
I20260709 13:02:55.597903  8284 tablet_copy_source_session.cc:215] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:55.600865  9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788fd48c46f4ede898fe663e6cf64cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:55.615743  9006 tablet_copy_client.cc:806] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:55.616319  9006 tablet_copy_client.cc:670] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:55.619333  9006 tablet_copy_client.cc:538] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:55.627138  9006 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:55.645694  9006 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.646488  9006 tablet_bootstrap.cc:492] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:55.647102  9006 ts_tablet_manager.cc:1403] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.008s
I20260709 13:02:55.649832  9006 raft_consensus.cc:359] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.650643  9006 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:55.651229  9006 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.656769  9006 ts_tablet_manager.cc:1434] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:55.658722  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-c788fd48c46f4ede898fe663e6cf64cc received from {username='slave'} at 127.0.0.1:34584
I20260709 13:02:55.659118  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-c788fd48c46f4ede898fe663e6cf64cc on tablet c788fd48c46f4ede898fe663e6cf64cc with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:55.661837  9000 ts_tablet_manager.cc:933] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:55.682241  9000 tablet_copy_client.cc:323] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:55.684095  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 587b9bcf479d417dbc213189e328a0f8 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:55.684593  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 587b9bcf479d417dbc213189e328a0f8 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-587b9bcf479d417dbc213189e328a0f8
I20260709 13:02:55.692770  8208 tablet_copy_source_session.cc:215] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:55.695612  9000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b9bcf479d417dbc213189e328a0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:55.706542  9000 tablet_copy_client.cc:806] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:55.707082  9000 tablet_copy_client.cc:670] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:55.713495  9000 tablet_copy_client.cc:538] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:55.720515  9000 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:55.736748  9000 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.737542  9000 tablet_bootstrap.cc:492] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:55.738091  9000 ts_tablet_manager.cc:1403] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.018s	user 0.019s	sys 0.000s
I20260709 13:02:55.740460  9000 raft_consensus.cc:359] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.741191  9000 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:55.741746  9000 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:55.743660  9000 ts_tablet_manager.cc:1434] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:55.747218  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-587b9bcf479d417dbc213189e328a0f8 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:55.747674  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-587b9bcf479d417dbc213189e328a0f8 on tablet 587b9bcf479d417dbc213189e328a0f8 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:55.902334  8809 raft_consensus.cc:1217] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:56.027844  8809 raft_consensus.cc:1217] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:56.045924  8809 raft_consensus.cc:1217] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:56.162428  8809 raft_consensus.cc:1217] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:56.461570  8993 raft_consensus.cc:1064] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:56.464143  8993 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.472360  8809 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.473547  8197 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.473881  8970 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.475140  8993 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.477264  8116 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.493496  8993 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:56.499620  9012 raft_consensus.cc:1064] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:56.504446  9012 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.507053  9011 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.523428  8809 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.525442  8271 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.524865  8811 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.524860  8116 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.530772  9019 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.531603  8980 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:56.533601  8116 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.535032  8980 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.542260  8023 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.593837  8197 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.595077  9012 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.597465  8270 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.605400  9011 raft_consensus.cc:1064] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:56.607563  9011 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.628993  8118 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.635844  8197 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.638105  9029 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.641593  8116 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.644354  8809 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.646083  9029 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.649049  9021 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:02:56.652731  8811 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.659993  8021 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.671898  9021 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.675002  8116 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.683182  8197 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.697808  8020 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.702236  8809 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.720331  8193 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.724016  8271 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.728245  8809 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.729596  9012 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:56.730804  8118 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.732926  8967 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.733219  8193 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.737973  8809 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.738428  9025 raft_consensus.cc:1064] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:56.738032  9011 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:02:56.743208  9029 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.740760  9025 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.753418  9011 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.765074  8810 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.767576  8270 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.780285  8197 raft_consensus.cc:2955] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.784837  8809 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.785914  8118 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.788053  9029 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.789721  9029 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.790215  8980 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.795399  8811 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.802033  9020 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.809962  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e2628cd0cb14e318af904dd53421357 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.817075  8020 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.817237  8811 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.818429  8023 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.827405  8121 raft_consensus.cc:2955] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.832840  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a3d4a04ded8480c86cbdcb830e8fd57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.833825  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 587b9bcf479d417dbc213189e328a0f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.836301  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 587b9bcf479d417dbc213189e328a0f8 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:02:56.840346  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e2628cd0cb14e318af904dd53421357 with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:56.856110  8118 raft_consensus.cc:2955] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.840015  9039 tablet_replica.cc:333] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:02:56.881915  9040 tablet_replica.cc:333] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:02:56.884241  9040 raft_consensus.cc:2243] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.883147  8810 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.884629  8197 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.884855  9040 raft_consensus.cc:2272] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.886399  9029 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.886735  8023 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.888495  9020 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.888851  9040 ts_tablet_manager.cc:1916] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.899364  9039 raft_consensus.cc:2243] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.900496  9039 raft_consensus.cc:2272] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.902256  8118 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:56.903820  9039 ts_tablet_manager.cc:1916] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.911319  9040 ts_tablet_manager.cc:1929] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:56.911832  9040 log.cc:1199] T 9e2628cd0cb14e318af904dd53421357 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/9e2628cd0cb14e318af904dd53421357
I20260709 13:02:56.913877  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 9e2628cd0cb14e318af904dd53421357 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:56.915695  9020 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.918550  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3d4a04ded8480c86cbdcb830e8fd57 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:02:56.927016  9039 ts_tablet_manager.cc:1929] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:56.927526  9039 log.cc:1199] T 587b9bcf479d417dbc213189e328a0f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/587b9bcf479d417dbc213189e328a0f8
I20260709 13:02:56.927834  9043 tablet_replica.cc:333] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:02:56.929298  9043 raft_consensus.cc:2243] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.930416  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 587b9bcf479d417dbc213189e328a0f8 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:56.931883  9043 raft_consensus.cc:2272] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.935039  9023 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.939991  9043 ts_tablet_manager.cc:1916] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.941999  8811 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.957949  8118 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.967101  8023 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.967120  8197 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:56.973615  9043 ts_tablet_manager.cc:1929] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:56.974159  9043 log.cc:1199] T 2a3d4a04ded8480c86cbdcb830e8fd57 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/2a3d4a04ded8480c86cbdcb830e8fd57
I20260709 13:02:56.976092  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 2a3d4a04ded8480c86cbdcb830e8fd57 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:56.984505  8270 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:56.995759  8810 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:56.997562  9023 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:57.000015  8118 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:57.004655  9011 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:57.007146  9011 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:57.008738  8810 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:57.014096  8121 raft_consensus.cc:2955] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:57.021678  8020 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:57.035054  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c788fd48c46f4ede898fe663e6cf64cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:57.040621  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet c788fd48c46f4ede898fe663e6cf64cc with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:02:57.041581  9043 tablet_replica.cc:333] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:02:57.042407  9043 raft_consensus.cc:2243] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.043009  9043 raft_consensus.cc:2272] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.045771  9043 ts_tablet_manager.cc:1916] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:57.057993  9043 ts_tablet_manager.cc:1929] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:57.058285  9043 log.cc:1199] T c788fd48c46f4ede898fe663e6cf64cc P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/c788fd48c46f4ede898fe663e6cf64cc
I20260709 13:02:57.059566  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet c788fd48c46f4ede898fe663e6cf64cc (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:02:58.103341  8118 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.108810  8267 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:58.109417  8088 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 621c07aa07044d69b33dead0af7e7fd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.109943  8950 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.110253  8197 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.111281  8950 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.117880  9045 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.119513  8267 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.121479  8197 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.136294  8200 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.136145  8021 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:02:58.149806  8163 consensus_peers.cc:597] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fc42e8321e24c91a3684956eeb796b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.151372  8267 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.151372  8118 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.153649  8980 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.156879  9046 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.167383  8980 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.169315  8118 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.170301  8271 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.184303  8200 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.182591  8020 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:58.214630  8163 consensus_peers.cc:597] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f66db9a2fdf400a9046121a4b3b1b3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.215881  8271 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.217197  9036 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.218891  8118 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.221227  9036 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.228582  9036 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.230513  8271 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.244933  8118 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.248165  8020 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.249853  8271 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.262089  8200 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.263561  9021 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:58.267686  8237 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 327bf050c29d49408e736f7e8fda9e6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.276074  8118 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:58.283821  9023 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.296391  9060 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.299882  8197 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.304837  8118 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.318495  8021 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:02:58.672360  9065 ts_tablet_manager.cc:933] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:58.675158  9065 tablet_copy_client.cc:323] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:58.676553  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 8f66db9a2fdf400a9046121a4b3b1b3b from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:58.676946  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 8f66db9a2fdf400a9046121a4b3b1b3b from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-8f66db9a2fdf400a9046121a4b3b1b3b
I20260709 13:02:58.681619  8208 tablet_copy_source_session.cc:215] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:58.684695  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f66db9a2fdf400a9046121a4b3b1b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:58.697736  9067 ts_tablet_manager.cc:933] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:02:58.710078  9067 tablet_copy_client.cc:323] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:02:58.711632  9065 tablet_copy_client.cc:806] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:58.711768  8135 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 621c07aa07044d69b33dead0af7e7fd9 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:02:58.712280  9065 tablet_copy_client.cc:670] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:58.712343  8135 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 621c07aa07044d69b33dead0af7e7fd9 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-621c07aa07044d69b33dead0af7e7fd9
I20260709 13:02:58.716323  9065 tablet_copy_client.cc:538] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:58.720009  8135 tablet_copy_source_session.cc:215] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:58.723057  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621c07aa07044d69b33dead0af7e7fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:58.723067  9065 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:58.744721  9067 tablet_copy_client.cc:806] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:58.745316  9067 tablet_copy_client.cc:670] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:58.757969  9065 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:58.759202  9065 tablet_bootstrap.cc:492] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:58.759889  9065 ts_tablet_manager.cc:1403] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.008s
I20260709 13:02:58.762274  9067 tablet_copy_client.cc:538] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:58.763901  9071 ts_tablet_manager.cc:933] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:02:58.766426  9065 raft_consensus.cc:359] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.767208  9065 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:58.768250  9065 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.772004  9071 tablet_copy_client.cc:323] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:02:58.773727  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 327bf050c29d49408e736f7e8fda9e6b from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:02:58.774223  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 327bf050c29d49408e736f7e8fda9e6b from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-327bf050c29d49408e736f7e8fda9e6b
I20260709 13:02:58.781172  8284 tablet_copy_source_session.cc:215] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:58.784461  9071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bf050c29d49408e736f7e8fda9e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:58.791134  9067 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:58.794341  9065 ts_tablet_manager.cc:1434] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.021s
I20260709 13:02:58.802850  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-8f66db9a2fdf400a9046121a4b3b1b3b received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:58.803247  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-8f66db9a2fdf400a9046121a4b3b1b3b on tablet 8f66db9a2fdf400a9046121a4b3b1b3b with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:58.806854  9065 ts_tablet_manager.cc:933] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:02:58.817209  9071 tablet_copy_client.cc:806] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:58.817929  9071 tablet_copy_client.cc:670] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:58.823802  9071 tablet_copy_client.cc:538] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:58.841930  9071 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:58.847256  9065 tablet_copy_client.cc:323] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:02:58.849582  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 4fc42e8321e24c91a3684956eeb796b7 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:02:58.850055  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 4fc42e8321e24c91a3684956eeb796b7 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-4fc42e8321e24c91a3684956eeb796b7
I20260709 13:02:58.857811  9067 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:58.858598  8208 tablet_copy_source_session.cc:215] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:58.858665  9067 tablet_bootstrap.cc:492] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:58.860636  9067 ts_tablet_manager.cc:1403] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.089s	user 0.040s	sys 0.025s
I20260709 13:02:58.862522  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc42e8321e24c91a3684956eeb796b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:58.863610  9067 raft_consensus.cc:359] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.864617  9067 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:58.865273  9067 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.867719  9067 ts_tablet_manager.cc:1434] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:58.869784  8135 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-621c07aa07044d69b33dead0af7e7fd9 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:02:58.870261  8135 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-621c07aa07044d69b33dead0af7e7fd9 on tablet 621c07aa07044d69b33dead0af7e7fd9 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:58.882776  9065 tablet_copy_client.cc:806] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:58.883296  9065 tablet_copy_client.cc:670] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:58.886502  9065 tablet_copy_client.cc:538] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:58.894129  9065 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:02:58.905818  9071 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:58.906684  9071 tablet_bootstrap.cc:492] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:58.907317  9071 ts_tablet_manager.cc:1403] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.003s
I20260709 13:02:58.909667  9071 raft_consensus.cc:359] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.918390  9071 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:58.919028  9071 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.921634  9071 ts_tablet_manager.cc:1434] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:02:58.923151  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-327bf050c29d49408e736f7e8fda9e6b received from {username='slave'} at 127.0.0.1:34584
I20260709 13:02:58.923544  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-327bf050c29d49408e736f7e8fda9e6b on tablet 327bf050c29d49408e736f7e8fda9e6b with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:58.927052  9065 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:58.927755  9065 tablet_bootstrap.cc:492] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:02:58.928248  9065 ts_tablet_manager.cc:1403] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.001s
I20260709 13:02:58.930408  9065 raft_consensus.cc:359] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.930946  9065 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:02:58.931414  9065 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:02:58.933952  9065 ts_tablet_manager.cc:1434] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:02:58.935714  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-4fc42e8321e24c91a3684956eeb796b7 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:02:58.936100  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-4fc42e8321e24c91a3684956eeb796b7 on tablet 4fc42e8321e24c91a3684956eeb796b7 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:02:59.226056  8811 raft_consensus.cc:1217] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:59.236639  8811 raft_consensus.cc:1217] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:59.237852  8810 raft_consensus.cc:1217] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:59.264257  8811 raft_consensus.cc:1217] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:59.744704  9078 raft_consensus.cc:1064] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:59.746557  9078 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:59.758352  8197 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.758539  8811 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.759754  9062 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.761567  9079 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.787039  9086 raft_consensus.cc:1064] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:59.796950  9086 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:59.802268  8121 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.809372  9085 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:59.825623  9084 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.826694  8118 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:02:59.808569  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 44419.1us
I20260709 13:02:59.845405  9046 raft_consensus.cc:1064] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:59.847901  9046 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:02:59.849069  8022 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.855485  9036 raft_consensus.cc:1064] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:02:59.857029  8197 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.859237  9036 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:02:59.882714  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 104831us
I20260709 13:02:59.886636  8270 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.887884  9090 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.888782  8809 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.901618  9090 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:59.902758  8810 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.900945  8809 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.907498  8271 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.909181  9086 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.909965  8197 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.910591  9087 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.919831  9074 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:59.922039  8118 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.933436  9100 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.940481  8808 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.942273  8116 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.942538  9100 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.943516  8270 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:59.948190  9090 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.949384  9036 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:59.969291  9090 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.970517  8807 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.985584  9087 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.988550  8810 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:02:59.994668  8271 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.004161  9095 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.018714  8270 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.023857  8267 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:00.025089  8020 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.029232  8118 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.035816  8807 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.040910  8200 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.050938  8807 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.056049  8021 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.058463  8121 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.057966  8021 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.061412  9098 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:00.062551  8121 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.063016  8267 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.066092  9098 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.076951  9099 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.080446  8810 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.082813  8121 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:00.092398  8197 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:00.092819  8811 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.093878  8271 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.094213  9086 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.095357  9087 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.104480  8809 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.105966  9090 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.107458  8809 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.113744  8271 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.122169  9100 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.124256  8811 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.134131  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 327bf050c29d49408e736f7e8fda9e6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:00.137008  8266 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.138489  8980 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.146162  8117 raft_consensus.cc:2955] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.160038  9074 raft_consensus.cc:2955] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.163893  8271 raft_consensus.cc:2955] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.170248  8197 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:00.172745  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f66db9a2fdf400a9046121a4b3b1b3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:00.152498  8022 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.180341  8118 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.181391  9100 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.181665  8807 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:00.183115  8980 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:00.186100  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 621c07aa07044d69b33dead0af7e7fd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:00.193539  9095 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.195003  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 327bf050c29d49408e736f7e8fda9e6b with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:03:00.197500  8022 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.199468  8118 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.203209  8810 raft_consensus.cc:2955] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:00.207823  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fc42e8321e24c91a3684956eeb796b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:00.208848  8019 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.224671  9117 tablet_replica.cc:333] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:03:00.227105  9117 raft_consensus.cc:2243] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.227782  9117 raft_consensus.cc:2272] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.230412  9117 ts_tablet_manager.cc:1916] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:00.268252  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f66db9a2fdf400a9046121a4b3b1b3b with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:00.268956  9117 ts_tablet_manager.cc:1929] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:00.269441  9117 log.cc:1199] T 327bf050c29d49408e736f7e8fda9e6b P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/327bf050c29d49408e736f7e8fda9e6b
I20260709 13:03:00.284372  9118 tablet_replica.cc:333] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:03:00.285308  9118 raft_consensus.cc:2243] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.271355  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 327bf050c29d49408e736f7e8fda9e6b (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:00.290117  9118 raft_consensus.cc:2272] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.291050  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 621c07aa07044d69b33dead0af7e7fd9 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:03:00.296870  8019 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.298281  9117 tablet_replica.cc:333] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:03:00.299347  9117 raft_consensus.cc:2243] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.300050  9117 raft_consensus.cc:2272] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.303484  9117 ts_tablet_manager.cc:1916] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:00.303917  9118 ts_tablet_manager.cc:1916] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:00.311452  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc42e8321e24c91a3684956eeb796b7 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:00.317816  9119 tablet_replica.cc:333] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:03:00.321921  9119 raft_consensus.cc:2243] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.322682  9119 raft_consensus.cc:2272] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.324658  9117 ts_tablet_manager.cc:1929] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:00.324987  9117 log.cc:1199] T 621c07aa07044d69b33dead0af7e7fd9 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/621c07aa07044d69b33dead0af7e7fd9
I20260709 13:03:00.326232  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 621c07aa07044d69b33dead0af7e7fd9 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:00.330039  9119 ts_tablet_manager.cc:1916] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:00.335733  9118 ts_tablet_manager.cc:1929] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:00.336089  9118 log.cc:1199] T 8f66db9a2fdf400a9046121a4b3b1b3b P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/8f66db9a2fdf400a9046121a4b3b1b3b
I20260709 13:03:00.337399  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 8f66db9a2fdf400a9046121a4b3b1b3b (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:00.342020  9119 ts_tablet_manager.cc:1929] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:00.342340  9119 log.cc:1199] T 4fc42e8321e24c91a3684956eeb796b7 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/4fc42e8321e24c91a3684956eeb796b7
I20260709 13:03:00.343636  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 4fc42e8321e24c91a3684956eeb796b7 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:01.394011  8117 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:01.400997  8193 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:01.402086  8088 consensus_peers.cc:597] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45f9d10e30d545a18e699e9ccaea3e4e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.402717  8270 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.402828  9122 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:01.404166  9074 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.411721  9086 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.413256  8193 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.415740  8270 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.427748  8023 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.431037  8270 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:01.439833  8193 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.442104  8117 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.444043  9099 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:01.444980  8237 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d2c54c9c07a444898c0a63f323dfd5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.447733  9098 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.463035  9099 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.465756  8117 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.475085  8197 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.481240  8193 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:01.484542  8020 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:03:01.502722  8163 consensus_peers.cc:597] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f5168daf09c45b4accfa213d5b29a43. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.504706  8118 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.506096  9121 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.508332  8267 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.510711  8980 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.517644  9121 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.520176  8118 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.521908  8267 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.535004  8267 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:01.536803  8023 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.544685  8193 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.546509  9120 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.546430  8118 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:01.548228  9120 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:01.551112  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3e62d20a8d54072882e6b574cdddee5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.557482  9099 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.561036  8197 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.574842  8118 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:01.577212  8020 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.988145  9140 ts_tablet_manager.cc:933] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:01.990010  9140 tablet_copy_client.cc:323] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:01.991283  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 5d2c54c9c07a444898c0a63f323dfd5d from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:03:01.991684  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 5d2c54c9c07a444898c0a63f323dfd5d from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-5d2c54c9c07a444898c0a63f323dfd5d
I20260709 13:03:01.997442  8284 tablet_copy_source_session.cc:215] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:02.000192  9142 ts_tablet_manager.cc:933] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:03:02.000574  9140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2c54c9c07a444898c0a63f323dfd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:02.002162  9142 tablet_copy_client.cc:323] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:03:02.003422  8135 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 45f9d10e30d545a18e699e9ccaea3e4e from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:03:02.003979  8135 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 45f9d10e30d545a18e699e9ccaea3e4e from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-45f9d10e30d545a18e699e9ccaea3e4e
I20260709 13:03:02.009685  8135 tablet_copy_source_session.cc:215] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:02.011994  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9d10e30d545a18e699e9ccaea3e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:02.017395  9140 tablet_copy_client.cc:806] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:02.017920  9140 tablet_copy_client.cc:670] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:02.021309  9140 tablet_copy_client.cc:538] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:02.032873  9140 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:02.034147  9142 tablet_copy_client.cc:806] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:02.034720  9142 tablet_copy_client.cc:670] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:02.055835  9142 tablet_copy_client.cc:538] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:02.056598  9140 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:02.057418  9140 tablet_bootstrap.cc:492] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:02.058179  9140 ts_tablet_manager.cc:1403] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.000s
I20260709 13:03:02.060930  9140 raft_consensus.cc:359] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.061764  9140 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:02.062368  9140 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.063544  9142 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:02.065519  9140 ts_tablet_manager.cc:1434] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:02.067257  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-5d2c54c9c07a444898c0a63f323dfd5d received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:02.067652  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-5d2c54c9c07a444898c0a63f323dfd5d on tablet 5d2c54c9c07a444898c0a63f323dfd5d with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:02.087358  9142 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:02.087988  9142 tablet_bootstrap.cc:492] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:02.088482  9142 ts_tablet_manager.cc:1403] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:03:02.090814  9142 raft_consensus.cc:359] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.091622  9142 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:02.092197  9142 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.094789  9142 ts_tablet_manager.cc:1434] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:02.096676  8135 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-45f9d10e30d545a18e699e9ccaea3e4e received from {username='slave'} at 127.0.0.1:53286
I20260709 13:03:02.097111  8135 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-45f9d10e30d545a18e699e9ccaea3e4e on tablet 45f9d10e30d545a18e699e9ccaea3e4e with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:02.102649  9142 ts_tablet_manager.cc:933] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:02.107380  9142 tablet_copy_client.cc:323] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:03:02.108881  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 1f5168daf09c45b4accfa213d5b29a43 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:03:02.109321  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 1f5168daf09c45b4accfa213d5b29a43 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-1f5168daf09c45b4accfa213d5b29a43
I20260709 13:03:02.115556  8208 tablet_copy_source_session.cc:215] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:02.119171  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5168daf09c45b4accfa213d5b29a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:02.130424  9142 tablet_copy_client.cc:806] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:02.130892  9142 tablet_copy_client.cc:670] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:02.134812  9142 tablet_copy_client.cc:538] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:02.145519  9142 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:02.157604  9140 ts_tablet_manager.cc:933] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:02.159123  9140 tablet_copy_client.cc:323] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:02.160612  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet b3e62d20a8d54072882e6b574cdddee5 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:03:02.161077  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet b3e62d20a8d54072882e6b574cdddee5 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-b3e62d20a8d54072882e6b574cdddee5
I20260709 13:03:02.168026  8284 tablet_copy_source_session.cc:215] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:02.170873  9140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e62d20a8d54072882e6b574cdddee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:02.175880  9142 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:02.176789  9142 tablet_bootstrap.cc:492] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:02.177420  9142 ts_tablet_manager.cc:1403] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.012s
I20260709 13:03:02.180828  9142 raft_consensus.cc:359] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.181607  9142 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:02.182211  9142 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.184480  9142 ts_tablet_manager.cc:1434] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:02.186234  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-1f5168daf09c45b4accfa213d5b29a43 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:02.186605  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-1f5168daf09c45b4accfa213d5b29a43 on tablet 1f5168daf09c45b4accfa213d5b29a43 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:02.186766  9140 tablet_copy_client.cc:806] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:02.187314  9140 tablet_copy_client.cc:670] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:02.191249  9140 tablet_copy_client.cc:538] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:02.199659  9140 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:02.216164  9140 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:02.216904  9140 tablet_bootstrap.cc:492] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:02.217507  9140 ts_tablet_manager.cc:1403] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.018s	user 0.019s	sys 0.000s
I20260709 13:03:02.219841  9140 raft_consensus.cc:359] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.220604  9140 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:02.221045  9140 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:02.223033  9140 ts_tablet_manager.cc:1434] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:02.225772  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-b3e62d20a8d54072882e6b574cdddee5 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:02.226152  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-b3e62d20a8d54072882e6b574cdddee5 on tablet b3e62d20a8d54072882e6b574cdddee5 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:02.541118  8810 raft_consensus.cc:1217] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:02.555578  8810 raft_consensus.cc:1217] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:02.564872  8810 raft_consensus.cc:1217] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:02.606142  8810 raft_consensus.cc:1217] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:03.037389  9139 raft_consensus.cc:1064] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:03.089030  9139 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.093024  9154 raft_consensus.cc:1064] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:03.104840  9156 raft_consensus.cc:1064] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:03.105582  9159 raft_consensus.cc:1064] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:03.108368  9159 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.109165  9156 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.122655  9154 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.153658  8810 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.154394  8197 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.155722  9152 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:03.156808  8810 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.158591  9155 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:03.159109  9158 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:03.165365  8266 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.174901  9158 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:03.180155  8200 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.185030  9120 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:03.186736  8809 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.180212  8198 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.189599  8121 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.189476  9151 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:03.194276  8809 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.194782  8116 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.197253  9157 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:03.198859  8270 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.199486  9157 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:03.200374  9154 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:03.206801  8121 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:03.206108  9139 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:03:03.201237  9157 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:03:03.220094  9155 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:03.310066  9166 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:03.358299  9171 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.361374  8200 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.366408  9158 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.371578  9152 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.384114  8806 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.380374  8197 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.414844  8980 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:03.511490  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 91052.1us
I20260709 13:03:03.527998  8117 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.538924  8023 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:03.541371  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 142900us
I20260709 13:03:03.549078  8809 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.556190  8271 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.593956  8807 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.605517  8200 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.629019  8019 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:03.646122  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 57475.1us
I20260709 13:03:03.677163  8807 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.704897  8271 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.716820  8121 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.723083  8116 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.753466  8022 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.758556  8022 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.754663  8121 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.772024  8807 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.781682  9074 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.783286  8191 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.785794  9074 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.804572  9178 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.810011  8191 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.808490  8807 raft_consensus.cc:2955] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.829130  8271 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.836050  8266 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.844569  8809 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.845393  8121 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.848073  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45f9d10e30d545a18e699e9ccaea3e4e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:03.853761  9188 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:03.856907  9154 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.863157  8811 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.866596  9139 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.867210  9154 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.874095  8121 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.875365  8811 raft_consensus.cc:2955] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.880381  9171 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.883580  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3e62d20a8d54072882e6b574cdddee5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:03.884586  8191 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.886199  9152 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.895033  8191 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.897475  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d2c54c9c07a444898c0a63f323dfd5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:03.899883  8807 raft_consensus.cc:2955] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.911791  8022 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.924623  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet b3e62d20a8d54072882e6b574cdddee5 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:03:03.882551  8020 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.934262  8022 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.940961  9194 tablet_replica.cc:333] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:03:03.942281  9194 raft_consensus.cc:2243] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.962144  9194 raft_consensus.cc:2272] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.949249  8191 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:03.969296  9194 ts_tablet_manager.cc:1916] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:03.972420  8807 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.973999  9183 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.974653  8271 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:03.976135  9183 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.976753  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d2c54c9c07a444898c0a63f323dfd5d with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:03.985183  9181 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:03.990278  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 45f9d10e30d545a18e699e9ccaea3e4e with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:03.992973  8807 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:04.006722  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f5168daf09c45b4accfa213d5b29a43 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:04.013135  8019 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:04.016429  9194 ts_tablet_manager.cc:1929] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:04.017078  9194 log.cc:1199] T b3e62d20a8d54072882e6b574cdddee5 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/b3e62d20a8d54072882e6b574cdddee5
I20260709 13:03:04.016573  9196 tablet_replica.cc:333] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:03:04.018659  9195 tablet_replica.cc:333] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:03:04.018904  9196 raft_consensus.cc:2243] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.018996  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet b3e62d20a8d54072882e6b574cdddee5 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:04.019790  9195 raft_consensus.cc:2243] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.019973  9196 raft_consensus.cc:2272] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.020463  9195 raft_consensus.cc:2272] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.022039  8266 raft_consensus.cc:2955] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:04.025516  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5168daf09c45b4accfa213d5b29a43 with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:04.026088  9195 ts_tablet_manager.cc:1916] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:04.030117  9196 ts_tablet_manager.cc:1916] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:04.056370  9196 ts_tablet_manager.cc:1929] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:04.056846  9196 log.cc:1199] T 45f9d10e30d545a18e699e9ccaea3e4e P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/45f9d10e30d545a18e699e9ccaea3e4e
I20260709 13:03:04.058322  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 45f9d10e30d545a18e699e9ccaea3e4e (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:04.061659  9195 ts_tablet_manager.cc:1929] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:04.062103  9195 log.cc:1199] T 5d2c54c9c07a444898c0a63f323dfd5d P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/5d2c54c9c07a444898c0a63f323dfd5d
I20260709 13:03:04.063733  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 5d2c54c9c07a444898c0a63f323dfd5d (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:04.063902  9195 tablet_replica.cc:333] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:03:04.064944  9195 raft_consensus.cc:2243] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.065656  9195 raft_consensus.cc:2272] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.068365  9195 ts_tablet_manager.cc:1916] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:04.083959  9195 ts_tablet_manager.cc:1929] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:04.084251  9195 log.cc:1199] T 1f5168daf09c45b4accfa213d5b29a43 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/1f5168daf09c45b4accfa213d5b29a43
I20260709 13:03:04.085377  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 1f5168daf09c45b4accfa213d5b29a43 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:05.112352  8191 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.117873  8266 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:05.118172  8163 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0862042002d04bcbb6dd1a4c89ed990c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.118685  8118 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:05.119052  9181 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.119727  9183 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.135151  8271 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.133644  9183 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.135356  8118 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.150991  8019 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.155666  8266 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.163048  8191 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:05.163322  8237 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3771ea49d91a4d3f8c3b8c67db52b9ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.164521  9188 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.168596  8121 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:05.169989  9188 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.172747  9152 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.176102  8200 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.186254  8118 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.194836  8200 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.195896  8022 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.207561  8266 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:05.208801  8163 consensus_peers.cc:597] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b269caef5384838a52bcedc78464607. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.208845  9183 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:05.211899  8118 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:05.213411  9183 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.217567  9157 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.222244  8266 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.227034  8121 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.232437  8271 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.242192  8019 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.249871  8200 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:05.250330  8121 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:05.251005  8237 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09b5bde69aba40fd84e97b20005e3997. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.251329  9208 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.252569  9152 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.263404  9188 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.327214  8191 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.344978  8019 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.387673  8118 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:05.601933  9218 ts_tablet_manager.cc:933] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:05.604342  9218 tablet_copy_client.cc:323] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:03:05.606158  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 0862042002d04bcbb6dd1a4c89ed990c from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:03:05.606663  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 0862042002d04bcbb6dd1a4c89ed990c from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-0862042002d04bcbb6dd1a4c89ed990c
I20260709 13:03:05.613502  8208 tablet_copy_source_session.cc:215] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:05.616554  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0862042002d04bcbb6dd1a4c89ed990c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.632028  9218 tablet_copy_client.cc:806] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:05.632579  9218 tablet_copy_client.cc:670] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:05.636091  9218 tablet_copy_client.cc:538] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:05.644143  9218 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:05.662684  9218 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:05.663558  9218 tablet_bootstrap.cc:492] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:05.664201  9218 ts_tablet_manager.cc:1403] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:03:05.666406  9218 raft_consensus.cc:359] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.666965  9218 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:05.667451  9218 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.670499  9218 ts_tablet_manager.cc:1434] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:05.673454  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-0862042002d04bcbb6dd1a4c89ed990c received from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:05.673907  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-0862042002d04bcbb6dd1a4c89ed990c on tablet 0862042002d04bcbb6dd1a4c89ed990c with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:05.716048  9218 ts_tablet_manager.cc:933] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:05.721933  9218 tablet_copy_client.cc:323] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:03:05.723593  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 6b269caef5384838a52bcedc78464607 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:03:05.724963  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 6b269caef5384838a52bcedc78464607 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-6b269caef5384838a52bcedc78464607
I20260709 13:03:05.733494  8208 tablet_copy_source_session.cc:215] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:05.736488  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b269caef5384838a52bcedc78464607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.751744  9218 tablet_copy_client.cc:806] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:05.752270  9218 tablet_copy_client.cc:670] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:05.755384  9218 tablet_copy_client.cc:538] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:05.763841  9218 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:05.763937  9223 ts_tablet_manager.cc:933] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:05.770180  9223 tablet_copy_client.cc:323] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:05.771950  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:03:05.772711  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 3771ea49d91a4d3f8c3b8c67db52b9ab from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-3771ea49d91a4d3f8c3b8c67db52b9ab
I20260709 13:03:05.779645  8284 tablet_copy_source_session.cc:215] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:05.783147  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.783972  9218 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:05.784838  9218 tablet_bootstrap.cc:492] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:05.785480  9218 ts_tablet_manager.cc:1403] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.004s
I20260709 13:03:05.788369  9218 raft_consensus.cc:359] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.789145  9218 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:05.789772  9218 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.792361  9218 ts_tablet_manager.cc:1434] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:05.798197  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-6b269caef5384838a52bcedc78464607 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:05.798571  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-6b269caef5384838a52bcedc78464607 on tablet 6b269caef5384838a52bcedc78464607 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:05.809988  9223 tablet_copy_client.cc:806] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:05.810820  9223 tablet_copy_client.cc:670] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:05.815048  9223 tablet_copy_client.cc:538] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:05.821930  9223 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:05.829984  9218 ts_tablet_manager.cc:933] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:05.831998  9218 tablet_copy_client.cc:323] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:05.833540  8284 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 09b5bde69aba40fd84e97b20005e3997 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:03:05.834033  8284 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 09b5bde69aba40fd84e97b20005e3997 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-09b5bde69aba40fd84e97b20005e3997
I20260709 13:03:05.840318  9223 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:05.841220  9223 tablet_bootstrap.cc:492] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:05.841878  9223 ts_tablet_manager.cc:1403] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:03:05.842172  8284 tablet_copy_source_session.cc:215] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:05.845180  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b5bde69aba40fd84e97b20005e3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.844779  9223 raft_consensus.cc:359] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.847116  9223 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:05.847805  9223 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.850219  9223 ts_tablet_manager.cc:1434] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:03:05.863830  9218 tablet_copy_client.cc:806] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:05.864320  9218 tablet_copy_client.cc:670] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:05.865731  8284 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-3771ea49d91a4d3f8c3b8c67db52b9ab received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:05.866191  8284 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-3771ea49d91a4d3f8c3b8c67db52b9ab on tablet 3771ea49d91a4d3f8c3b8c67db52b9ab with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:05.869745  9218 tablet_copy_client.cc:538] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:05.876284  9218 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:05.890924  9218 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:05.891575  9218 tablet_bootstrap.cc:492] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:05.892012  9218 ts_tablet_manager.cc:1403] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:03:05.893869  9218 raft_consensus.cc:359] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.894367  9218 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:05.894920  9218 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:05.900215  9218 ts_tablet_manager.cc:1434] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:05.901645  8283 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-09b5bde69aba40fd84e97b20005e3997 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:05.902027  8283 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-09b5bde69aba40fd84e97b20005e3997 on tablet 09b5bde69aba40fd84e97b20005e3997 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:06.057623  8811 raft_consensus.cc:1217] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:06.180364  8811 raft_consensus.cc:1217] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:06.218690  8811 raft_consensus.cc:1217] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:06.243960  8811 raft_consensus.cc:1217] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:06.617583  9183 raft_consensus.cc:1064] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:06.621030  9229 raft_consensus.cc:1064] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:06.620937  9183 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.627377  9229 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.637001  8118 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.637010  8807 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.640866  8191 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.640966  8807 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.639420  9235 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.642342  9152 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.643051  8118 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.643122  9229 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.643051  8266 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.644483  9157 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.647361  9183 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.650679  9181 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.669495  9181 raft_consensus.cc:1064] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:06.671541  9181 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.689016  9183 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.699281  9152 raft_consensus.cc:1064] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:06.701521  9152 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.716380  8266 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.722065  8200 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.723389  9232 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.728366  9229 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:06.744541  8271 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.750504  8811 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:03:06.751766  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63855.6us
I20260709 13:03:06.753620  8811 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.759505  8118 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.756016  8019 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:06.761848  8807 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.775362  9249 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.782485  8118 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.795223  9232 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:06.806689  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 48989.2us
I20260709 13:03:06.810271  8116 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:06.799553  9232 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:03:06.821786  9254 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:03:06.843962  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62828.2us
I20260709 13:03:06.858867  8200 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.851667  9254 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:03:06.870558  8806 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.875283  8121 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.894161  9181 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.899147  9255 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.901153  8124 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.910331  8807 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.913156  8271 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.918759  8118 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.922508  8200 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.931547  8807 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.945641  8023 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.959615  8019 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:06.961419  8019 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.977296  8200 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.977628  8191 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.981905  8807 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:06.982368  8271 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.983721  9258 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:06.987128  8266 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:06.993733  8807 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:06.994185  8124 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:06.996651  8806 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:06.996908  9181 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:06.998201  8807 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:06.998845  9235 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.001859  8124 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:07.002125  9254 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.002756  9258 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.003423  8806 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.006426  9258 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:07.008575  9254 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.009370  9248 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.010891  8124 raft_consensus.cc:2955] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.014468  8116 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:07.014874  8811 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.015007  9258 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.018724  9183 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.018561  8807 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.023698  9216 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.025883  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0862042002d04bcbb6dd1a4c89ed990c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:07.028164  8121 raft_consensus.cc:2955] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.039119  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:07.044183  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09b5bde69aba40fd84e97b20005e3997 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:07.045607  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b269caef5384838a52bcedc78464607 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:07.047506  8116 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.048307  8023 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.067013  8200 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:07.068292  9248 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.071256  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 0862042002d04bcbb6dd1a4c89ed990c with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:07.071352  8019 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.074726  8807 raft_consensus.cc:2955] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.075809  8020 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.087625  8020 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.090952  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 3771ea49d91a4d3f8c3b8c67db52b9ab with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:03:07.082836  8191 raft_consensus.cc:2955] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:07.120321  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b5bde69aba40fd84e97b20005e3997 with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:07.121788  9269 tablet_replica.cc:333] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:03:07.122145  8261 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b269caef5384838a52bcedc78464607 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:07.122720  9269 raft_consensus.cc:2243] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.123420  9269 raft_consensus.cc:2272] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.134366  9270 tablet_replica.cc:333] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:03:07.139743  9270 raft_consensus.cc:2243] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.140444  9270 raft_consensus.cc:2272] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.137357  9269 ts_tablet_manager.cc:1916] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:07.143198  9268 tablet_replica.cc:333] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:03:07.150189  9268 raft_consensus.cc:2243] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.152130  9270 ts_tablet_manager.cc:1916] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:07.153853  9268 raft_consensus.cc:2272] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.157157  9268 ts_tablet_manager.cc:1916] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:07.159731  9269 ts_tablet_manager.cc:1929] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:07.160140  9269 log.cc:1199] T 3771ea49d91a4d3f8c3b8c67db52b9ab P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/3771ea49d91a4d3f8c3b8c67db52b9ab
I20260709 13:03:07.161695  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 3771ea49d91a4d3f8c3b8c67db52b9ab (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:07.166050  9270 ts_tablet_manager.cc:1929] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:07.166415  9270 log.cc:1199] T 09b5bde69aba40fd84e97b20005e3997 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/09b5bde69aba40fd84e97b20005e3997
I20260709 13:03:07.167634  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 09b5bde69aba40fd84e97b20005e3997 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:07.169170  9268 ts_tablet_manager.cc:1929] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:07.169593  9268 log.cc:1199] T 0862042002d04bcbb6dd1a4c89ed990c P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/0862042002d04bcbb6dd1a4c89ed990c
I20260709 13:03:07.171021  9268 tablet_replica.cc:333] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:03:07.171212  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 0862042002d04bcbb6dd1a4c89ed990c (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:07.171725  9268 raft_consensus.cc:2243] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.172307  9268 raft_consensus.cc:2272] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.174707  9268 ts_tablet_manager.cc:1916] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:07.184279  9268 ts_tablet_manager.cc:1929] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:07.184577  9268 log.cc:1199] T 6b269caef5384838a52bcedc78464607 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/6b269caef5384838a52bcedc78464607
I20260709 13:03:07.185832  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 6b269caef5384838a52bcedc78464607 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:08.008019  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:08.052983  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:08.053468  8266 raft_consensus.cc:606] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.055509  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26e50e42ace14a4db7be14613c771220"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:08.055866  8266 raft_consensus.cc:606] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.057753  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:08.058130  8266 raft_consensus.cc:606] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.060016  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60fac097ca0e444dbe442019479fc818"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:08.060336  8266 raft_consensus.cc:606] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.074119  8200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:08.074553  8200 raft_consensus.cc:606] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.076866  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:08.077316  8266 raft_consensus.cc:606] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.078236  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:08.079468  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:08.116403  9258 raft_consensus.cc:993] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.116901  9181 raft_consensus.cc:1081] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.118234  8811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40706
I20260709 13:03:08.118690  8811 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.118958  8811 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.123453  8811 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.128242  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:08.128839  8200 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.129161  8200 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:08.129609  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:08.130136  8266 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.129895  8200 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.130900  8200 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.136085  8266 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.137640  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:08.136515  8811 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.139231  9274 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.140004  8200 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.140280  9274 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:08.141695  9274 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.149940  8022 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.189885  8266 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.195958  8121 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:08.196278  8200 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:08.196610  8237 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 292514be4a7b4f768913b094de3d5d6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:08.197415  9216 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.198137  9255 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.210021  9216 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.214483  8121 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.217916  8200 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.227299  8118 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.234025  8022 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.238343  8271 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:08.237653  8088 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4e63fd519e64f52b42bde9b044f1a9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:08.239759  9267 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.240229  8200 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:08.241456  9231 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.255883  9231 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.261898  8191 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.273871  8266 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.277786  8022 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.288745  8271 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.300390  8200 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:08.301149  8121 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:08.301810  9216 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.302943  9235 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:08.305231  8237 consensus_peers.cc:597] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79c1b3089e984aa991014bbd831e7bfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:08.310014  9235 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.311506  8191 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.312032  8121 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.322732  8271 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.328622  8019 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:08.332536  8237 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cf74acfb5ea42d6ab6d4dfdb9067cd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:08.337462  8121 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:08.338465  8191 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:08.339432  9235 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.340225  9216 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.349591  9285 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.352721  8191 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.352174  8118 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.377396  8022 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:08.386169  9216 raft_consensus.cc:993] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.386600  9286 raft_consensus.cc:1081] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.388080  8807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40718
I20260709 13:03:08.388531  8807 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.388841  8807 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.392805  8807 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.394589  8807 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.395184  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:08.395691  8271 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.395955  8271 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:08.396535  8271 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.397362  8271 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.398200  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:08.399191  8191 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.407155  9285 raft_consensus.cc:993] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.407644  9216 raft_consensus.cc:1081] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.409111  8807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40718
I20260709 13:03:08.409543  8191 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.410449  8775 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:08.411274  9274 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.411708  9274 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:08.412492  8271 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.412742  9274 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.409977  8807 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.418089  8807 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.424693  8807 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.427520  8807 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.427453  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:08.427145  8022 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.427428  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:08.428574  8270 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.428829  8270 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:08.429556  8118 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.429525  8270 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.430852  8270 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.435670  8118 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.436894  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:08.437695  9274 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.438736  9274 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:08.439407  8270 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.439571  9274 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.455902  8022 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.468701  9216 raft_consensus.cc:993] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.469197  9216 raft_consensus.cc:1081] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.470577  8807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60fac097ca0e444dbe442019479fc818"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40718
I20260709 13:03:08.470952  8807 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.471201  8807 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.475342  8807 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.476894  8807 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.477906  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:08.478380  8270 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.478322  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:08.478705  8270 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:08.478928  8121 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.479254  8270 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.480043  8270 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.484746  8121 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.485644  8270 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.485899  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:08.486619  9274 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.487071  9274 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:08.487876  9274 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.495669  8022 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.538779  9216 raft_consensus.cc:993] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.539306  9285 raft_consensus.cc:1081] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.540477  8807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40718
I20260709 13:03:08.540871  8807 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.541123  8807 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.545025  8807 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.546375  8807 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.546985  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:08.547380  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:08.547760  8121 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.548053  8270 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.548305  8270 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:08.548848  8270 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.549942  8270 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.556100  8270 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.557113  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:08.557860  9274 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.558305  9274 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:08.559088  9274 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.561731  8121 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.572301  8022 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.575332  8191 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.583027  9274 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.610169  8270 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.611701  9274 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.674443  9216 raft_consensus.cc:993] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.674883  9285 raft_consensus.cc:1081] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:08.676200  8807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26e50e42ace14a4db7be14613c771220"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40718
I20260709 13:03:08.676609  8807 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.676867  8807 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.681474  8807 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.683633  8807 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.683785  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:08.684320  8191 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.684717  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:08.685235  8270 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.685530  8270 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:08.686241  8270 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.687345  8270 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.690799  8191 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.692144  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:08.692962  9275 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.693459  9275 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:08.694310  9275 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:08.701100  8270 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:08.707647  8022 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.734601  9310 ts_tablet_manager.cc:933] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:03:08.736986  9310 tablet_copy_client.cc:323] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:03:08.738724  8135 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet a4e63fd519e64f52b42bde9b044f1a9d from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:03:08.739243  8135 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet a4e63fd519e64f52b42bde9b044f1a9d from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-a4e63fd519e64f52b42bde9b044f1a9d
I20260709 13:03:08.745651  8135 tablet_copy_source_session.cc:215] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:08.748597  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e63fd519e64f52b42bde9b044f1a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:08.766083  9310 tablet_copy_client.cc:806] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:08.766619  9310 tablet_copy_client.cc:670] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:08.770233  9310 tablet_copy_client.cc:538] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:08.776808  9310 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:08.802805  9313 ts_tablet_manager.cc:933] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.805871  9313 tablet_copy_client.cc:323] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:08.807318  8283 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 292514be4a7b4f768913b094de3d5d6d from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:03:08.807869  8283 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 292514be4a7b4f768913b094de3d5d6d from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-292514be4a7b4f768913b094de3d5d6d
I20260709 13:03:08.812422  9310 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:08.813895  9310 tablet_bootstrap.cc:492] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:08.814647  9310 ts_tablet_manager.cc:1403] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.038s	user 0.031s	sys 0.004s
I20260709 13:03:08.818081  9310 raft_consensus.cc:359] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.818917  9310 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:08.819197  8283 tablet_copy_source_session.cc:215] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:08.819633  9310 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.822072  9310 ts_tablet_manager.cc:1434] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:08.824361  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292514be4a7b4f768913b094de3d5d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:08.828428  8135 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-a4e63fd519e64f52b42bde9b044f1a9d received from {username='slave'} at 127.0.0.1:53286
I20260709 13:03:08.828873  8135 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-a4e63fd519e64f52b42bde9b044f1a9d on tablet a4e63fd519e64f52b42bde9b044f1a9d with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.836663  8191 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.837893  9275 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.842206  9313 tablet_copy_client.cc:806] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:08.842979  9313 tablet_copy_client.cc:670] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:08.854281  8270 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.857113  9313 tablet_copy_client.cc:538] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:08.865658  9275 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.866698  9313 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:08.874599  8118 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.878053  9275 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.892601  9310 ts_tablet_manager.cc:933] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.911088  9310 tablet_copy_client.cc:323] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:08.909212  9313 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:08.912962  9313 tablet_bootstrap.cc:492] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:08.912891  8283 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:03:08.913560  8283 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-8cf74acfb5ea42d6ab6d4dfdb9067cd9
I20260709 13:03:08.921208  8283 tablet_copy_source_session.cc:215] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:08.925077  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:08.926270  8270 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.930733  9275 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.937458  9313 ts_tablet_manager.cc:1403] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.003s
I20260709 13:03:08.947067  9313 raft_consensus.cc:359] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.950657  9313 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:08.951776  9313 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:08.958242  9313 ts_tablet_manager.cc:1434] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:03:08.960192  8283 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-292514be4a7b4f768913b094de3d5d6d received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:08.960662  8283 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-292514be4a7b4f768913b094de3d5d6d on tablet 292514be4a7b4f768913b094de3d5d6d with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:08.966166  9313 ts_tablet_manager.cc:933] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:08.970082  8121 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:08.972662  9310 tablet_copy_client.cc:806] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:08.973207  9310 tablet_copy_client.cc:670] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:08.975899  9275 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.976894  9310 tablet_copy_client.cc:538] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:09.010530  9313 tablet_copy_client.cc:323] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:03:09.012668  8283 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet 79c1b3089e984aa991014bbd831e7bfc from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
W20260709 13:03:09.014050  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 87845.8us
I20260709 13:03:09.013207  8283 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet 79c1b3089e984aa991014bbd831e7bfc from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-79c1b3089e984aa991014bbd831e7bfc
I20260709 13:03:09.015636  9310 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:09.025103  8270 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.028255  9275 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.037696  8283 tablet_copy_source_session.cc:215] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:09.042625  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1b3089e984aa991014bbd831e7bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.057461  9310 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:09.058395  9310 tablet_bootstrap.cc:492] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:09.059089  9310 ts_tablet_manager.cc:1403] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.001s
W20260709 13:03:09.061219  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 158411us
I20260709 13:03:09.061677  9310 raft_consensus.cc:359] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:09.073163  9310 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:09.073797  9310 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:09.076021  9310 ts_tablet_manager.cc:1434] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 13:03:09.077497  8283 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-8cf74acfb5ea42d6ab6d4dfdb9067cd9 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:09.077905  8283 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-8cf74acfb5ea42d6ab6d4dfdb9067cd9 on tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:09.080330  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.093796  9313 tablet_copy_client.cc:806] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:09.094452  9313 tablet_copy_client.cc:670] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:09.098227  9313 tablet_copy_client.cc:538] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:09.100839  8270 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.102741  9307 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.124920  8121 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.125768  9313 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:09.126267  9275 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.159065  9313 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:09.160252  9313 tablet_bootstrap.cc:492] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:09.160993  9313 ts_tablet_manager.cc:1403] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.010s
I20260709 13:03:09.166826  9313 raft_consensus.cc:359] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:09.167657  9313 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:09.168666  9313 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:09.171269  9313 ts_tablet_manager.cc:1434] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:09.172744  8283 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-79c1b3089e984aa991014bbd831e7bfc received from {username='slave'} at 127.0.0.1:34584
I20260709 13:03:09.173111  8283 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-79c1b3089e984aa991014bbd831e7bfc on tablet 79c1b3089e984aa991014bbd831e7bfc with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:09.175946  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.221480  8200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:09.221961  8200 raft_consensus.cc:606] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:09.229683  8200 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.230360  8191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:09.230913  8191 raft_consensus.cc:606] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:09.231187  9307 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.235920  9181 raft_consensus.cc:993] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:09.236188  8200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:09.236814  8200 raft_consensus.cc:606] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:09.236285  9181 raft_consensus.cc:1081] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:09.239183  8197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:09.239674  8197 raft_consensus.cc:606] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:09.240480  8811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40706
I20260709 13:03:09.240984  8811 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.241335  8811 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.244576  8270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:09.245074  8270 raft_consensus.cc:606] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:09.246966  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:09.248428  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:09.251400  8270 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.252948  9274 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.254724  8811 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.257022  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:09.257557  8118 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.258323  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:09.258818  8191 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.259090  8191 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:09.259809  8191 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.260713  8191 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.268087  8118 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:09.270856  8191 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:09.257150  8811 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:09.272074  8774 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:09.275704  9274 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.279398  9274 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:09.281296  9274 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.320439  8811 raft_consensus.cc:1217] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:09.332597  8022 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.381242  8811 raft_consensus.cc:1217] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:09.384785  9322 raft_consensus.cc:993] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:09.385318  9181 raft_consensus.cc:1081] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:09.386853  8271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44554
I20260709 13:03:09.387326  8271 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.387651  8271 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.395071  8271 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.397675  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:09.397864  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:09.397964  8271 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:09.398173  8200 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.398591  8118 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.398605  8200 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:09.399456  8200 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.400607  8200 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.405405  8118 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:09.406292  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:09.406917  9285 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.407292  9285 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:09.408812  9285 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.410791  8200 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:09.422425  8021 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.459257  8811 raft_consensus.cc:1217] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:09.468808  9322 raft_consensus.cc:993] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:09.469275  9181 raft_consensus.cc:1081] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:09.470721  8270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44554
I20260709 13:03:09.471109  8270 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.471472  8270 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.477632  8270 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.479888  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:09.480405  8118 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.484956  8118 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:09.486207  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:09.486971  9342 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.488005  9342 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:09.489269  9342 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.487900  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:09.491149  8198 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.491454  8198 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:09.492111  8198 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.493112  8198 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.501430  8198 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:09.505906  8270 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:09.512806  9181 raft_consensus.cc:993] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:09.513203  9301 raft_consensus.cc:1081] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:09.514740  8121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50790
I20260709 13:03:09.515204  8121 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.515529  8121 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.523439  8121 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.530820  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:09.531154  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:09.531443  8198 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.531706  8270 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.531756  8198 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:09.532686  8198 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.533885  8198 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.533284  8022 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.530093  8121 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:09.541311  8270 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:09.542598  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:09.543520  9320 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.543978  9320 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:09.544759  9320 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.545043  8811 raft_consensus.cc:1217] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:09.551633  8198 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:09.576426  8023 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.716763  9320 raft_consensus.cc:1064] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:09.718809  9320 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.725605  8198 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.725873  8811 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.726709  9231 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:09.727849  8270 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.728392  9320 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:09.732105  9231 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:09.746660  9231 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.750540  8811 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.750806  8270 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.764106  8023 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.766675  8198 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.781855  9285 raft_consensus.cc:993] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:09.782306  9285 raft_consensus.cc:1081] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:09.786310  8121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50784
I20260709 13:03:09.786801  8121 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.787108  8121 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.797629  8121 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.799422  8121 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:09.800592  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:09.801183  8198 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.803288  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:09.803884  8270 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.804181  8270 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:09.807044  8198 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:09.806915  8270 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.807976  8270 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.811735  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:09.812829  9231 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.813256  9231 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:09.813148  8121 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.814134  9231 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:09.818532  8811 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:09.820154  9326 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:09.828924  9320 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.832648  8118 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.835527  9342 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.836272  8270 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:09.841209  8200 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:09.844859  8200 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.844410  8811 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.846494  9336 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.850138  8118 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.854115  9336 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.860055  9216 raft_consensus.cc:1064] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:09.861057  9286 raft_consensus.cc:1064] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:09.862232  9216 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.863420  9286 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:09.876554  8191 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.878211  9342 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.883980  8807 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.885602  9285 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:09.885913  9231 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:09.905211  8198 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.915799  8023 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:09.931665  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 76610.7us
I20260709 13:03:09.934520  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet a4e63fd519e64f52b42bde9b044f1a9d with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:09.942570  8116 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.946568  8198 raft_consensus.cc:2955] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:09.950762  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4e63fd519e64f52b42bde9b044f1a9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:03:09.953598  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47218.9us
I20260709 13:03:09.957556  8197 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.959318  9285 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:09.966580  8022 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.983246  9360 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:03:09.999341  8122 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:09.999821  8118 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:10.000491  9362 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:10.003193  8193 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.010896  9216 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.014016  8807 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:10.026132  8271 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.033169  9350 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:10.052978  9363 tablet_replica.cc:333] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:03:10.066464  9363 raft_consensus.cc:2243] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.071233  9363 raft_consensus.cc:2272] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.077889  9363 ts_tablet_manager.cc:1916] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:10.103226  9360 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:10.110854  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 96267.5us
I20260709 13:03:10.120419  9342 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.121138  9216 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.122654  8193 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.125906  9351 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.126055  8198 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.130934  9363 ts_tablet_manager.cc:1929] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:10.131364  9363 log.cc:1199] T a4e63fd519e64f52b42bde9b044f1a9d P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/a4e63fd519e64f52b42bde9b044f1a9d
I20260709 13:03:10.133368  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet a4e63fd519e64f52b42bde9b044f1a9d (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:10.143985  9286 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.148028  8807 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.170840  8122 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.183809  9216 raft_consensus.cc:1064] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:10.187337  9216 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:10.201622  8198 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:10.203164  9362 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.204860  8811 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:10.163214  8021 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.209407  9216 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.225585  8121 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:10.228571  9216 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.237815  9359 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.249818  8271 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:10.258836  8121 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.261014  8806 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:10.263950  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.264343  8197 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.269855  9362 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:10.272688  8806 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.279670  9285 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.279685  8198 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:10.283634  9216 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:10.292356  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 292514be4a7b4f768913b094de3d5d6d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:10.291131  8198 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.295125  8809 raft_consensus.cc:2955] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.302610  8020 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.323618  9359 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.326534  8019 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.326872  8271 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:10.337304  8811 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.342414  8809 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:10.345326  9359 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:10.343662  8197 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.345923  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 292514be4a7b4f768913b094de3d5d6d with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:10.358063  9216 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.361291  8270 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.364689  9350 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.359437  9386 tablet_replica.cc:333] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:03:10.374765  9386 raft_consensus.cc:2243] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.375533  9386 raft_consensus.cc:2272] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.338369  8198 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:10.381842  9362 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:10.383648  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:10.384104  9386 ts_tablet_manager.cc:1916] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:10.435410  8198 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.436914  9350 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.440924  8019 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.404098  8118 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.387660  8197 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.405963  8806 raft_consensus.cc:2955] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.473785  8021 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 4, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.490664  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:10.501169  9386 ts_tablet_manager.cc:1929] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:10.501735  9386 log.cc:1199] T 292514be4a7b4f768913b094de3d5d6d P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/292514be4a7b4f768913b094de3d5d6d
I20260709 13:03:10.504029  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 292514be4a7b4f768913b094de3d5d6d (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:10.506536  9386 tablet_replica.cc:333] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:03:10.507565  9386 raft_consensus.cc:2243] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.510123  9386 raft_consensus.cc:2272] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.517195  9386 ts_tablet_manager.cc:1916] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:10.530287  8271 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:10.537624  8806 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:10.539913  9386 ts_tablet_manager.cc:1929] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:10.540488  9386 log.cc:1199] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/8cf74acfb5ea42d6ab6d4dfdb9067cd9
I20260709 13:03:10.541644  9362 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:10.542096  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet 8cf74acfb5ea42d6ab6d4dfdb9067cd9 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:10.539970  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.540123  8118 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:10.547814  9216 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:10.560616  9359 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.569115  8811 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.575654  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79c1b3089e984aa991014bbd831e7bfc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:10.576689  8118 raft_consensus.cc:2955] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:10.585577  8023 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 3 to 4, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 1 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.599768  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:10.600312  8271 raft_consensus.cc:606] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:10.602856  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 79c1b3089e984aa991014bbd831e7bfc with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50476
I20260709 13:03:10.616377  9390 tablet_replica.cc:333] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:03:10.617113  9390 raft_consensus.cc:2243] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:10.618050  9390 raft_consensus.cc:2272] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:10.621410  9390 ts_tablet_manager.cc:1916] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:10.623323  8118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:10.623844  8118 raft_consensus.cc:606] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:10.626386  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:10.626875  8121 raft_consensus.cc:606] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:10.629251  8198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:10.629758  8198 raft_consensus.cc:606] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:10.631906  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:10.632330  8271 raft_consensus.cc:606] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:10.633689  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:10.634687  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:10.641790  9390 ts_tablet_manager.cc:1929] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:10.642201  9390 log.cc:1199] T 79c1b3089e984aa991014bbd831e7bfc P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/79c1b3089e984aa991014bbd831e7bfc
I20260709 13:03:10.643785  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 79c1b3089e984aa991014bbd831e7bfc (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:03:10.756179  9216 raft_consensus.cc:993] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:10.756644  9359 raft_consensus.cc:1081] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:10.758121  8118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50784
I20260709 13:03:10.758519  8118 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.758746  8118 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.762657  8118 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:10.763963  8118 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:10.764516  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:10.764786  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:10.765022  8198 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.765272  8271 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.765584  8271 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:10.766227  8271 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:10.767138  8271 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.769955  8198 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:10.770823  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:10.771423  8271 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:10.771477  9231 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.771921  9231 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:10.772630  9231 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:10.782858  8020 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.898787  9359 raft_consensus.cc:993] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:10.899173  9216 raft_consensus.cc:1081] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:10.900442  8118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50784
I20260709 13:03:10.900938  8118 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.901298  8118 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.906028  8118 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:10.907549  8118 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:10.908075  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:10.908293  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:10.908615  8198 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.908799  8271 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:10.909124  8271 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:10.909797  8271 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:10.910861  8271 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.915572  8198 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:10.916517  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:10.917155  9231 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:10.917596  9231 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:10.918448  9231 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:10.917536  8271 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:10.925623  8020 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 2 to 3, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.985163  9301 raft_consensus.cc:993] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:10.985649  9181 raft_consensus.cc:1081] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:10.987569  8811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40706
I20260709 13:03:10.988039  8811 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.988292  8811 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.989969  9231 raft_consensus.cc:993] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:10.990375  9231 raft_consensus.cc:1081] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:10.992609  8271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:03:10.993130  8271 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.993496  8271 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.995189  8811 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:10.997746  8811 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:10.998246  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:10.998626  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:10.998775  8118 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.001185  8198 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.001456  8198 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:11.002130  8198 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.003095  8198 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.003749  8271 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:11.005890  8118 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:11.006069  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:11.006317  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:11.006675  8121 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.006816  8197 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.007028  8121 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:11.007750  8121 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:11.008399  8198 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:11.008646  8121 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.009455  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:11.011049  8197 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:11.011632  8271 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:11.012007  8238 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:11.012679  9216 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.010951  9274 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.013878  9216 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:11.014618  9216 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:11.016382  8121 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:11.022253  9274 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:11.023126  9274 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.025317  8020 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.035063  8023 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.093662  9350 raft_consensus.cc:993] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:11.094112  9326 raft_consensus.cc:1081] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:11.095297  8811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40700
I20260709 13:03:11.095691  8811 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.095927  8811 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.100171  8811 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.101558  8811 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:11.102087  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:11.102383  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:11.102587  8121 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.102852  8271 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.102872  8121 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:11.103737  8121 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.104732  8121 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.107801  8271 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:11.108640  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:11.109289  8121 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:11.109967  9274 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.111129  9274 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:11.111897  9274 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.118906  8023 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.353052  8198 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.354066  9326 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.358680  8271 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:11.360013  9326 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:11.367260  8270 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.368595  9231 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.389667  8197 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:11.391181  9326 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:11.495750  8193 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:11.497437  9393 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:11.508985  8121 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:11.514436  8121 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:11.514626  9393 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:11.517127  9393 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:11.526364  8118 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.528421  8270 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:11.529241  9216 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.529640  9274 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:11.547721  8198 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.548955  9359 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.635476  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.665587  8121 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:11.671937  8270 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:11.672474  8088 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccbf67588374458ebbd07bc5aeeb3b5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:11.673305  9403 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.674664  8198 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.677707  9403 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.686432  9231 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.687387  8198 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.689483  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.698257  8270 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.704226  8020 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.709021  8198 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:11.727600  8270 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:11.727869  8163 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19747a1b37df480faebc96d93689cda5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:11.728880  8121 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.731644  9181 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.733336  9181 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.755008  9400 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.756479  8121 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.757227  8270 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.766433  8198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:11.766995  8198 raft_consensus.cc:606] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:11.771335  8198 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:11.772264  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:11.772821  8121 raft_consensus.cc:606] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Received request to transfer leadership to TS 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:11.774837  8021 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.778365  8191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:11.778882  8191 raft_consensus.cc:606] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:11.785687  8270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:11.786202  8270 raft_consensus.cc:606] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:11.786280  8271 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.788607  9181 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:11.792691  8163 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e848f577948c470fb4c95fcc2b55b7ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:11.794535  8118 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.796401  9301 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.801211  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:11.804625  8121 raft_consensus.cc:606] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:11.804852  9400 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.807092  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:11.808560  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:11.809671  8122 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.819092  8118 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:11.815729  8270 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.824256  8020 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:11.906978  8088 consensus_peers.cc:597] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f5cf690845d47f4a2d4e3ab5d8922c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:11.909914  8270 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.910609  8198 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.911737  9350 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.912559  9326 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.937880  9429 raft_consensus.cc:993] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:11.938319  9429 raft_consensus.cc:1081] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:11.938473  9326 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.942116  8193 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.948582  8118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50790
I20260709 13:03:11.949097  8118 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.949416  8118 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.950961  8270 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.965006  8118 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.970273  8023 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 2, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 1 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:11.979221  8118 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:11.985180  9216 raft_consensus.cc:993] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:03:11.985296  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:11.985976  8806 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.986958  9216 raft_consensus.cc:1081] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:03:11.988611  8191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50482
I20260709 13:03:11.989107  8191 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.989456  8191 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.994601  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:11.995229  8198 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.995541  8198 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:11.996387  8198 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:11.997546  8198 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.997238  8191 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.001679  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:12.001606  8806 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:12.003285  8270 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.003605  8270 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:12.004133  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:12.004330  8270 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.005010  9435 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.005328  8270 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.005466  9435 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:12.006404  9435 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.008862  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:12.009387  8811 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.014946  8191 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:12.017421  8811 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:12.018067  8270 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:12.018527  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:12.019426  9433 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.019961  9433 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:12.019392  8198 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:12.020936  9433 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.032102  8020 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.035009  8021 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.069236  9436 raft_consensus.cc:993] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:12.069715  9436 raft_consensus.cc:1081] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Signalling peer 17c126976afd40d9a398d13a5ddd222f to start an election
I20260709 13:03:12.071022  8806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
 from {username='slave'} at 127.0.0.1:40700
I20260709 13:03:12.071431  8806 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.071698  8806 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.077389  9435 raft_consensus.cc:993] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:12.077891  9435 raft_consensus.cc:1081] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:03:12.080209  8270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:03:12.080727  8270 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.081039  8270 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.087536  8806 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.089046  8270 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:12.090588  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:12.091192  8118 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.091461  8118 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:12.091790  8270 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:12.092805  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:12.093442  8191 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.093146  8118 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.094274  8118 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.098770  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:12.099359  8193 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.099956  8191 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:12.101042  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:12.101776  9216 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.102267  9216 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:12.102942  8118 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:12.104224  8806 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:12.104539  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:12.102972  9216 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:12.106118  9274 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.106626  9274 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:12.106020  8193 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:12.107448  9274 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:12.109834  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:12.110357  8122 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.110608  8122 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:12.111230  8122 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:12.122411  8122 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.121201  8021 catalog_manager.cc:5697] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.129081  9400 raft_consensus.cc:993] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:12.129637  9400 raft_consensus.cc:1081] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:12.131186  8117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50790
I20260709 13:03:12.131732  8117 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.132076  8117 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.137754  8122 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:12.141918  8117 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:12.143788  8117 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:12.144472  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:12.144994  8198 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.145275  8198 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:12.145646  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:12.146152  8271 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.146086  8198 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:12.147266  8198 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.148713  8021 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.152302  8271 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:12.153643  8091 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:12.154384  9403 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.154814  9403 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:12.155928  9403 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:12.156529  8198 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:12.176934  9441 ts_tablet_manager.cc:933] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:12.177486  9442 ts_tablet_manager.cc:933] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:12.180209  9441 tablet_copy_client.cc:323] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:03:12.181739  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet e848f577948c470fb4c95fcc2b55b7ef from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:03:12.182226  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet e848f577948c470fb4c95fcc2b55b7ef from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-e848f577948c470fb4c95fcc2b55b7ef
I20260709 13:03:12.184214  8021 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.189613  8208 tablet_copy_source_session.cc:215] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:12.191205  9442 tablet_copy_client.cc:323] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:03:12.193035  8208 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 19747a1b37df480faebc96d93689cda5 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:03:12.193676  8208 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 19747a1b37df480faebc96d93689cda5 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-19747a1b37df480faebc96d93689cda5
I20260709 13:03:12.202279  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848f577948c470fb4c95fcc2b55b7ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:12.202625  8208 tablet_copy_source_session.cc:215] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:12.206663  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19747a1b37df480faebc96d93689cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:12.235651  9446 ts_tablet_manager.cc:933] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:03:12.238684  9447 ts_tablet_manager.cc:933] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:03:12.246414  9446 tablet_copy_client.cc:323] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:03:12.247964  8135 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet ccbf67588374458ebbd07bc5aeeb3b5a from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:03:12.248503  8135 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet ccbf67588374458ebbd07bc5aeeb3b5a from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-ccbf67588374458ebbd07bc5aeeb3b5a
I20260709 13:03:12.253851  9447 tablet_copy_client.cc:323] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:03:12.255749  8134 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:03:12.256238  8134 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-2f5cf690845d47f4a2d4e3ab5d8922c0
I20260709 13:03:12.256402  8135 tablet_copy_source_session.cc:215] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:12.260627  9441 tablet_copy_client.cc:806] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:12.261174  9441 tablet_copy_client.cc:670] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:12.265161  9442 tablet_copy_client.cc:806] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:12.265313  9446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbf67588374458ebbd07bc5aeeb3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:12.265789  9442 tablet_copy_client.cc:670] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:12.267927  8134 tablet_copy_source_session.cc:215] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:12.270004  9441 tablet_copy_client.cc:538] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:12.272192  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:12.278465  9442 tablet_copy_client.cc:538] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:12.285907  9446 tablet_copy_client.cc:806] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:12.286437  9446 tablet_copy_client.cc:670] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:12.290723  9446 tablet_copy_client.cc:538] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:12.292676  9441 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:12.294425  9447 tablet_copy_client.cc:806] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:12.294924  9447 tablet_copy_client.cc:670] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:12.297295  9442 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:12.302605  9446 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:12.306728  9447 tablet_copy_client.cc:538] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:12.321179  9447 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:03:12.346858  9441 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:12.347834  9441 tablet_bootstrap.cc:492] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:12.348513  9441 ts_tablet_manager.cc:1403] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.008s
I20260709 13:03:12.381069  9441 raft_consensus.cc:359] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.384918  9446 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:12.391322  9446 tablet_bootstrap.cc:492] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:12.392390  9441 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:12.393395  9441 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.398422  9446 ts_tablet_manager.cc:1403] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.096s	user 0.024s	sys 0.014s
I20260709 13:03:12.404970  8806 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:12.409648  9441 ts_tablet_manager.cc:1434] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.003s
I20260709 13:03:12.410895  9442 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:12.412030  9442 tablet_bootstrap.cc:492] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:12.412892  9442 ts_tablet_manager.cc:1403] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.116s	user 0.034s	sys 0.004s
I20260709 13:03:12.416102  9442 raft_consensus.cc:359] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.586277  9442 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:12.587018  9442 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.419710  9446 raft_consensus.cc:359] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.589156  9446 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:12.589934  9446 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.591742  9446 ts_tablet_manager.cc:1434] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.193s	user 0.004s	sys 0.002s
I20260709 13:03:12.690995  9447 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:12.692181  9447 tablet_bootstrap.cc:492] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:03:12.729228  9442 ts_tablet_manager.cc:1434] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.316s	user 0.003s	sys 0.004s
I20260709 13:03:12.745287  9447 ts_tablet_manager.cc:1403] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.424s	user 0.020s	sys 0.015s
I20260709 13:03:12.748304  9447 raft_consensus.cc:359] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.749226  9447 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:03:12.749979  9447 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:12.752542  9447 ts_tablet_manager.cc:1434] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:12.766470  8135 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-2f5cf690845d47f4a2d4e3ab5d8922c0 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:03:12.767021  8135 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-2f5cf690845d47f4a2d4e3ab5d8922c0 on tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:12.845695  8198 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:12.855726  9274 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:13.000483  8118 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:13.360975  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 159658us
I20260709 13:03:13.408133  9463 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:13.407562  9454 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.410754  9454 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.413139  9454 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.430240  9454 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:13.430822  9454 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.432842  9454 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:13.513899  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 105431us
I20260709 13:03:13.585866  9464 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.586433  9464 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.588415  9464 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:13.729595  8088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.004s	sys 0.004s
W20260709 13:03:13.730399  8088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.005s	sys 0.004s
I20260709 13:03:13.739323  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:13.724797  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.748586  9459 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.754323  9454 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.753535  9459 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.755213  9454 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.761204  9455 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.762290  9455 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.775777  9454 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.777143  9454 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.778272  9454 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.780515  9454 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.782308  9465 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.783059  9465 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.787276  9466 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.788028  9466 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.790452  9466 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.797035  9470 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.797574  9469 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.798019  9470 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.798318  9469 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.768810  9459 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.795660  9464 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.800320  9459 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.800541  9464 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.801179  9459 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.803376  9464 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.803995  9469 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.803966  9464 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.804617  9459 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.804992  9464 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.807088  9470 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.808678  9465 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.799489  9466 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.819574  9466 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.822234  9466 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.824661  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:13.827936  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:13.833166  9470 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.834609  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:13.835464  8198 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:13.836426  9473 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.838090  9459 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.840400  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:13.840878  9459 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.844727  9459 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.834563  9470 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.845485  8208 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-e848f577948c470fb4c95fcc2b55b7ef received from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:13.845958  9433 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.846165  8208 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-e848f577948c470fb4c95fcc2b55b7ef on tablet e848f577948c470fb4c95fcc2b55b7ef with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:13.846690  9433 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.847327  8208 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:36640 (request call id 79) took 1098 ms. Trace:
I20260709 13:03:13.829833  9469 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.850469  8134 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-ccbf67588374458ebbd07bc5aeeb3b5a received from {username='slave'} at 127.0.0.1:53286
I20260709 13:03:13.851035  8134 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-ccbf67588374458ebbd07bc5aeeb3b5a on tablet ccbf67588374458ebbd07bc5aeeb3b5a with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:13.851565  9473 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.859521  9469 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.852243  8134 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:53286 (request call id 70) took 1091 ms. Trace:
I20260709 13:03:13.857672  8121 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:13.862854  9468 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.830220  9466 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.847783  8208 rpcz_store.cc:276] 0709 13:03:12.748969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.845127 (+1096158us) service_pool.cc:224] Handling call
0709 13:03:13.847263 (+  2136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:13.864148  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 72) took 1102 ms. Trace:
I20260709 13:03:13.864934  9468 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.865310  8121 rpcz_store.cc:276] 0709 13:03:12.761009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.856553 (+1095544us) service_pool.cc:224] Handling call
0709 13:03:13.857162 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.862314 (+  5152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.863528 (+  1214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:13.858839  9470 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.870885  9454 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.871860  9454 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.874514  9454 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.874720  9468 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.875260  9472 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.880585  9467 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.882126  9465 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.882835  9465 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.883270  8194 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:13.883996  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1292) took 1135 ms. Trace:
I20260709 13:03:13.862257  8134 rpcz_store.cc:276] 0709 13:03:12.760456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.850104 (+1089648us) service_pool.cc:224] Handling call
0709 13:03:13.852174 (+  2070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:13.867268  9464 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.881472  9467 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.889503  9467 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.890972  9469 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.891633  9433 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.879254  9472 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.865816  9459 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.891717  9468 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.884347  8194 rpcz_store.cc:276] 0709 13:03:12.748115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.882149 (+1134034us) service_pool.cc:224] Handling call
0709 13:03:13.882641 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.883698 (+  1057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.883939 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:13.904138  9465 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.902861  9466 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.910472  9464 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.911257  9466 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.912779  9472 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.913682  9459 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:13.914108  9468 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.895287  9473 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.922765  8209 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-19747a1b37df480faebc96d93689cda5 received from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:13.923295  8209 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-19747a1b37df480faebc96d93689cda5 on tablet 19747a1b37df480faebc96d93689cda5 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:13.923754  9475 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.942658  9481 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.943362  9481 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.945679  9481 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.946208  9481 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.946846  9481 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:13.948895  9481 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:13.949381  9481 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.949935  9481 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.951917  9481 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:13.924705  9475 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:13.954420  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 48531.8us
I20260709 13:03:13.953224  9433 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.959049  9433 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:13.960554  9454 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.961259  9454 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.963016  8209 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:36640 (request call id 84) took 1115 ms. Trace:
I20260709 13:03:13.963523  9454 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.963462  8209 rpcz_store.cc:276] 0709 13:03:12.847104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.922479 (+1075375us) service_pool.cc:224] Handling call
0709 13:03:13.962924 (+ 40445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:13.957046  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:13.941681  9468 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.961820  9459 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:13.911264  9464 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.973130  9465 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.975039  9454 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.977231  9466 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.982255  9478 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.983357  9478 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.987987  9471 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.990890  9466 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:03:14.003624  8775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.009s	sys 0.019s
I20260709 13:03:13.981424  9465 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:13.990276  9476 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:13.988767  9471 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:14.014848  9487 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:13.993676  9454 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:14.012459  8775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.010s	sys 0.019s
W20260709 13:03:14.019722  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 1.1659e+06us
I20260709 13:03:14.039510  9464 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.049571  9482 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:14.017275  9483 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.027266  9479 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:03:14.065620  9489 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:14.066316  9489 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.068596  9489 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.069119  9492 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.051962  9475 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.075728  9494 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.052356  9484 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:14.076946  9466 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:14.086045  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 103794us
I20260709 13:03:14.064555  9464 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.034864  9476 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.087579  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.069679  9492 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.091459  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.082403  9484 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.091769  9491 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.092520  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.092717  9490 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.081380  9475 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.093699  9465 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.095599  9468 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.092434  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.098551  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.082548  9483 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.091667  9474 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:14.091691  9485 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.102284  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.102427  9454 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.092326  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.050305  9482 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.102526  9471 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.099054  9484 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.100539  9494 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.100720  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.105545  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.104164  9491 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.107267  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.035398  9487 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.106771  9474 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.108517  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.112010  8116 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:14.112645  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.104524  9475 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.113481  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.124150  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.102559  9490 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.108510  9485 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.261925  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.263666  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1285) took 1517 ms. Trace:
I20260709 13:03:14.269901  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.274163  8193 rpcz_store.cc:276] 0709 13:03:12.746436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.262454 (+1516018us) service_pool.cc:224] Handling call
0709 13:03:14.262891 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.263181 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.263208 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.263253 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:14.263286 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.263339 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.263460 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:14.275774  8807 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:14.113602  9455 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.279466  8198 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:14.201963  8811 raft_consensus.cc:1217] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:14.200748  9475 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.194491  9474 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.271607  8274 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.202891  9454 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:13.964557  9433 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.137181  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.280172  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.190021  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.335824  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.315239  9216 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:14.338354  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.162367  8194 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:14.337826  8200 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:14.137735  9464 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.294130  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.338994  9471 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.159794  9468 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.343148  8807 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:14.276522  9459 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.315248  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.293752  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.344897  8274 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:14.345498  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.345732  9471 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:14.346249  9216 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.346609  9500 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.344441  8193 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:14.334904  9493 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:14.339042  9483 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.337011  8806 raft_consensus.cc:1217] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:14.355568  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.343904  9490 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.359678  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.347050  9487 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.364454  9482 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.358835  9489 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.357664  9455 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.361850  9466 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.365283  9464 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.353230  9470 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.367514  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.369527  9475 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.419422  9491 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.373239  9492 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.368028  9216 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.419730  9455 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:14.422899  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54587us
I20260709 13:03:14.334422  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.422170  9466 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.423694  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.424028  8195 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:14.425529  9466 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.426244  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.426736  8268 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:14.427856  8268 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.428936  9471 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.358139  9454 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.358278  9474 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.373600  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:14.444134  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.444698  8266 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:14.367722  9486 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.373530  9494 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.435221  8122 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:14.430347  9484 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.449389  9499 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.369544  9476 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.423084  9482 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.370383  9465 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.425583  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.443874  8196 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:14.458799  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.419852  9475 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.370067  9489 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.457814  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.371085  9459 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.450021  9499 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.454027  9454 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.470966  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:14.476161  8267 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:14.476467  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.476166  9495 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.477118  8268 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:14.446825  9470 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.470671  8806 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:14.479827  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.477595  9495 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.480811  8270 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:14.420274  9493 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.481787  9468 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.453513  9474 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.482839  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:14.481974  9490 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.469578  8269 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:14.485080  8266 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:14.483850  9412 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.483719  9487 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.486784  9470 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.486888  9485 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.473774  9476 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.490922  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:14.479393  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.491370  9493 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.501816  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.490934  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.471151  9465 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.491516  9463 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.496094  9216 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.496213  9471 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:14.496748  9466 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.496577  9487 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.488183  9498 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:14.495260  9412 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.374023  9500 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.499096  9503 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:14.499631  9499 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.499941  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.496197  9490 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.501061  9495 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.481123  9482 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.510612  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.508864  9463 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.511246  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.511643  9471 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.511961  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.512553  9454 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.514631  9463 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.509444  9466 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.509296  9412 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.513782  8200 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:14.516419  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:14.516408  8271 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:14.517515  9216 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.513005  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.518961  9490 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.529052  9492 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.529204  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.529505  9475 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.529693  9492 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.527700  9476 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.531056  9216 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.520471  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.522509  9494 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.518195  9493 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.522307  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.519400  9466 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.533449  9491 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.533257  9471 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.537904  8238 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:14.534651  8199 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.545644  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.543234  9494 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.514750  9503 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.549614  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.473618  9486 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.548795  9493 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.556564  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.546748  9491 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.561767  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:14.562675  9490 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.563040  9490 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.548132  9483 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.548297  9494 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.563454  9490 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.566228  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.548458  9487 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.557142  8269 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:14.568602  8193 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:14.548863  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.578565  8265 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:14.563835  9459 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.580066  9465 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.563277  9489 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.550858  9484 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.564999  9470 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:14.590241  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.563071  9491 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.569787  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.566556  9483 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.595257  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.595820  8272 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:14.595101  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:14.599232  8808 raft_consensus.cc:1217] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:14.595360  9483 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.605456  8811 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.601727  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.604244  9491 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:03:14.624518  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 59602.1us
I20260709 13:03:14.625695  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.624414  9483 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:14.610476  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.610046  9474 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.631029  9483 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.634954  9459 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:14.628178  9470 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:14.637084  8806 raft_consensus.cc:1217] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:14.638413  9476 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.644076  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.644701  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.645115  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.645872  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.646246  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.646484  8193 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:14.647308  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.656785  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:14.657860  9486 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:14.656168  9466 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:14.663143  9466 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:14.658607  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:14.665015  9475 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.665477  9475 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:14.665889  9475 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.702188  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:14.702921  8272 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:14.658648  9482 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:14.632050  9490 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:14.705981  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:15.787007  9500 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:15.833271  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:15.859630  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:15.860718  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:15.861294  8122 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:16.031721  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.032582  8122 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:16.033429  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:15.887727  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:15.924608  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.035169  8121 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:16.073540  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1364) took 1903 ms. Trace:
I20260709 13:03:16.073989  8117 rpcz_store.cc:276] 0709 13:03:14.186730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.072651 (+1885921us) service_pool.cc:224] Handling call
0709 13:03:16.073024 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.073214 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.073238 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.073275 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:16.073302 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.073367 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.073482 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:14.705156  9412 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.111995  9412 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:15.792552  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1353) took 1321 ms. Trace:
W20260709 13:03:15.958740  9475 consensus_meta.cc:287] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.292s	user 0.014s	sys 0.006s
I20260709 13:03:16.521512  8272 rpcz_store.cc:276] 0709 13:03:14.471345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.791670 (+1320325us) service_pool.cc:224] Handling call
0709 13:03:15.792025 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.792249 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.792273 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.792313 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:15.792341 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.792390 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.792497 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.521663  9475 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.524192  9475 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.312516  8803 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:16.623365  9510 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:16.624101  9510 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:16.625907  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1920 after lost signal to thread 7008
I20260709 13:03:16.627096  9510 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.627712  9510 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:16.639297  9510 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.639786  9511 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.640448  9511 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.641459  9510 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.642158  9510 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.642611  9510 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.643008  9511 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.644512  9511 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.644507  9510 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.645372  9510 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.645205  9511 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.645906  9455 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.647197  9511 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.647735  9510 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.649546  9510 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.655234  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.656325  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.657227  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.657800  8196 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:16.658699  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.659278  8196 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:16.662330  8196 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:16.662333  9475 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.662922  9475 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.664567  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 115) took 2173 ms. Trace:
I20260709 13:03:16.664662  9475 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.664835  8267 rpcz_store.cc:276] 0709 13:03:14.490704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.663913 (+2173209us) service_pool.cc:224] Handling call
0709 13:03:16.664127 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.664303 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.664325 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.664361 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:16.664388 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.664435 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.664520 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.665961  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 120) took 2069 ms. Trace:
I20260709 13:03:16.666162  8267 rpcz_store.cc:276] 0709 13:03:14.596399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.665473 (+2069074us) service_pool.cc:224] Handling call
0709 13:03:16.665647 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.665767 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.665781 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.665804 (+    23us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:16.665819 (+    15us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.665847 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.665919 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.667850  9412 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:16.668380  8237 connection.cc:256] RPC call timeout handler was delayed by -1.466341295999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:03:16.668864  8237 connection.cc:256] RPC call timeout handler was delayed by -1.4337405030000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:03:16.669286  8237 connection.cc:256] RPC call timeout handler was delayed by -1.428335737999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 13:03:16.668538  9412 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:16.669673  8237 connection.cc:256] RPC call timeout handler was delayed by -1.4189482909999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:03:16.669974  8237 connection.cc:256] RPC call timeout handler was delayed by -1.2137222670000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:03:16.670145  8237 connection.cc:256] RPC call timeout handler was delayed by -1.181567651000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:03:16.670369  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1268695570000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 13:03:16.670616  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1082625120000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:03:16.670989  9412 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.671597  9503 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.672416  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.672987  8116 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
W20260709 13:03:16.670861  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0907610240000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:03:16.673780  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0787111260000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:03:16.674229  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0357761480000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
I20260709 13:03:16.674379  9412 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.675424  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.675576  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.676087  8123 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:16.674863  9412 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:16.674554  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0242664969999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 13:03:16.677815  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:16.678833  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:16.679018  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:16.679891  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:16.680248  9412 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.677917  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.682340  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 369) took 2203 ms. Trace:
I20260709 13:03:16.682543  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:16.683351  9497 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:16.683709  9497 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.684073  9497 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.684614  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:16.676906  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1317) took 2355 ms. Trace:
W20260709 13:03:16.685642  8195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 932) took 2035 ms (client timeout 1687 ms). Trace:
W20260709 13:03:16.686045  8195 rpcz_store.cc:269] 0709 13:03:14.650072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.656498 (+  6426us) service_pool.cc:224] Handling call
0709 13:03:16.685560 (+2029062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.686643  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:16.687707  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:16.689124  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:16.685588  8197 rpcz_store.cc:276] 0709 13:03:14.321583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.323549 (+  1966us) service_pool.cc:224] Handling call
0709 13:03:14.323980 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.529050 (+205070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.529080 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.529132 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:14.529158 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.676597 (+2147439us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540035cad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:16.676630 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.676724 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470271104}
I20260709 13:03:16.690636  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:16.691445  8193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 934) took 2039 ms (client timeout 2165 ms). Trace:
W20260709 13:03:16.691762  8193 rpcz_store.cc:269] 0709 13:03:14.652068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.690372 (+2038304us) service_pool.cc:224] Handling call
0709 13:03:16.691366 (+   994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.682778  8810 rpcz_store.cc:276] 0709 13:03:14.478543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.481833 (+  3290us) service_pool.cc:224] Handling call
0709 13:03:14.482063 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.563653 (+ 81590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.563682 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.563715 (+    33us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:14.563741 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.682037 (+2118296us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b54004e2354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:16.682074 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.682177 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187175680}
I20260709 13:03:16.689297  9501 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.693574  9501 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:16.693579  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1346) took 2353 ms (client timeout 1698 ms). Trace:
W20260709 13:03:16.694793  8270 rpcz_store.cc:269] 0709 13:03:14.340035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.359504 (+ 19469us) service_pool.cc:224] Handling call
0709 13:03:16.693384 (+2333880us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b5400408b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:16.693501 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129900416}
W20260709 13:03:16.697702  8125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1383) took 2583 ms (client timeout 1883 ms). Trace:
W20260709 13:03:16.698086  8125 rpcz_store.cc:269] 0709 13:03:14.118255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.697496 (+2579241us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:16.697634 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:16.699596  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.700737  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.701717  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.702850  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.703538  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:16.703930  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:16.704299  8269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 118) took 2122 ms (client timeout 1643 ms). Trace:
W20260709 13:03:16.704645  8269 rpcz_store.cc:269] 0709 13:03:14.581727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.596994 (+ 15267us) service_pool.cc:224] Handling call
0709 13:03:16.703451 (+2106457us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b58000f5d98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:16.704240 (+   789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5820160}
I20260709 13:03:16.706291  9497 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:16.707473  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.215s	user 0.008s	sys 0.034s
W20260709 13:03:16.707836  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.216s	user 0.008s	sys 0.034s
W20260709 13:03:16.708109  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 2.22208e+06us
I20260709 13:03:16.708647  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.709332  9497 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.710003  9497 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.710335  9497 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.710657  9497 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.711675  9433 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:14.675503  9463 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.712186  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.720455  9454 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.720824  9454 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:16.721012  9216 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.721431  9216 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.721768  9216 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.723215  9470 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.723912  9454 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.724184  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:16.724581  9501 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.724893  8804 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:16.727250  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.728324  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.712281  9433 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.729741  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.729981  9433 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.715830  9463 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:16.735280  8804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 374) took 2029 ms (client timeout 1793 ms). Trace:
W20260709 13:03:16.735736  8804 rpcz_store.cc:269] 0709 13:03:14.705886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.707406 (+  1520us) service_pool.cc:224] Handling call
0709 13:03:16.735181 (+2027775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.736326  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.718539  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.739144  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:16.739931  8802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 189) took 2138 ms (client timeout 1988 ms). Trace:
W20260709 13:03:16.740258  8802 rpcz_store.cc:269] 0709 13:03:14.603408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.612383 (+  8975us) service_pool.cc:224] Handling call
0709 13:03:16.738999 (+2126616us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:16.739853 (+   854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23589632}
I20260709 13:03:16.718398  9514 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:16.742344  9514 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:16.742756  9514 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.743083  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.747628  9468 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.747970  9468 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:16.748291  9468 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.744151  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.751394  8166 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.751569  9510 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.752517  9475 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:16.755092  9512 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.766692  9475 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:16.767133  9475 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.767184  9512 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.752168  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.769500  9512 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.770186  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:16.744659  9454 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.770439  9433 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.770876  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.772339  9454 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.772897  9454 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.773572  9497 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.762014  8021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 159) took 4144 ms. Trace:
I20260709 13:03:16.778487  8021 rpcz_store.cc:276] 0709 13:03:12.617071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.858087 (+1241016us) service_pool.cc:224] Handling call
0709 13:03:16.761821 (+2903734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6596,"reported_tablets":1}
I20260709 13:03:16.752219  9455 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:16.779618  9216 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.780126  9455 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:16.780503  9455 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.760149  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:16.775712  9494 consensus_meta.cc:287] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 2.175s	user 0.016s	sys 0.059s
I20260709 13:03:16.770200  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.781864  8118 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:16.781522  9492 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.781997  8191 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:16.782894  9433 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:16.783224  8191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 1323) took 2282 ms (client timeout 2005 ms). Trace:
I20260709 13:03:16.783730  9433 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:16.752025  9511 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.784153  9433 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.783541  8191 rpcz_store.cc:269] 0709 13:03:14.501128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.509886 (+  8758us) service_pool.cc:224] Handling call
0709 13:03:16.770077 (+2260191us) spinlock_profiling.cc:243] Waited 871 us on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:16.783149 (+ 13072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002816}
I20260709 13:03:16.781368  9497 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.784674  9494 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.785243  9433 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.765379  9510 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.786587  9494 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.786888  9510 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.772737  9468 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.789217  9511 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.791159  9501 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.791463  9475 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.773298  9454 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:16.802206  9501 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.826716  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.827178  9468 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.827389  8193 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:16.827744  9468 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.805359  8265 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:16.828033  9473 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.828485  9478 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.828685  9473 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.828794  9468 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.829071  9478 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:16.829588  9478 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.806605  9511 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.830696  9473 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.831192  9473 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.831494  9478 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.831648  9473 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:16.821962  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.832790  8192 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
W20260709 13:03:16.833684  8805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 372) took 2171 ms (client timeout 1642 ms). Trace:
I20260709 13:03:16.834257  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.807262  9216 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:16.804836  8199 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:16.834126  8805 rpcz_store.cc:269] 0709 13:03:14.666924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.670296 (+  3372us) service_pool.cc:224] Handling call
0709 13:03:16.833605 (+2163309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.825697  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.867854  8197 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
W20260709 13:03:16.800704  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 110340us
W20260709 13:03:16.869582  8091 connection.cc:256] RPC call timeout handler was delayed by -1.5668076759999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:03:16.869724  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:16.870059  8091 connection.cc:256] RPC call timeout handler was delayed by -1.3643179279999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:03:16.870443  8091 connection.cc:256] RPC call timeout handler was delayed by -1.323428468999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:03:16.870760  8091 connection.cc:256] RPC call timeout handler was delayed by -1.2672135099999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:03:16.870977  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:16.871649  9483 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:16.872112  9483 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:16.872502  9483 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.873498  9216 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:16.873940  9216 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:16.874320  9216 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:16.876438  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.877862  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.879127  9483 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.829663  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.805971  9475 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.804553  9433 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.880245  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.810993  9454 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.813658  9459 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:16.914505  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:16.989630  9459 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:16.880712  8193 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:16.991583  9459 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.915824  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:16.880249  9216 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.993009  8197 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:16.807550  8273 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:16.813475  9467 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.988556  9520 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:17.006453  8806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 373) took 2302 ms (client timeout 1596 ms). Trace:
I20260709 13:03:16.872745  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:17.034317  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 161612us
I20260709 13:03:17.035876  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.037563  8191 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:16.807082  9514 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.997747  9216 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:16.999238  8271 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:16.812255  9510 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:16.814296  9512 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.044531  9512 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.046653  9512 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:16.988771  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 218638us
I20260709 13:03:17.047820  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:17.033809  8806 rpcz_store.cc:269] 0709 13:03:14.705515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.705709 (+   194us) service_pool.cc:224] Handling call
0709 13:03:17.006381 (+2300672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.048884  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.049852  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.050010  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:17.051256  9519 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.051592  9519 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:17.051908  9519 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.997622  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.000377  9483 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.002106  9468 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:16.985456  9518 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:17.061723  9467 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:16.915556  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.069305  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.069693  8123 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.070093  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 922) took 2717 ms. Trace:
I20260709 13:03:17.070600  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.070677  9510 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:17.071919  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.072789  9510 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.072962  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.003981  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.040535  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:17.092202  8163 connection.cc:256] RPC call timeout handler was delayed by -1.3269965719999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:03:17.040063  9501 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:17.120774  8163 connection.cc:256] RPC call timeout handler was delayed by -1.3107965719999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:03:17.121129  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2567965719999279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:03:17.121441  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2387965719999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:03:17.121829  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0956965719999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:03:17.122107  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0902965719999429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:03:16.970793  9455 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:17.125886  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.130236  8271 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:16.883833  8194 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:17.043762  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1341) took 2770 ms. Trace:
I20260709 13:03:17.043989  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:16.976017  9473 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.058449  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:17.062196  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 146253us
I20260709 13:03:16.998286  8195 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.064254  9518 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:16.993643  8775 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.66:37313 timed out after 1.531s (SENT) [suppressed 2 similar messages]
I20260709 13:03:17.066939  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 932) took 2578 ms. Trace:
I20260709 13:03:17.064200  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:17.126747  8088 connection.cc:256] RPC call timeout handler was delayed by -1.7478090449999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:03:17.127203  8122 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:17.077179  8269 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:17.150642  8272 rpcz_store.cc:276] 0709 13:03:14.489543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.522870 (+2033327us) service_pool.cc:224] Handling call
0709 13:03:16.694022 (+171152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.694202 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.694226 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.694266 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:16.694294 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.694343 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.066757 (+372414us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400408b50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:17.066867 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392809856}
I20260709 13:03:16.813568  9470 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:17.130132  8777 connection.cc:256] RPC call timeout handler was delayed by -1.1134565789999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:03:17.151708  8777 connection.cc:256] RPC call timeout handler was delayed by -1.0828565789999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:03:17.136353  8125 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.126089  9501 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.153806  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.153941  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.155377  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:17.156059  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 123503us
I20260709 13:03:17.159765  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:17.161804  8274 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
W20260709 13:03:17.163738  8088 connection.cc:256] RPC call timeout handler was delayed by -1.2546090449999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 13:03:17.163813  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:17.153941  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.155579  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.174645  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.154176  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.159499  9501 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.070441  8265 rpcz_store.cc:276] 0709 13:03:14.353137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.581135 (+227998us) service_pool.cc:224] Handling call
0709 13:03:14.592445 (+ 11310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.828460 (+2236015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.069865 (+241405us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b540030a554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:17.070039 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5045627264}
I20260709 13:03:17.175675  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:17.155802  9518 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.184648  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.186271  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.189648  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:17.194097  8198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 1307) took 3087 ms (client timeout 2170 ms). Trace:
W20260709 13:03:17.194523  8198 rpcz_store.cc:269] 0709 13:03:14.106697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.107013 (+   316us) service_pool.cc:224] Handling call
0709 13:03:17.193903 (+3086890us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400364554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:17.194026 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380421504}
I20260709 13:03:17.198341  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 933) took 2548 ms. Trace:
I20260709 13:03:17.198766  8200 rpcz_store.cc:276] 0709 13:03:14.650399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.710361 (+2059962us) service_pool.cc:224] Handling call
0709 13:03:17.197251 (+486890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.197517 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.197543 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.197586 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:17.197615 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.197671 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.198156 (+   485us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400364550. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:17.198257 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118990208}
I20260709 13:03:17.207403  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.210809  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 926) took 2566 ms. Trace:
I20260709 13:03:17.211220  8199 rpcz_store.cc:276] 0709 13:03:14.643946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.647279 (+  3333us) service_pool.cc:224] Handling call
0709 13:03:16.787717 (+2140438us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:16.787898 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.861502 (+ 73604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.210580 (+349078us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b540021b954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:17.210745 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40680448}
I20260709 13:03:17.219276  9459 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.220093  9459 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.220413  9459 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.220743  9459 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.221885  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.167608  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.229182  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:17.228416  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 166859us
W20260709 13:03:17.249586  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 85860.7us
I20260709 13:03:17.250205  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.227555  9492 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:17.225859  9468 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.228574  9493 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.167382  9470 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:17.259164  9528 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:03:17.260686  9514 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.254668  9433 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.263319  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 185) took 2664 ms. Trace:
I20260709 13:03:17.264081  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.265776  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.132504  8273 rpcz_store.cc:276] 0709 13:03:14.273040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.294584 (+ 21544us) service_pool.cc:224] Handling call
0709 13:03:16.807002 (+2512418us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b58000f5d98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:16.807223 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.998688 (+191465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.043681 (+ 44993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994048}
I20260709 13:03:17.309544  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.309878  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.310159  8271 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:17.310977  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.311094  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.311762  8273 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:17.311985  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.312664  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.267869  9524 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.313670  9524 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.315225  9470 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.315629  9524 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.315900  9433 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.316442  9433 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.316748  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:17.317028  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08000cde80 after lost signal to thread 8057
I20260709 13:03:17.307006  8803 rpcz_store.cc:276] 0709 13:03:14.598600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.598851 (+   251us) service_pool.cc:224] Handling call
0709 13:03:14.599152 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.524990 (+1925838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.263103 (+738113us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005b0254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:17.263264 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246722432}
I20260709 13:03:17.318266  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:17.318631  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.319286  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.319814  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.322503  9493 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.268808  9467 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.269657  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.322991  8273 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:17.328912  9433 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.249224  9454 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.304103  9468 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.322922  9459 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.330672  9454 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.271551  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.273382  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.331077  9468 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.273838  9455 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.273634  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.230079  9518 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.337359  9490 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.342090  9518 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.324354  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.275655  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:17.278533  8832 debug-util.cc:398] Leaking SignalData structure 0x7b0800245d80 after lost signal to thread 7008
W20260709 13:03:17.282859  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 123188us
W20260709 13:03:17.332703  8238 connection.cc:256] RPC call timeout handler was delayed by -1.794007567000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:03:17.344413  8238 connection.cc:256] RPC call timeout handler was delayed by -1.3236800629999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 13:03:17.324112  9493 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.261574  9516 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.327369  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:17.341106  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080019eb80 after lost signal to thread 8149
I20260709 13:03:17.349247  9516 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:17.349751  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080019eb60 after lost signal to thread 8150
W20260709 13:03:17.350674  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08000dbac0 after lost signal to thread 8224
I20260709 13:03:17.254465  9492 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.331480  8270 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:17.350847  9493 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.351234  9516 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.332197  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.352077  9492 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:17.228133  8120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1369) took 1421 ms (client timeout 1626 ms). Trace:
W20260709 13:03:17.283717  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 102620us
W20260709 13:03:17.344696  8238 connection.cc:256] RPC call timeout handler was delayed by -1.2720075670000597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:03:17.336081  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.344712  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:17.327843  9519 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.328037  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:17.346226  8832 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7e20 after lost signal to thread 8057
W20260709 13:03:17.359248  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 71461.7us
I20260709 13:03:17.361768  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.362293  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.365078  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:17.355103  8120 rpcz_store.cc:269] 0709 13:03:15.806936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.080691 (+1273755us) service_pool.cc:224] Handling call
0709 13:03:17.226857 (+146166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.368757  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.369340  9519 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.370108  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.338210  9501 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.325537  9463 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.345252  9459 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.326208  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.324153  9529 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:03:17.344027  9518 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:17.306762  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 320258us
W20260709 13:03:17.355333  8238 connection.cc:256] RPC call timeout handler was delayed by -1.01138006299999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 13:03:17.357837  9516 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:17.323906  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:17.358767  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.370788  8199 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:17.382588  8191 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:17.386044  8810 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:17.393725  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:17.393863  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 271238us
W20260709 13:03:17.355577  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080037ba00 after lost signal to thread 8298
I20260709 13:03:17.399761  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:17.400393  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080030f9c0 after lost signal to thread 8835
I20260709 13:03:17.362986  9473 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:17.400683  8054 debug-util.cc:398] Leaking SignalData structure 0x7b0800309f80 after lost signal to thread 8836
I20260709 13:03:17.401081  8274 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:17.400362  8198 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.397635  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:17.403152  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 79316.1us
I20260709 13:03:17.403766  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:17.405597  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.406147  8197 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.406999  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:17.417241  9523 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.420929  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.407491  9459 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.422441  9459 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.422806  9459 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:17.423744  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 66866.6us
I20260709 13:03:17.424432  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:17.403275  9473 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.439455  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.417840  9511 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.407799  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.398281  9463 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.443230  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:17.461633  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:17.437847  8774 connection.cc:256] RPC call timeout handler was delayed by -1.3663903130000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:03:17.436911  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 81985.4us
I20260709 13:03:17.445930  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:17.450675  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:17.404534  9518 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:03:17.443018  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.463260  8267 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:17.467711  9216 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:17.469239  9216 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:17.469646  9216 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.429524  9533 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:17.473054  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:17.467147  8774 connection.cc:256] RPC call timeout handler was delayed by -1.1422903130000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 13:03:17.436327  9473 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.467922  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:17.437608  9493 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.437692  9490 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.486996  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.485491  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.476739  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:17.474887  8774 connection.cc:256] RPC call timeout handler was delayed by -1.1233903130000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:03:17.488582  8774 connection.cc:256] RPC call timeout handler was delayed by -1.0396903129999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:03:17.480988  8271 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:17.474159  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.490149  8267 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:17.482302  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:17.484223  9543 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:17.498342  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:17.473655  9532 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:17.442598  9511 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.438001  9472 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:03:17.486374  8832 debug-util.cc:398] Leaking SignalData structure 0x7b08000836a0 after lost signal to thread 8149
I20260709 13:03:17.435623  9467 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:03:17.488086  8272 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.492241  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.541672  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.492847  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.541993  8804 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.542382  8809 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.542889  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.493322  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.543162  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.494680  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.543555  8802 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.544451  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.545800  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.546428  8802 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:17.495604  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.496500  9540 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.461253  9529 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:17.547691  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.492926  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.547885  9529 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.547816  9540 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.548328  9529 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.548401  9540 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.497463  9530 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:17.499693  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.515965  9455 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:17.517313  9531 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:17.517959  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 75024.1us
I20260709 13:03:17.519485  9492 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.549401  8267 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:17.550570  9455 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:17.553546  9455 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.520675  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.485157  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.522734  9501 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.552985  9492 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:17.555070  9530 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:17.523078  9490 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.555450  9492 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:17.551093  8804 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:17.554495  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.555585  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.555413  9530 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:17.524149  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.523876  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.556591  9535 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:17.556944  9490 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.558143  9535 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:17.558821  8195 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:17.551348  9472 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:17.559456  9472 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:17.525329  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.526749  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.558167  8197 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:17.528636  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.529531  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.531854  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.502112  9493 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.532948  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.533850  9519 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:17.485050  9512 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:17.504904  8266 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:17.536655  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 76683.3us
I20260709 13:03:17.537503  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.538308  9216 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.539412  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:17.540910  8832 debug-util.cc:398] Leaking SignalData structure 0x7b08003167e0 after lost signal to thread 8224
I20260709 13:03:17.544402  9463 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.478209  9533 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:17.548861  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:17.481428  9412 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:17.580806  9412 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:17.581238  9412 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.581553  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.582325  8194 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:17.557550  8802 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:03:17.549400  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51240.2us
I20260709 13:03:17.551627  9467 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:17.551532  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.585650  9467 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:17.566478  9519 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:17.586494  9467 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:17.587002  9519 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.561614  8807 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.570859  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.571486  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.552101  8808 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:17.576491  8272 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:17.572710  8811 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.571839  9472 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:03:17.606525  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 68434.9us
I20260709 13:03:17.579072  9216 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.580420  9533 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:17.580873  8832 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2fc0 after lost signal to thread 8298
I20260709 13:03:17.538875  9511 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.568464  9512 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:17.594513  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.552254  9532 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:17.603075  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.604055  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.605001  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.609136  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.610793  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.621626  8272 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.590813  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.611833  9501 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.610555  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:17.612076  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.613902  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.623065  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.618221  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:17.618705  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 143265us
I20260709 13:03:17.624013  8810 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:17.619020  8271 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:17.617939  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.625262  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.626272  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:17.621110  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.629555  8122 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:17.630479  8806 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:17.630739  8199 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:17.631313  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.631515  8117 raft_consensus.cc:2393] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:17.599516  9531 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.633735  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:17.631326  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.636611  9510 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.636765  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.637005  9510 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.637419  9510 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.631264  9455 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.642583  9510 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.643321  9455 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.634253  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.631960  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.645910  8125 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:17.611645  9519 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:17.650610  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 185247us
I20260709 13:03:17.651325  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:17.647276  8271 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:17.647723  9216 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:17.570308  9473 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:17.634119  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.649477  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.559224  9535 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:17.650161  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:17.619958  9467 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.646716  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:17.648525  9544 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.649963  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.653398  8272 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:17.620369  9532 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:17.655112  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.703900  8125 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
W20260709 13:03:17.699570  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 111956us
I20260709 13:03:17.704704  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.656817  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.558102  9530 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.694521  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:17.695602  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 45505.5us
I20260709 13:03:17.710357  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:17.697886  8832 debug-util.cc:398] Leaking SignalData structure 0x7b080033d240 after lost signal to thread 8835
I20260709 13:03:17.652436  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:17.644774  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.644510  9516 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.695724  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.634429  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:17.698784  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52131.3us
I20260709 13:03:17.657670  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:17.703061  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:17.655373  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.706665  9497 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.657567  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.719146  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.698333  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.709749  9493 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.634918  9543 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:17.712867  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:17.611383  9470 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:17.715808  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:17.728434  8118 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.713999  8273 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:17.731523  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:17.699216  9216 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:17.705751  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.708053  9532 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.730319  8117 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:17.731159  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.733089  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.652086  9468 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:03:17.717221  9516 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:17.719655  9510 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:17.814996  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:17.723385  9497 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:17.831772  8122 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:17.734365  9514 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:17.733711  9463 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:17.655720  9536 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260709 13:03:17.836577  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 123752us
W20260709 13:03:17.837412  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 131703us
I20260709 13:03:17.841800  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.842417  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:17.842833  8125 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:17.844012  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 140938us
I20260709 13:03:17.844491  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:17.845530  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.840029  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:17.837841  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 222813us
I20260709 13:03:17.815670  9516 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.813217  9543 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:17.818311  9497 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.718669  9512 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.734514  9459 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:17.863742  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:17.839238  9510 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.840382  9455 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:17.853542  9543 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:17.906002  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 64233.8us
I20260709 13:03:17.950971  9472 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.906841  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.957463  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:17.911640  9512 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.909785  9468 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.908723  9455 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:17.967553  9473 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:17.968083  9549 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.968304  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:17.967389  9517 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.911738  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:17.982148  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70480.6us
I20260709 13:03:17.983202  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:18.034499  9542 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.034992  9542 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.035874  9542 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:18.017148  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 109846us
I20260709 13:03:17.938728  9522 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.257s
I20260709 13:03:18.030107  9535 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:18.039263  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 56132.3us
I20260709 13:03:17.963406  8194 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:18.046905  8803 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:18.054466  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.055124  8191 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.021121  9520 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.965487  9412 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.068192  9532 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:18.070075  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.082376  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.967276  9550 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:03:18.031641  9510 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:03:18.118983  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 68755.1us
I20260709 13:03:18.123713  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.125730  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.126274  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.127007  8199 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:18.127801  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:18.128131  9529 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.000s
I20260709 13:03:18.128634  8195 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:18.128563  9529 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.129699  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.129884  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:18.131673  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 480378us
W20260709 13:03:18.121630  9540 consensus_meta.cc:287] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.573s	user 0.003s	sys 0.006s
I20260709 13:03:18.139264  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.140722  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.141381  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:18.132432  9459 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:18.112655  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56991.5us
W20260709 13:03:18.130506  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 313556us
I20260709 13:03:18.136579  8121 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:18.074630  9470 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:03:18.145509  9561 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.147146  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.132864  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.154793  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.155026  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.155520  9529 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.160311  8125 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:18.160629  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.137773  9532 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.118336  9455 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.136873  9551 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.159471  8273 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:18.166941  9412 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.168709  9529 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:18.180426  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.140363  9540 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.182360  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.183837  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.184609  9216 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.184959  9216 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:18.185276  9216 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.185858  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.186893  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:18.187736  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49936.2us
I20260709 13:03:18.188146  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:18.188381  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:18.189262  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:18.195837  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 332157us
I20260709 13:03:18.196435  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.196717  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:18.196992  8116 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.201062  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.205222  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:18.207357  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.179263  9551 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.212069  8809 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:18.189975  9553 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.189827  9557 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.181242  9529 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.212186  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:18.191004  9536 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:18.211736  9533 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.001s
I20260709 13:03:18.200554  9473 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.198845  9510 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:18.203512  9480 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.210306  9468 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.213475  9549 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.217574  9550 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.262682  9555 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.263113  9555 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.263468  9555 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.268751  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:18.237819  9548 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.258153  9537 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:18.261549  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:18.285001  8191 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:18.219683  9520 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:18.259207  9510 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:18.266986  9550 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.262079  9468 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.299281  8268 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:18.289502  9518 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.251499  9557 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:18.287456  9548 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:18.253103  9533 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.271452  9473 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:03:18.319600  9467 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.616s	user 0.017s	sys 0.000s
I20260709 13:03:18.330356  8118 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:18.296924  9510 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.293890  9537 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:18.331218  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:18.346525  9530 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.298664  9550 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.287108  9492 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:18.298795  9468 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.340878  9537 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.353155  9545 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.353760  9545 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:18.332017  9548 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.312155  9557 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.356453  9552 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.357419  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.357136  9551 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.363240  8265 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.366374  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.368186  9497 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.291811  9529 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.380095  9558 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:18.380666  9558 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.384112  9551 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:18.378242  9511 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.001s
I20260709 13:03:18.376888  9552 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.386693  9497 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:18.403554  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.404422  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:18.396777  9519 consensus_meta.cc:287] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.003s
I20260709 13:03:18.391619  9540 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:18.400033  9529 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.402429  9537 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.427290  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.415534  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:18.422812  9544 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.000s
I20260709 13:03:18.399083  9511 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:18.444710  9552 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.449779  9552 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.450383  9531 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.452099  9531 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:18.317811  9216 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.419224  9549 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.431650  8200 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:18.435745  9493 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.436846  8116 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:18.437904  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.441465  8273 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.413921  9467 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:03:18.442373  9523 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:18.453171  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.464172  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.478205  8193 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:03:18.472747  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.475999  9216 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.392166  9545 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.466423  9544 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.484412  9565 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:18.284157  9543 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.477783  9523 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.482141  9533 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:18.497912  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 312092us
I20260709 13:03:18.484717  9549 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.499884  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:18.500239  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.019s	sys 0.083s
W20260709 13:03:18.502007  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.019s	sys 0.083s
I20260709 13:03:18.502792  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.500638  9549 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.452932  9531 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.525714  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:18.491358  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53523.8us
I20260709 13:03:18.495738  8269 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:18.523298  9463 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.532405  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.521327  9549 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.535907  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.526618  9533 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.504880  9565 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.537524  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.548352  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:18.523948  9544 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:03:18.540638  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.541056  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:18.529543  9490 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:18.534010  9463 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:18.562642  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:18.563072  9463 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.563809  8808 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.564069  9463 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.541759  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.504292  9518 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:18.543951  9510 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.568991  9510 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.552211  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:18.552896  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:18.554634  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.556246  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.561451  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.562228  9490 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:18.564777  8198 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.543404  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:18.534781  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:18.536165  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.574079  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:18.566243  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:18.571192  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.579468  9556 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.579828  9556 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:18.561309  9561 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:18.581674  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.544447  9548 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.585043  8268 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:18.585870  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.586930  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.556735  9558 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.591099  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:18.582815  9516 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.005s
I20260709 13:03:18.592304  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.593384  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:18.589298  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.596679  9216 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.578382  9511 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:18.582360  8192 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.599360  8271 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:18.561123  8775 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:18.598485  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.569890  9518 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.601948  8125 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.598142  9533 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.630030  9492 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.628068  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:18.630584  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 419585us
I20260709 13:03:18.602217  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:18.602775  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.623760  8198 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:18.633338  8238 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.561914  9563 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:03:18.627116  9557 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.636334  9540 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:18.636686  9540 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:18.637749  9557 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.637446  9540 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.639024  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.640092  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.617774  9517 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.641399  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.551265  9523 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:18.642377  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.627277  9550 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.620566  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:18.642644  9512 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.646749  9511 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.634809  9473 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.648473  9510 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:18.647482  9565 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.638666  9497 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.599578  9516 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.655846  9216 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.642309  9533 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.649570  9512 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.649225  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.641587  9544 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:18.656530  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 54382.8us
I20260709 13:03:18.659082  9510 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.663362  9510 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.663647  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.664233  9510 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.665328  9510 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.650064  9540 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:18.641657  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 95372.6us
I20260709 13:03:18.668684  9470 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.673182  8123 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.662533  9512 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.671108  9490 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.671909  9468 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.650823  9511 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.673730  9532 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.673269  9470 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.676204  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1412) took 1054 ms. Trace:
I20260709 13:03:18.583663  9556 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.684335  8123 rpcz_store.cc:276] 0709 13:03:17.622377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.838547 (+216170us) service_pool.cc:224] Handling call
0709 13:03:17.876037 (+ 37490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.673600 (+797563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.676005 (+  2405us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400306e54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:18.676152 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832831232}
I20260709 13:03:18.680836  9490 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.685829  9548 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:18.686540  9470 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.662981  9544 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.642082  9518 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.682243  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:18.650008  9542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.015s	sys 0.085s
I20260709 13:03:18.700093  9533 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.683084  9532 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:18.683259  9511 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.702971  9493 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.704456  9550 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:18.706139  8118 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:18.681874  9516 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.709858  9543 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:18.712257  9523 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.714016  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:18.714293  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:18.776310  8776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.014s
I20260709 13:03:18.776382  8805 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
W20260709 13:03:18.776733  8776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.003s	sys 0.014s
W20260709 13:03:18.716626  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.718281  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:18.719944  8269 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:18.713913  8802 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.708110  9467 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.723771  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:18.726369  8272 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.726903  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:18.772614  9537 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:18.780194  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49050.2us
I20260709 13:03:18.727536  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:18.728981  8124 raft_consensus.cc:2410] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:18.693655  9544 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.730227  9555 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:18.704478  9480 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.694485  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.731258  9468 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:18.737536  9556 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.738976  8808 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:18.740413  9531 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.740684  9512 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.749924  8116 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:18.743744  9470 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.754843  9549 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:18.767566  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.004s	sys 0.015s
I20260709 13:03:18.674775  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:18.634482  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:18.814276  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.004s	sys 0.015s
W20260709 13:03:18.814795  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 609580us
W20260709 13:03:18.814894  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 180491us
I20260709 13:03:18.815546  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:18.771625  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 101253us
W20260709 13:03:18.770799  9542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.015s	sys 0.086s
W20260709 13:03:18.779217  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.795950  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.012s
W20260709 13:03:18.818833  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.006s	sys 0.012s
W20260709 13:03:18.819223  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 607054us
I20260709 13:03:18.780035  9467 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:18.826171  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 151455us
W20260709 13:03:18.826996  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.826900  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.773337  8192 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:18.811615  8266 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.039s
W20260709 13:03:18.840880  8266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.039s
W20260709 13:03:18.795794  9475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.006s
W20260709 13:03:18.829560  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.815546  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.830539  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.816875  8238 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.810000  9490 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.814273  8268 raft_consensus.cc:2393] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:18.844051  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.860601  8811 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:18.861819  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.866019  8163 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:18.853466  9475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.010s	sys 0.007s
W20260709 13:03:18.874611  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 59131.5us
W20260709 13:03:18.822695  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 137506us
I20260709 13:03:18.875209  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:18.884462  9216 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.884894  9216 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:18.876021  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 59205.2us
I20260709 13:03:18.879245  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.885746  8238 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.851707  9510 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:18.852016  9412 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.839619  9480 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.855487  9543 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.897735  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:18.810750  9532 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:18.856940  8021 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 3 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.907044  8121 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.906582  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.901172  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.947307  9543 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:18.947710  9543 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.881412  9517 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.867554  9536 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.851310  9524 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:03:18.951496  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50410.5us
I20260709 13:03:18.945397  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.955715  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.956024  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.953424  8198 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.879884  9559 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.959436  8088 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.965643  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:18.949916  9562 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:18.972167  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.973049  8197 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:18.974730  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 100020us
W20260709 13:03:18.960096  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 74432.6us
I20260709 13:03:18.961619  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:18.977035  8088 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.976158  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.980372  8116 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:18.975363  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:18.982722  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:18.984544  8116 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.986024  8122 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.892506  9510 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:18.987493  9541 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.987723  9510 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:18.987752  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.987887  9541 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:18.988562  9541 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.951016  9490 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.891651  9566 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.003845  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:18.969321  9216 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:18.986840  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.009717  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:18.816645  9567 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
I20260709 13:03:18.963104  9545 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.003100  8196 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:18.877444  9542 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260709 13:03:19.025141  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49054.3us
I20260709 13:03:19.014807  8119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:19.039924  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.039924  8119 raft_consensus.cc:606] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.040442  8811 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.040540  8119 raft_consensus.cc:614] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:18.984193  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:19.041102  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.037976  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.981966  9561 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.990948  9520 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:19.042096  9564 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:03:19.042544  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.043125  8808 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.960021  9412 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:03:19.005532  9551 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.003225  9568 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.012096  9566 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:19.050786  9511 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.053889  9518 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.056586  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.058682  9497 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.962201  9540 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:03:18.961374  9475 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:03:19.014591  9459 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.087785  8267 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.060813  9520 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:19.134760  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 231311us
W20260709 13:03:19.138290  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 81772.4us
I20260709 13:03:19.083405  9561 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:19.149358  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.150924  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:18.983070  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.141875  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.153475  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.155368  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.060396  9524 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.060305  9522 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.057104  9557 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.085273  9499 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:19.134469  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.107426  9551 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:19.159960  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.201265  9562 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.133580  9566 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.142997  9567 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.152381  9561 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.135758  9549 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.007427  9565 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:03:19.183868  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.185675  9467 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.188061  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.191035  9516 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:19.191258  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.153398  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.223520  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:19.290868  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 99683us
W20260709 13:03:19.292287  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.156205  9520 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.299357  8271 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.300587  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.181335  9499 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.197013  8023 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.202656  9551 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.200592  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:19.181947  9540 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.206914  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.282614  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.208557  9569 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:19.214797  9572 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:03:19.318393  8270 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.294445  9552 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.157518  9481 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.222260  8197 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
W20260709 13:03:19.223569  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 268919us
I20260709 13:03:19.183287  9470 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.160761  9497 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.326766  8274 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:19.327026  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 134654us
I20260709 13:03:19.254139  9559 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:19.312548  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.162523  9483 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.213548  9562 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:19.207823  9510 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.336694  8267 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.276340  8265 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.217247  8803 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
W20260709 13:03:19.304160  9556 consensus_meta.cc:287] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 13:03:19.292169  9516 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:19.308089  9475 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.216147  9511 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:19.298413  8237 leader_election.cc:336] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.642s (SENT)
I20260709 13:03:19.153160  9555 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.358093  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.330098  9559 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:19.323377  9582 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:19.324193  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:19.327616  8197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:19.419441  8197 raft_consensus.cc:606] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.283717  8269 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.197528  9522 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:19.330914  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.429493  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.321439  8194 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.335392  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:19.432477  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 134084us
W20260709 13:03:19.432686  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 97358.1us
I20260709 13:03:19.311033  9541 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.346199  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:19.435672  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.323364  9578 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:03:19.358814  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:19.416954  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 83177.7us
I20260709 13:03:19.344086  8273 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:19.420951  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63098.2us
I20260709 13:03:19.431028  9483 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.357739  9475 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.431449  9516 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.437105  9550 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.253321  9567 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:19.440299  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.461500  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.462610  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.331615  9499 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.447124  8809 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.449461  8197 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.450956  8198 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:19.429111  9549 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:19.464239  9565 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.464250  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.527592  9216 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:19.458745  8121 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:19.528188  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64013.7us
I20260709 13:03:19.529512  9490 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.514997  8197 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.528949  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.447491  9470 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.535650  9481 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:03:19.545854  9575 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:03:19.546154  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.547047  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:19.551488  9493 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.552178  9569 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.552520  9569 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:19.552625  9543 consensus_meta.cc:287] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.001s
I20260709 13:03:19.553927  9216 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.554077  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.554296  9216 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:19.555037  9216 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.556053  9216 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:19.557291  8804 consensus_meta.cc:287] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.001s
I20260709 13:03:19.557714  8804 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:19.558394  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 378) took 1015 ms. Trace:
I20260709 13:03:19.558641  8810 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.528877  9549 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:19.519646  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63391.6us
I20260709 13:03:19.568257  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:19.553040  9543 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.569406  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.552942  9497 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.470309  9541 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:19.521523  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:19.524328  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.524760  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:19.515161  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 359818us
I20260709 13:03:19.535111  8197 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.536448  8193 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.516506  9529 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.519838  9511 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.571023  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.567840  9549 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:19.573612  9522 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.540063  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.567528  9499 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.579962  8197 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.580018  9583 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.519421  9516 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:19.581489  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46684.3us
I20260709 13:03:19.559223  9569 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.585469  8805 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:19.602813  8271 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:19.602906  9569 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.576531  9497 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.566350  8803 rpcz_store.cc:276] 0709 13:03:18.543046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.543184 (+   138us) service_pool.cc:224] Handling call
0709 13:03:19.558241 (+1015057us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540058f2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:19.558344 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476154112}
I20260709 13:03:19.591080  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.560662  9556 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:19.584538  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.434391  9582 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.561208  9470 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.605052  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.608513  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:19.614605  9216 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.614924  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:19.616093  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:19.609107  8088 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.569711  9455 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:03:19.611255  8271 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.615036  9216 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:19.617509  9216 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.594940  9468 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:19.600088  9544 consensus_meta.cc:287] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.804s	user 0.002s	sys 0.007s
I20260709 13:03:19.545185  9559 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.625491  9584 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:03:19.624868  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.532119  9562 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:19.630952  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.612282  9579 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.613554  9545 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.627079  9481 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.623543  9483 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:19.623840  9511 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:19.636723  8807 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.623050  9519 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:03:19.630333  8194 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:19.642496  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:19.643352  9588 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.643711  9588 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.626375  9544 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.579556  9566 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.646988  9216 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.644558  9588 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.648403  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:19.648768  9480 consensus_meta.cc:287] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.000s
I20260709 13:03:19.647307  9481 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:19.656641  9481 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.646100  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.636432  9510 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:19.657209  9566 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:19.657320  9544 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:19.650329  9531 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.836s	user 0.001s	sys 0.009s
I20260709 13:03:19.642323  9511 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:19.658381  9511 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.659495  9497 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:19.661768  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.631716  9524 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.652107  9473 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:19.665710  9530 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.665328  9473 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:19.666075  9530 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:19.666311  9480 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.667295  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.668792  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:19.634716  9586 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.670045  8274 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.671352  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.660899  9529 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.649782  9579 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.683073  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:19.694653  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 48625.5us
W20260709 13:03:19.696770  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.703106  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.684396  9510 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:19.712155  9510 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:19.713065  9510 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.713567  9512 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.684345  9588 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.682022  9497 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.673331  9544 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.708513  9567 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.709573  9522 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:19.711282  9561 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.719696  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:19.720156  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.642081  9549 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.683938  9483 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:19.700820  9566 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.719182  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:19.721434  8089 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.704254  9550 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.723623  9550 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:19.724025  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:19.724572  8273 raft_consensus.cc:606] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:19.724479  9540 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:19.725104  9543 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.716372  9530 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.726423  9530 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.706920  9455 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:19.724309  8163 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:19.730124  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47149.4us
I20260709 13:03:19.730814  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.731782  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:19.734975  8273 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.715868  9490 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.735195  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.738493  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.739137  8268 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.739557  9481 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:19.740268  9557 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:19.741452  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.729702  9524 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.742012  8192 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.739046  8195 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.739449  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.743860  8197 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:19.739202  9592 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.746244  8193 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.745436  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:19.745121  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.715777  9529 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:03:19.748186  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.748920  8196 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:19.729843  9579 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.727612  9522 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.722067  9497 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:19.755090  8117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:19.737607  9531 raft_consensus.cc:1064] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:19.734833  9584 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:03:19.735076  9468 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.751513  9556 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.744138  9519 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.744596  9586 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.729221  9517 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:03:19.761655  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.761827  9522 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.762230  8806 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.737167  9544 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:19.767673  8807 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.749266  9557 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:19.755081  9529 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.769837  9582 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.771988  9483 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.758006  9470 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.774933  8803 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:19.782631  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.772713  9517 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.771988  9497 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.776886  9529 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:19.777060  9522 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:19.805612  9522 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.805709  9529 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.806993  9529 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.807222  8193 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:19.807467  9473 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:19.808637  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:19.776973  9468 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.774995  9566 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:19.809312  8193 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:19.831195  9566 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:19.831781  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.832437  8193 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.783169  9582 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:19.842530  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:19.843299  8803 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:19.843436  9475 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.844928  9475 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.845170  9582 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.847200  9582 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.849218  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:19.849381  9557 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:19.852021  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.853204  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:19.855432  8807 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Advancing to term 2
I20260709 13:03:19.758337  9579 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.782215  8194 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.782140  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:19.819800  8265 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:19.829805  9511 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.766255  9584 consensus_queue.cc:1243] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:19.836560  8117 raft_consensus.cc:606] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.873165  8117 raft_consensus.cc:614] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:19.833323  9566 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.874699  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.874933  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.875404  8272 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:19.838532  8193 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:19.875950  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.874220  9537 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:03:19.877244  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:19.878211  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.879691  8271 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.880862  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.839407  9468 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:19.798254  9517 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:19.840847  9561 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:19.884418  9467 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.766803  9586 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.885007  9517 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.889683  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:19.889858  9517 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.862617  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.862782  8196 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
W20260709 13:03:19.863763  9595 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:03:19.886775  9480 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.864217  9490 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:19.865433  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.890504  9216 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:19.883373  8272 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:19.808147  9522 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.861671  9593 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:19.884449  8197 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.862480  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.894207  8805 raft_consensus.cc:2393] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:19.890447  8200 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:19.897419  9593 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:19.898768  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.837270  8806 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:19.903023  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.904335  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.900854  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.873715  8195 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:19.905956  8272 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:19.908408  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.897826  9593 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:19.909318  8122 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.911139  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.911751  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:19.914198  8116 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:19.886893  9520 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 13:03:19.915956  8122 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.916827  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:19.917677  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.919194  8123 raft_consensus.cc:2393] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:19.917227  9561 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.905551  9584 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.923038  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:19.891232  9480 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.892318  8192 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:19.922780  9584 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.928790  8116 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:19.928689  9511 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:19.920073  9561 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:19.920285  9579 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.930583  8091 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:19.929337  9472 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.931191  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:19.913300  9552 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.920989  8803 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:19.941494  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:19.929205  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.905534  9522 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:19.907043  9540 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:03:19.944279  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.946221  9586 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:19.948582  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:19.941125  9516 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.986486  8119 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:19.995121  9584 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.996763  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:19.997385  8806 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:19.945282  9470 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:19.948525  9568 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:03:19.923651  9520 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:19.952524  9518 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:19.941931  9552 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.000308  9470 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.015674  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:20.037382  8807 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:20.040465  8122 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.041551  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.041844  8116 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.042192  8122 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:20.043625  9216 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.044138  9216 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.045547  9594 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:20.045956  9594 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.046254  9594 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:20.011919  9530 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.050578  9581 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:20.051652  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.027269  9470 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.015714  9516 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:20.013027  9529 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:20.054014  8125 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.058904  8120 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.052037  9473 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:03:20.066180  8120 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.067152  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.061480  9216 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.070185  8811 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:20.071827  8088 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:20.072428  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:20.074615  8120 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:20.075659  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.076277  8120 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:20.077030  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.055217  9523 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.050163  8807 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.082450  8271 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:20.084785  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:20.086162  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1384) took 1890 ms. Trace:
I20260709 13:03:20.085983  8120 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:20.092276  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:20.087949  9481 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:20.086349  9523 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.096145  9520 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.055029  9530 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.086133  9592 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:03:20.088091  9510 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:03:20.101063  9533 raft_consensus.cc:1064] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:20.097570  9463 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:20.083762  9473 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:03:20.064005  9516 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.086694  8266 rpcz_store.cc:276] 0709 13:03:18.191606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.191704 (+    98us) service_pool.cc:224] Handling call
0709 13:03:18.191975 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.284901 (+ 92926us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:18.850197 (+565296us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.024612 (+174415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:19.024659 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:19.024697 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.081638 (+1056941us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b5400211454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:20.081682 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.081808 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55410,"prepare.queue_time_us":645664,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":12859,"raft.queue_time_us":56023,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":213199616,"thread_start_us":674643,"threads_started":2,"wal-append.queue_time_us":301647}
I20260709 13:03:20.083573  9512 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:20.070865  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.051105  9581 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.106180  8125 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.116561  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:20.118042  8118 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:20.106927  9523 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:20.109825  9551 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.000s
I20260709 13:03:20.110517  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:20.120633  8806 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:20.070132  9529 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.089458  9586 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:20.093276  9561 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.120954  8163 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.120047  8125 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.129966  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:20.116204  9510 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:20.150579  9598 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:20.150719  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:20.118796  9512 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:20.157485  8163 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.162883  9592 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.163269  9592 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.163574  9592 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.128435  9523 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.172925  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:20.174571  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.148389  9537 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:20.175076  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.175488  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.160962  9467 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.126173  9551 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.160800  9569 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.159192  9598 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:20.175294  9499 consensus_meta.cc:287] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.002s
I20260709 13:03:20.191418  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:20.239535  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 48219.3us
I20260709 13:03:20.240258  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:20.213248  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.171865  9519 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:20.218361  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.219434  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:20.175877  9522 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.232568  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.169587  9584 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:03:20.157814  9510 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.178656  9552 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.189440  9467 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.244117  8806 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:20.188117  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.177338  9523 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.171981  9588 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.191920  9569 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.259464  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:20.250137  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.265425  9605 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:03:20.248229  9589 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.258466  9467 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.250674  9522 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.269768  9552 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.277906  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:20.311654  8198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 964) took 1415 ms (client timeout 1857 ms). Trace:
I20260709 13:03:20.312538  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.313198  8274 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
W20260709 13:03:20.312098  8198 rpcz_store.cc:269] 0709 13:03:18.895910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.964762 (+ 68852us) service_pool.cc:224] Handling call
0709 13:03:20.311470 (+1346708us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54002062d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:20.311591 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809337216}
I20260709 13:03:20.313125  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1386) took 1092 ms. Trace:
I20260709 13:03:20.268394  8268 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:20.314550  8267 rpcz_store.cc:276] 0709 13:03:19.220909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.221040 (+   131us) service_pool.cc:224] Handling call
0709 13:03:19.252948 (+ 31908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.337451 (+ 84503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.312902 (+975451us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b5400346f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:20.313072 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192198528}
I20260709 13:03:20.250931  9512 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.275065  8120 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:20.278331  9524 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:20.317873  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.290345  9552 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.287976  9589 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:20.310915  9562 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.316857  9569 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.316542  9529 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.270529  9519 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.314071  9511 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.318671  9602 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:20.320421  9530 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.328927  9581 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.333202  9589 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.289096  9588 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:20.325748  9552 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.287464  9598 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.352715  9551 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.354125  8806 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:20.354537  8806 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:20.357210  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:20.357987  8811 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:20.355233  8806 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.364528  8806 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:20.383320  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.384020  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.345850  9511 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.397713  9511 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:20.398829  9601 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:20.399737  9532 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.399538  9588 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:20.391650  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.393214  8777 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.363895  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:20.395366  9600 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:03:20.395789  9510 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.406770  8806 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:20.364312  9602 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:20.392930  9475 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.002s
W20260709 13:03:20.409855  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 169671us
W20260709 13:03:20.454552  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.459679  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.458469  8120 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:20.433796  9610 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:20.456490  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.462263  9522 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.471246  9475 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.505569  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.454910  9594 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.515436  9602 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.456669  9511 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:20.517242  9610 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.530072  8200 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.531364  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:20.531564  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:20.532447  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:20.529577  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:20.526899  9522 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.517868  9475 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.528829  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:20.550277  9603 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:03:20.554744  8200 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:20.554971  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 462721us
I20260709 13:03:20.557778  9622 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:20.563265  9497 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.563865  9497 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.565441  9463 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.565908  9463 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:20.568346  9463 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:20.572446  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 140) took 1222 ms. Trace:
W20260709 13:03:20.573616  9611 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:03:20.574716  9483 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:20.575088  9483 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.575232  9475 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.544152  9537 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:20.586195  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:20.549463  9544 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.530084  9610 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.572827  8265 rpcz_store.cc:276] 0709 13:03:19.350438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.440947 (+ 90509us) service_pool.cc:224] Handling call
0709 13:03:20.572258 (+1131311us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5400211954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:20.572366 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4998016}
I20260709 13:03:20.575865  9483 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.544410  9522 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:20.564400  9517 consensus_meta.cc:287] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.003s
I20260709 13:03:20.597867  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:20.610677  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:20.611541  8806 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:20.612246  8270 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.565928  9497 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:20.599143  8120 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:20.616789  9586 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:20.617017  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:20.617386  8124 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:20.614391  9594 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:20.619580  9470 consensus_meta.cc:287] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.004s
I20260709 13:03:20.619988  9470 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:20.620426  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.616091  9562 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.621654  8117 raft_consensus.cc:2368] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:20.621868  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:20.624274  9555 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:20.624656  9555 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:20.625444  9555 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.625790  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:20.578081  9501 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:03:20.627157  9614 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:20.621666  9562 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.628786  8267 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:20.595235  9511 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.634220  8197 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.634753  8270 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:20.598882  9617 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:03:20.595820  9544 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.633731  9511 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.631981  9475 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.643069  9467 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.646128  9617 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:03:20.635546  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.646680  9617 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.635355  9582 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 13:03:20.643148  9607 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.318s	user 0.003s	sys 0.000s
I20260709 13:03:20.645711  9583 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.633805  8265 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.670558  9545 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.634884  8120 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:20.670914  9545 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.671222  9522 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.598788  9592 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.671761  9545 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.672592  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:20.632200  9497 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:20.664779  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.648811  9582 consensus_queue.cc:1243] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:20.673748  8273 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:20.656018  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.666793  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.664425  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.676697  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.676151  9493 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:20.678320  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:20.678769  9497 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.663269  8196 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.679551  8122 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.679633  9497 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.680205  8196 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.646287  9475 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.680531  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.681080  8122 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:20.687812  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.660460  9523 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.688483  8116 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:20.652372  9593 consensus_meta.cc:287] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.000s
I20260709 13:03:20.649583  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:20.645483  9558 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:20.681793  9516 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.664031  8163 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.684562  8266 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.657974  9216 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.672729  9545 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.684870  9549 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.685621  9475 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.686357  9540 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:20.671229  9562 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:20.689770  8125 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:20.688439  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.647017  9511 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.694588  9558 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:20.650260  9583 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:20.702354  8193 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:20.695778  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.719910  9216 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.694783  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:20.746495  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.773624  8122 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:20.774065  8116 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:20.775187  8116 pending_rounds.cc:85] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 1
I20260709 13:03:20.773550  8123 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
W20260709 13:03:20.722761  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58836.1us
I20260709 13:03:20.688967  9593 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.778496  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.718488  8196 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.690454  9467 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.779438  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.779845  9216 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.786171  8123 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.786497  9216 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.718166  9522 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.780841  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.791018  8195 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:20.791911  8120 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:20.792220  9497 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.793176  8269 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.795073  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:20.796188  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:20.797765  9490 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.797968  9614 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.798476  9614 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:20.777596  8116 pending_rounds.cc:107] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:20.800377  8116 raft_consensus.cc:2889] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.797673  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 103) took 1332 ms. Trace:
I20260709 13:03:20.722635  9519 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:20.802659  8091 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:20.803395  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:20.801743  8124 rpcz_store.cc:276] 0709 13:03:19.465701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.470894 (+  5193us) service_pool.cc:224] Handling call
0709 13:03:20.797493 (+1326599us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540029b654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:20.797601 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397770496}
I20260709 13:03:20.803040  9490 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:20.799315  9614 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.807327  9490 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.809966  9555 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.772389  9516 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:03:20.813657  8121 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:20.814064  9516 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.814399  9516 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:20.815330  9516 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.816259  9516 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:20.820371  8118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1426) took 1914 ms (client timeout 2055 ms). Trace:
W20260709 13:03:20.820770  8118 rpcz_store.cc:269] 0709 13:03:18.906279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.906390 (+   111us) service_pool.cc:224] Handling call
0709 13:03:20.820236 (+1913846us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000e3dd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:20.820323 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672976640}
I20260709 13:03:20.718230  9582 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:03:20.822154  8118 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:20.657285  9552 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.824227  8191 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:20.824436  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 43660.4us
I20260709 13:03:20.827963  8272 raft_consensus.cc:2368] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:20.829944  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.694238  9493 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.785687  9475 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.838903  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:20.755074  9566 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:03:20.800329  9522 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:20.853688  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.805362  9519 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.854444  9548 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:20.862241  9552 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.796838  9533 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.829967  9467 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.849673  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:20.866554  9618 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.866752  9627 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:20.865394  9548 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:20.906663  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:20.907251  8193 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:20.907094  9548 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.908164  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:20.908249  9548 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:20.868319  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.910856  9490 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.911373  9490 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:20.912228  9490 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.909114  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:20.914745  8193 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:20.857559  9522 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.858878  9517 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:20.918735  9517 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.919096  9517 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:20.919915  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:20.921008  8238 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:20.874891  9619 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:03:20.922873  9481 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.922696  9619 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.875041  8200 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.916194  9467 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:20.777850  9537 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.921835  8195 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.864192  9523 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:20.921505  8199 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:03:20.917155  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.923573  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:20.648852  9617 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.937784  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:20.939330  9594 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.939677  9594 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.939968  9594 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.941509  9592 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.941992  9586 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.943694  9586 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.865844  9519 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:20.921665  9473 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:20.924644  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:20.906543  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 76480.6us
I20260709 13:03:20.906329  9627 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.923070  9412 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:20.932551  9467 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.932965  9589 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.952802  9523 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.959066  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:20.916759  9470 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:20.867630  9604 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:03:20.866609  9558 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:20.934298  9559 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.949316  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.972559  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:20.973598  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:20.974917  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:20.975333  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.923269  9481 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:20.927047  9621 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:03:20.926055  9619 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:20.929615  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:20.944185  9586 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:20.967895  9216 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:03:20.968289  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.954185  9501 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.979434  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:21.016072  8811 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.980193  9558 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.984714  9512 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:20.985109  9550 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.986486  8806 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:20.956285  9552 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.995811  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.026943  8199 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:20.954864  8120 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.994576  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:20.966955  9627 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.015966  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:20.984350  9532 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:20.979547  9480 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:20.986999  9472 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.020664  9501 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.994504  9470 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:03:21.020669  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:21.025781  9541 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:21.020525  8196 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:21.045648  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.039292  8802 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.038230  9532 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.061606  9532 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.029259  9593 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.044180  9501 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:21.074985  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 97972.9us
I20260709 13:03:21.035732  9552 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.054970  8803 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.084769  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.177675  8199 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:03:21.131218  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.134637  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.179653  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.145551  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.162889  9638 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:03:21.164561  9552 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.166363  9588 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.167037  8802 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:21.169730  8123 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:21.172406  9594 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.059654  9493 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.227582  8811 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:21.073787  9512 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:21.069324  9472 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.164888  9532 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.054952  9541 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.227334  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:21.239145  9545 consensus_meta.cc:287] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:03:21.234081  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.057478  9481 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.263183  8199 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:21.264295  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.241485  9512 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.270246  9481 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.270696  9512 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.272840  9512 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.272737  9467 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.275755  9467 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.277920  9586 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.278494  9541 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.280565  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.281987  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.286490  8120 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:21.287743  9568 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.288228  9568 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:21.291706  9633 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:03:21.239483  9588 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.288566  8120 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:21.294152  9588 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:21.295056  9637 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:21.295908  9519 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.297169  8200 raft_consensus.cc:2368] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:21.300071  9519 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:21.300460  9624 log.cc:927] Time spent T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.519s	user 0.000s	sys 0.004s
W20260709 13:03:21.301440  9511 consensus_meta.cc:287] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.520s	user 0.001s	sys 0.007s
I20260709 13:03:21.301807  9511 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.302198  8116 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.303325  8116 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.304337  8116 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:21.304917  8122 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:21.314508  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.252729  9639 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.315037  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.327935  8116 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:03:21.333441  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.358803  8116 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:21.326572  9475 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:21.367965  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:21.361924  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.363409  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.364667  9501 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:21.368199  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.371627  9552 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:21.355306  9550 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.372623  9550 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.375578  8803 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:21.376603  9511 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.377297  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:21.278537  9472 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.377938  8807 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:21.378916  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.379307  8807 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Advancing to term 2
I20260709 13:03:21.335914  9639 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.383834  8120 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.370074  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:21.385583  8811 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:21.385720  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:21.355564  9586 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.386956  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:21.355810  9519 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.394025  9519 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.395907  9519 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.387899  8199 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:21.395841  9627 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.396997  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.397609  9642 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.398021  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.399078  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.401458  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.388103  8807 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:21.387414  8802 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.388939  9511 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.389225  9552 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.425625  9552 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.427059  9552 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:21.429507  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.389607  9621 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.390232  9467 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.357338  9588 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:21.430197  9621 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.430549  9588 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.432173  9621 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.432332  9588 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:21.407166  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.417178  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.407895  8270 raft_consensus.cc:2368] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:21.369508  9541 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.434070  9541 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.436008  9541 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.361119  9604 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.436585  9604 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.438494  9604 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.409336  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:21.442166  9592 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.442821  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.442699  9592 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.443900  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.444418  8199 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:21.410050  8020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 163) took 1520 ms. Trace:
I20260709 13:03:21.410427  8198 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.411814  9644 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:21.445142  9644 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.412472  8023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 243) took 2443 ms. Trace:
I20260709 13:03:21.446161  9639 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.445735  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.446774  8118 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:21.447106  8198 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:21.419741  9522 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.421084  9594 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.456928  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:21.457755  8802 raft_consensus.cc:2410] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:03:21.458205  9618 consensus_meta.cc:287] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.540s	user 0.003s	sys 0.004s
I20260709 13:03:21.458565  9618 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:21.367638  9545 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:21.446087  8023 rpcz_store.cc:276] 0709 13:03:18.968637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.968854 (+   217us) service_pool.cc:224] Handling call
0709 13:03:21.412417 (+2443563us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:20.114804 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:20.223719 (+108915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:20.237306 (+ 13587us) write_op.cc:435] Acquired schema lock
0709 13:03:20.237362 (+    56us) tablet.cc:662] Decoding operations
0709 13:03:20.267806 (+ 30444us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:20.272262 (+  4456us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:20.274448 (+  2186us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:20.316438 (+ 41990us) tablet.cc:701] Row locks acquired
0709 13:03:20.316458 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:03:20.329616 (+ 13158us) write_op.cc:270] Start()
0709 13:03:20.331407 (+  1791us) write_op.cc:276] Timestamp: P: 1783602200326176 usec, L: 0
0709 13:03:20.332715 (+  1308us) op_driver.cc:348] REPLICATION: starting
0709 13:03:20.333298 (+   583us) log.cc:844] Serialized 538 byte log entry
0709 13:03:20.358779 (+ 25481us) op_driver.cc:464] REPLICATION: finished
0709 13:03:20.467427 (+108648us) write_op.cc:301] APPLY: starting
0709 13:03:20.467498 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:20.467589 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:20.467694 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:20.467935 (+   241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:20.468081 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:20.468125 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:20.468277 (+   152us) log.cc:844] Serialized 23 byte log entry
0709 13:03:20.468390 (+   113us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.468458 (+    68us) write_op.cc:454] Released schema lock
0709 13:03:20.468491 (+    33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":940141,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":106335,"apply.run_cpu_time_us":1383,"apply.run_wall_time_us":35531,"num_ops":1,"prepare.queue_time_us":789412,"prepare.run_cpu_time_us":3242,"prepare.run_wall_time_us":224667,"replication_time_us":12572,"thread_start_us":159407,"threads_started":1}]]}
I20260709 13:03:21.459297  9545 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.422963  8803 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:21.423341  9473 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.461112  9473 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.423753  8021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 253) took 2586 ms. Trace:
I20260709 13:03:21.424314  9511 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.424819  9501 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.406986  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.444586  9592 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.451211  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.452149  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.467974  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.444906  8020 rpcz_store.cc:276] 0709 13:03:19.889156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.889265 (+   109us) service_pool.cc:224] Handling call
0709 13:03:21.409872 (+1520607us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":366,"reported_tablets":1}
I20260709 13:03:21.455890  9588 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:21.456211  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.469878  8198 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:03:21.422211  9517 consensus_meta.cc:287] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:03:21.466993  8270 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:21.465747  8116 raft_consensus.cc:2410] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:21.466009  8271 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:21.462852  9545 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.472944  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.473557  8199 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:21.474260  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.474666  8777 leader_election.cc:400] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:21.474897  8777 leader_election.cc:403] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:21.479650  8198 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:21.480355  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.480801  8198 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.408097  9512 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.483291  8199 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:21.485023  8199 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:21.466518  9473 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.491961  9475 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:03:21.492309  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.488121  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:21.401599  9586 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.496212  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:21.497578  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:21.521122  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.454881  9519 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:03:21.532498  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.465636  9604 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:21.542197  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:21.489161  9559 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.552497  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:21.553300  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:21.548684  8198 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:21.549670  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.541311  9216 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:21.556565  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.557510  9501 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.557899  9501 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.558348  9501 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.551647  8196 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:21.562175  9511 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.528250  9493 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:21.565281  9493 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.566059  9216 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.566434  9216 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:21.548367  9463 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.487360  9517 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.568475  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:21.464231  8021 rpcz_store.cc:276] 0709 13:03:18.837696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.837843 (+   147us) service_pool.cc:224] Handling call
0709 13:03:21.423699 (+2585856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:19.540608 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:19.541406 (+   798us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:19.541457 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:03:19.541493 (+    36us) tablet.cc:662] Decoding operations
0709 13:03:19.541892 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:19.541980 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:19.542017 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:19.542323 (+   306us) tablet.cc:701] Row locks acquired
0709 13:03:19.542381 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:03:19.542561 (+   180us) write_op.cc:270] Start()
0709 13:03:19.542705 (+   144us) write_op.cc:276] Timestamp: P: 1783602199542496 usec, L: 0
0709 13:03:19.542742 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:03:19.636067 (+ 93325us) log.cc:844] Serialized 538 byte log entry
0709 13:03:19.993971 (+357904us) op_driver.cc:464] REPLICATION: finished
0709 13:03:20.094125 (+100154us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b540006bb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d23e28 00007fbd2875e581 00007fbd2875dd58 00007fbd287629f1 00007fbd287629a9 00007fbd28762939 00007fbd28762901 00007fbd28761b2d 000000000038f354 000000000038f199
0709 13:03:20.458302 (+364177us) write_op.cc:301] APPLY: starting
0709 13:03:20.463233 (+  4931us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:20.463475 (+   242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:20.463521 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:20.463970 (+   449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:20.464206 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:20.464273 (+    67us) write_op.cc:312] APPLY: finished
0709 13:03:20.466345 (+  2072us) log.cc:844] Serialized 23 byte log entry
0709 13:03:20.466542 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.466624 (+    82us) write_op.cc:454] Released schema lock
0709 13:03:20.466679 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:20.467062 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.467087 (+    25us) write_op.cc:454] Released schema lock
0709 13:03:20.533769 (+ 66682us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.535786 (+  2017us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":942093,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":416435,"apply.run_cpu_time_us":2440,"apply.run_wall_time_us":32801,"num_ops":1,"prepare.queue_time_us":353679,"prepare.run_cpu_time_us":25479,"prepare.run_wall_time_us":558352,"raft.queue_time_us":107572,"raft.run_cpu_time_us":70900,"raft.run_wall_time_us":472672,"replication_time_us":451067,"spinlock_wait_cycles":105981312,"thread_start_us":625410,"threads_started":4,"wal-append.queue_time_us":112330,"wal-append.run_cpu_time_us":6606,"wal-append.run_wall_time_us":1786576}]]}
I20260709 13:03:21.528093  9642 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.550726  9541 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:21.573655  9541 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:21.550987  9549 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.570855  9216 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.563498  9497 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.490947  9512 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:21.528257  9473 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:03:21.576515  8197 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:21.567329  9493 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.567049  9627 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.575757  9541 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.571630  9562 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.578944  9216 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.577183  9497 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.569868  9463 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:21.589830  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.587059  9594 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.592835  9463 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.592023  9497 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.585942  9604 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.583051  8198 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:21.578222  9549 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.598970  9594 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:21.612210  9549 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.589635  9562 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:21.612131  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.609577  9604 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.590652  9644 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.615180  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.640380  8271 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:21.615825  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.617797  9604 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.618711  9490 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.642138  9490 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.642683  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.643499  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:21.646610  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.647382  8199 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:21.623512  9642 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.612265  9594 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.624643  9562 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.625597  9518 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.626305  9517 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.626600  8192 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.633569  9559 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:21.598778  9522 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.614367  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.635092  9549 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:21.636408  9548 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:21.637717  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:21.638546  9568 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.672626  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:21.639753  9586 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:21.659931  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 80087.5us
W20260709 13:03:21.661684  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79516.4us
I20260709 13:03:21.664263  9463 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:21.668041  9645 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:03:21.633157  9583 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.695219  9583 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.696250  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.697623  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:21.698132  8270 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:21.678148  9602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.011s	sys 0.029s
I20260709 13:03:21.682889  9512 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.684082  9648 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.685001  9490 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:21.712447  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.666617  9518 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:21.685854  9568 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:21.710870  8266 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:21.676250  9644 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.688205  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.691502  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:21.691529  8272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 987) took 1743 ms (client timeout 1621 ms). Trace:
W20260709 13:03:21.741531  8272 rpcz_store.cc:269] 0709 13:03:19.948233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.948367 (+   134us) service_pool.cc:224] Handling call
0709 13:03:21.691360 (+1742993us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54003b9f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:21.691462 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018921728}
I20260709 13:03:21.693737  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.736953  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:21.743050  8123 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:21.743322  9648 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.744290  9648 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.745105  9523 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.686875  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1371) took 1158 ms. Trace:
I20260709 13:03:21.745700  8192 rpcz_store.cc:276] 0709 13:03:20.528100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.529269 (+  1169us) service_pool.cc:224] Handling call
0709 13:03:21.626281 (+1097012us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:21.626432 (+   151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.669490 (+ 43058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.686808 (+ 17318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9484672}
I20260709 13:03:21.674007  8120 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:21.747885  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 104450us
I20260709 13:03:21.690922  9557 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.751330  9557 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.703375  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.755707  8121 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:21.734625  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.737991  8807 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:21.686633  9544 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.741221  8116 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:21.757306  9532 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.757640  8273 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:21.759766  9544 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:03:21.763043  9610 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.763621  9610 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.763973  9610 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:21.764307  9610 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.761330  9472 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.767097  9472 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.770370  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:21.773571  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.777482  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:21.779770  9610 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.782048  9610 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.783162  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.783738  8119 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.784215  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.785912  8116 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:21.786748  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.787665  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.788549  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.789165  8116 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:21.790886  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.791850  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.792304  8121 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.794072  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.794526  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:21.794716  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.794929  8116 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:21.785255  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.796584  8119 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:21.798077  9610 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.801265  8120 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:21.769199  9472 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.813766  8266 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:21.810668  9610 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:21.709710  9602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.011s	sys 0.029s
I20260709 13:03:21.825793  8121 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:21.703310  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:21.819380  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:21.820276  9518 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.823272  9541 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.825068  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.888360  8267 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:21.817759  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:21.889282  8271 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.826467  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.818810  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.828486  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:21.676673  9548 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.829778  9216 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.891304  9216 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.891656  9216 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.830691  8193 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:21.830685  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:21.892977  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 62364.1us
I20260709 13:03:21.894443  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:21.740082  9568 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.812081  9604 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.734834  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:21.833149  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.834707  8802 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:21.834887  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:21.837107  9630 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.911s	user 0.003s	sys 0.012s
I20260709 13:03:21.837944  9501 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.841042  9657 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.842269  9463 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.894044  9562 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.845480  9483 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.846621  8270 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:21.848387  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:21.946842  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 98514.3us
I20260709 13:03:21.948028  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:21.848456  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:21.840806  9497 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.896682  9568 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.825269  9644 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.962949  8804 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.963205  9644 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.828431  9653 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:21.828685  9473 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.964782  9653 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.965579  9473 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.855677  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.858026  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1441) took 1401 ms. Trace:
I20260709 13:03:21.858713  8200 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:21.859728  9481 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.589s	user 0.003s	sys 0.006s
I20260709 13:03:21.864214  8199 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:21.868119  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.975481  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.975857  8270 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:21.884927  9620 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.978821  8119 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.979352  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:21.979270  9620 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:21.901803  8125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1432) took 1740 ms (client timeout 1843 ms). Trace:
I20260709 13:03:21.902287  9672 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:21.905650  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:21.981820  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:21.982098  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 76516.7us
I20260709 13:03:21.982836  9523 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:21.982977  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:21.983472  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:21.909052  9569 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.984019  8118 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.918016  9557 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.984380  9532 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.956172  9518 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.984946  9532 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:21.985913  9532 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:21.914654  9531 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.989946  8121 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:21.923439  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:21.993618  8272 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:21.994256  9473 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.925834  9537 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.930781  8021 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.931825  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:21.932943  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.998209  8274 raft_consensus.cc:2368] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
W20260709 13:03:21.933495  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.887850  8269 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.960065  9470 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:21.899240  9604 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:21.933971  8265 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:21.941517  8163 leader_election.cc:400] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:21.951258  9216 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:21.953219  9501 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.953666  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1388) took 1080 ms. Trace:
I20260709 13:03:21.898382  9593 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:21.958256  8271 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:21.958797  9552 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:21.959437  9472 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:21.959913  9617 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.961510  9619 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.962944  8805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 412) took 1893 ms. Trace:
I20260709 13:03:21.967047  9653 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:21.831833  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:22.056725  9541 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.028568  9470 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.057934  9648 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:22.058024  9470 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:22.058387  9648 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:22.059180  9648 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:21.967334  9493 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.060253  9648 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:21.898600  9580 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:03:21.970705  9642 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.062142  9642 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.062479  9642 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.065948  9619 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.955050  9657 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.056137  8805 rpcz_store.cc:276] 0709 13:03:20.069779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.070601 (+   822us) service_pool.cc:224] Handling call
0709 13:03:20.077649 (+  7048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.410391 (+332742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.419717 (+  9326us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.475208 (+ 55491us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.557563 (+ 82355us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:20.557602 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.557670 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.836560 (+1278890us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:21.962597 (+126037us) raft_consensus.cc:1685] finished
0709 13:03:21.962630 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.962852 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":313768,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":3500800,"thread_start_us":346364,"threads_started":2,"wal-append.queue_time_us":313276}
I20260709 13:03:22.055932  9497 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:22.075858  9657 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:21.971464  9548 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:21.972607  8266 raft_consensus.cc:2368] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3.
W20260709 13:03:21.961237  9631 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.031s	user 0.017s	sys 0.019s
I20260709 13:03:21.977775  8117 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.973140  8122 rpcz_store.cc:276] 0709 13:03:20.456943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.779213 (+322270us) service_pool.cc:224] Handling call
0709 13:03:21.857849 (+1078636us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54000744d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:21.857971 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193126272}
I20260709 13:03:21.984062  9523 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.929790  8267 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:21.981490  8125 rpcz_store.cc:269] 0709 13:03:20.161373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.172677 (+ 11304us) service_pool.cc:224] Handling call
0709 13:03:21.901664 (+1728987us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400149954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:21.901749 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185320192}
I20260709 13:03:21.983940  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:21.999017  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 220881us
I20260709 13:03:22.003376  8118 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:21.998670  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.080071  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 96206.3us
I20260709 13:03:22.081166  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:21.998541  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:21.937798  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1376) took 1407 ms. Trace:
I20260709 13:03:22.021732  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.081840  8191 rpcz_store.cc:276] 0709 13:03:20.530396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.530771 (+   375us) service_pool.cc:224] Handling call
0709 13:03:20.530994 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.829071 (+298077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.937582 (+1108511us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540002a8d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:21.937741 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673962880}
I20260709 13:03:22.083382  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.083982  8191 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:22.084779  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:22.085856  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 87398us
I20260709 13:03:22.086545  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.087311  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.022333  8806 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:22.022465  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.088728  8200 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:22.023054  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.023684  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:21.998477  8021 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.090049  8197 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:22.090626  8021 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:22.092633  9493 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.092211  8021 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 2 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.092953  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:22.029564  8163 leader_election.cc:403] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.093783  8267 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:22.094112  8021 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 3, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:22.095132  9648 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:22.096632  9648 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:22.067337  9562 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:22.094875  9642 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.047938  9216 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:22.050577  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.026247  9583 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.054833  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.027827  9549 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.102589  8196 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:22.026885  9579 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.030306  8091 leader_election.cc:400] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:22.044426  8193 rpcz_store.cc:276] 0709 13:03:20.873004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.924081 (+ 51077us) service_pool.cc:224] Handling call
0709 13:03:20.924322 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.892522 (+968200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.953449 (+ 60927us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540035cad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:21.953607 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084036480}
I20260709 13:03:22.098290  8089 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:22.018911  9512 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:03:22.097700  9610 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:22.026412  9518 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.102846  9559 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:22.077718  9472 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.111866  9549 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.116003  9472 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.117095  9568 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.117775  9549 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.112233  9579 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:22.119668  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61899.1us
I20260709 13:03:22.120390  9579 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:22.112763  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 83706.9us
I20260709 13:03:22.102124  9552 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:22.018402  9620 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:22.123021  9604 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.054359  9593 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:22.024889  9537 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.102389  9490 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.054064  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:22.107362  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 173007us
I20260709 13:03:22.199405  8163 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:22.200671  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:22.108789  9642 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.109476  9602 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:22.111286  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:22.205411  8267 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:22.124619  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:22.118137  8810 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:22.207621  9568 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.208242  9568 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:22.208706  9568 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.210306  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:22.210945  8121 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:22.211753  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:22.212334  8265 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.214246  8267 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:22.218811  9493 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:22.219772  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:22.220597  8804 raft_consensus.cc:2393] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:22.223011  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:22.114038  8089 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:22.227114  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 113152us
I20260709 13:03:22.227882  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:22.228924  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:22.105293  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.119696  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.125854  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.125941  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:22.231144  8117 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:22.125284  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:22.232045  8122 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:22.125415  8806 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:22.233685  9216 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:22.234179  9216 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.121311  9549 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:03:22.126210  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:22.183418  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:22.183849  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:22.184425  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:22.241907  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 115767us
I20260709 13:03:22.242723  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:22.242748  8809 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:22.194644  9657 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.196676  8125 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:22.099417  9497 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.202342  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:22.079982  9588 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:22.237213  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:22.103065  9658 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.178344  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.103319  9523 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.240871  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:22.256912  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:22.249538  9511 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:22.102943  9580 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.257545  8272 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:22.248972  9497 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.111686  8269 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:22.117822  9472 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.198545  9490 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:22.235824  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 82234.5us
I20260709 13:03:22.262585  9580 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.250427  8274 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:22.115196  9610 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.115554  9518 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.266144  8272 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:22.201628  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:22.239657  9544 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:22.240005  9648 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:22.257642  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:22.257236  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:22.243422  9642 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:22.114936  9512 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.257943  9619 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:22.286103  9619 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:22.286957  9619 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.249684  9602 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:22.261413  9490 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.262204  9472 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.262765  9497 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:22.123576  9583 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.114310  9470 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.247843  9604 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:22.275287  8265 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:22.260061  9658 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.243813  8195 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:22.250880  9216 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:22.295384  8191 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.251919  9657 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.251463  9541 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:22.309917  9541 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:22.310282  9657 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.295244  9472 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.310464  9541 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.293331  9620 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.297436  9602 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.277135  9552 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.316118  9552 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:22.316499  9552 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.316777  8120 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:22.317628  9559 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:22.318091  9559 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:22.318877  9559 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.319550  9470 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.301396  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:22.320868  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:22.256599  9588 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.321938  9579 raft_consensus.cc:2764] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:22.322505  9620 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.282385  9512 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.323266  9512 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.279362  9580 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:22.322908  9620 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.325126  8117 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
W20260709 13:03:22.334336  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.612s (SENT) [suppressed 31 similar messages]
I20260709 13:03:22.312085  9472 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.343708  9568 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.345091  9490 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.345503  9583 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:22.347266  8807 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 3. Ops: []
I20260709 13:03:22.338217  9522 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:22.347987  9522 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:22.349099  9490 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.334785  9588 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.283690  9593 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.350268  9658 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.361750  9583 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.347266  9537 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.362314  9583 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.362984  9610 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.364535  9583 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:22.365715  9518 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.367847  9620 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:22.378546  9581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.013s	sys 0.045s
W20260709 13:03:22.378921  9581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.013s	sys 0.045s
I20260709 13:03:22.348834  9522 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:22.388412  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 491896us
I20260709 13:03:22.352856  9579 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:22.401693  9581 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:22.402245  9581 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:22.403203  9581 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.406315  9523 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:22.389076  8803 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:22.415938  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.422631  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.433135  9497 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.434016  9517 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:22.434410  9517 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:22.433758  9497 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.437229  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:22.457206  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.027s	sys 0.024s
W20260709 13:03:22.457654  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.030s	sys 0.024s
W20260709 13:03:22.486307  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.417165  9579 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.552253  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 115073us
I20260709 13:03:22.553082  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:22.466773  9605 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:22.569404  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:22.570192  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 93204.6us
I20260709 13:03:22.570590  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:22.433251  9653 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 13:03:22.435025  9512 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.555804  9463 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:22.557287  9531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.029s	sys 0.032s
I20260709 13:03:22.509652  9620 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:22.566092  9594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.015s	sys 0.085s
I20260709 13:03:22.581617  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.593477  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.617183  8199 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:22.596614  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.617833  8197 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:22.618803  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.584095  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:22.566843  9532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.004s
I20260709 13:03:22.607865  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.601647  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.567617  9605 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:22.569090  9541 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:22.624194  8021 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.032s	sys 0.036s
W20260709 13:03:22.623220  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 52710.2us
I20260709 13:03:22.651677  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:22.613480  9594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.015s	sys 0.087s
I20260709 13:03:22.583899  9501 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:22.605540  9531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.030s	sys 0.032s
W20260709 13:03:22.657089  8021 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.049s	sys 0.052s
I20260709 13:03:22.605693  9470 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.661715  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:22.656070  9580 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:22.657624  8200 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.579813  9562 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:22.662220  9677 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:22.567386  9579 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:22.662830  9683 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:22.698781  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.667171  8268 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:22.645143  9545 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:03:22.659435  9532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.006s
I20260709 13:03:22.664322  8196 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:22.680778  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:22.698604  9550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.026s	sys 0.063s
W20260709 13:03:22.717157  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.717685  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.012s
I20260709 13:03:22.720315  8197 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:22.657160  9644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.002s	sys 0.025s
W20260709 13:03:22.770370  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.002s	sys 0.012s
I20260709 13:03:22.717965  8194 raft_consensus.cc:3055] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:03:22.718220  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 452499us
I20260709 13:03:22.772091  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:22.772223  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:22.717545  9562 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.774505  8121 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:22.730587  8193 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:22.775331  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:22.773272  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:22.719300  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 482113us
I20260709 13:03:22.778550  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:22.779299  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.779618  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:22.737718  8192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.037s
I20260709 13:03:22.780244  8125 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:22.715370  9511 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:22.785761  8193 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:22.792111  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 232) took 1056 ms. Trace:
I20260709 13:03:22.708379  9552 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.793496  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.708976  9604 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:22.815279  9604 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.816061  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.785840  8200 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:22.818074  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.819044  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.819744  8200 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:22.820425  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:22.820904  8200 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
W20260709 13:03:22.821972  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 487621us
I20260709 13:03:22.833083  9610 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.833742  9610 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.835733  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:22.835877  9610 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:22.858098  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.868337  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.720945  9580 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:22.792714  8811 rpcz_store.cc:276] 0709 13:03:21.735432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.738329 (+  2897us) service_pool.cc:224] Handling call
0709 13:03:21.939410 (+201081us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:21.939610 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.939812 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:22.438731 (+498919us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.791692 (+352961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.791847 (+   155us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:22.791886 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.791957 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.792061 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":780149,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1780,"spinlock_wait_cycles":4930304,"thread_start_us":839236,"threads_started":2}
I20260709 13:03:22.883882  9580 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:22.787456  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.014s	sys 0.002s
I20260709 13:03:22.805299  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:22.808104  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.007s
I20260709 13:03:22.811254  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:22.780241  8192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.005s	sys 0.038s
W20260709 13:03:22.889969  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.012s	sys 0.007s
W20260709 13:03:22.776669  9644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.007s	sys 0.025s
I20260709 13:03:22.889984  8124 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.890280  8809 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:03:22.889784  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.002s
W20260709 13:03:22.890364  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 647658us
I20260709 13:03:22.892637  8091 leader_election.cc:400] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3.
I20260709 13:03:22.892913  8091 leader_election.cc:403] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:22.891731  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 634106us
I20260709 13:03:22.902853  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:22.903640  9610 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:22.904191  9610 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:22.905040  9610 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:22.906065  8124 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:22.914566  8200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13dada18d63642d99cf497f978999d7a"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:51262
I20260709 13:03:22.916607  8200 raft_consensus.cc:606] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:22.917776  8200 raft_consensus.cc:614] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:22.903690  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:22.934862  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.786579  9550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.027s	sys 0.063s
W20260709 13:03:22.990363  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 182365us
I20260709 13:03:22.990505  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:22.990898  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 107040us
I20260709 13:03:23.010643  8118 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:03:22.991351  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.010675  8089 leader_election.cc:400] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:23.011503  8089 leader_election.cc:403] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.814100  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:23.014791  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 122273us
I20260709 13:03:22.781360  9562 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.719431  9470 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:22.786435  9549 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:23.016427  8091 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:23.027952  8806 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:22.989820  9548 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.038s	sys 0.043s
I20260709 13:03:22.776482  9497 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:22.786429  9541 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.780580  8195 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:23.064177  8810 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:22.771721  8194 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:23.048234  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:23.049113  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:23.071424  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:23.063206  8809 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:22.990357  9673 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:23.069654  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.079826  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.791086  9523 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.262s
W20260709 13:03:23.046192  9548 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.038s	sys 0.043s
I20260709 13:03:22.741745  9472 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.010869  9619 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:23.024356  9501 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:23.093536  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:23.035280  9544 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3.
I20260709 13:03:23.045512  9549 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:23.035512  9518 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.045331  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:23.103834  9512 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.031157  9644 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:03:23.078112  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:23.078414  9497 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.101850  9559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.007s	sys 0.003s
I20260709 13:03:23.077929  9673 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:23.089675  9493 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:23.195291  9676 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.486s	user 0.001s	sys 0.000s
I20260709 13:03:23.170970  9533 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:23.197423  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:23.286276  8809 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:23.071302  9550 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:22.742401  9605 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.079912  9541 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.187364  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:23.195967  8194 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:23.287845  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 473781us
I20260709 13:03:23.200258  9501 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.170182  9511 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.203140  9549 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.202505  9592 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.206777  9483 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.233s	user 0.010s	sys 0.000s
I20260709 13:03:23.368093  8809 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:23.283514  9559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.008s	sys 0.008s
I20260709 13:03:23.400739  9523 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:23.439760  8810 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:23.202564  9604 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.204s
I20260709 13:03:23.335314  9493 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:23.205565  9522 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.405992  8196 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:23.372323  9497 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.456254  8194 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.456183  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 407) took 1529 ms. Trace:
W20260709 13:03:23.238544  9679 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.547s	user 0.001s	sys 0.000s
I20260709 13:03:23.207558  9518 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.404878  9579 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:23.205651  9531 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.201s
I20260709 13:03:23.396472  9694 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:23.288256  8120 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:23.473084  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.448971  9680 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.333778  9544 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:23.483695  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 193129us
I20260709 13:03:23.452906  9552 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.466192  9470 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.465667  8802 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:23.439529  9533 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.540462  9711 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:23.556308  9711 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.557108  9533 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:23.558264  9711 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:23.559010  9579 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:23.559382  9579 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:23.560104  9579 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.553684  9694 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:23.562247  9694 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.562906  9518 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:23.564284  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1018) took 1440 ms. Trace:
I20260709 13:03:23.209169  8804 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:23.443251  9592 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.468856  9559 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.405539  9517 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.474931  9667 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:23.201196  9619 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:23.514891  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 284329us
I20260709 13:03:23.583035  9559 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.409459  9673 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.465160  9522 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:23.520299  9701 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:03:23.520660  9569 consensus_meta.cc:287] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.503s	user 0.005s	sys 0.005s
W20260709 13:03:23.521303  9681 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:03:23.521492  9699 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:23.612600  9699 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:23.506625  9472 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:23.517964  9689 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 13:03:23.613273  9699 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:23.516613  9688 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:03:23.614393  9699 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.615051  8120 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:23.615176  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1016) took 1493 ms. Trace:
I20260709 13:03:23.525271  9581 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:23.613261  9501 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:23.616194  9549 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.617197  8807 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:23.617690  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:23.617050  9699 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.620623  9522 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.526127  9541 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:23.527112  9605 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.621915  9594 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.622583  9684 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.532s	user 0.001s	sys 0.002s
I20260709 13:03:23.622406  9594 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:23.530192  9463 consensus_meta.cc:287] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.917s	user 0.007s	sys 0.001s
I20260709 13:03:23.507584  9493 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.499222  8808 rpcz_store.cc:276] 0709 13:03:21.923358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.923905 (+   547us) service_pool.cc:224] Handling call
0709 13:03:21.924203 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:21.924537 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:21.924567 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:21.924998 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.395130 (+470132us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:22.397674 (+  2544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.442026 (+ 44352us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.409178 (+967152us) raft_consensus.cc:1685] finished
0709 13:03:23.409197 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.452761 (+ 43564us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1902,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":464479,"threads_started":1,"wal-append.queue_time_us":698066}
I20260709 13:03:23.531446  9562 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:23.521508  9705 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:23.533555  9697 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.549427  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 478036us
I20260709 13:03:23.551151  8238 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:23.638236  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 87161.2us
I20260709 13:03:23.565640  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:23.550220  9716 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:23.569455  9680 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.570658  9497 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:23.552731  9544 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.561211  9579 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.564692  8271 rpcz_store.cc:276] 0709 13:03:22.123954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.195489 (+ 71535us) service_pool.cc:224] Handling call
0709 13:03:22.218491 (+ 23002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.267584 (+ 49093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.267612 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.268056 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.708734 (+440678us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:22.708779 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.503561 (+794782us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b5400154354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:23.503623 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.563979 (+ 60356us) raft_consensus.cc:1685] finished
0709 13:03:23.563999 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.564215 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2913,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":105520000,"thread_start_us":415724,"threads_started":1,"wal-append.queue_time_us":1241239}
I20260709 13:03:23.581305  9592 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:23.581754  8194 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:03:23.582509  9216 raft_consensus.cc:1064] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
W20260709 13:03:23.585116  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.471941  9696 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:23.554067  9531 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.590618  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.591835  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:23.592672  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:23.607271  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:23.610519  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:23.611217  9673 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:23.621493  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:23.611856  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:23.615640  8266 rpcz_store.cc:276] 0709 13:03:22.121971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.122121 (+   150us) service_pool.cc:224] Handling call
0709 13:03:22.122354 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.122631 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.122655 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.123085 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.583200 (+460115us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:22.583235 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.583296 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.614743 (+1031447us) raft_consensus.cc:1685] finished
0709 13:03:23.614765 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.615024 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3079,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":53813,"thread_start_us":459799,"threads_started":1,"wal-append.queue_time_us":903026}
I20260709 13:03:23.626070  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:23.586428  9545 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.627488  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:23.636642  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.606251  9517 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:23.637746  9463 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:23.646165  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1407) took 1072 ms. Trace:
W20260709 13:03:23.647720  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 82153.8us
I20260709 13:03:23.647917  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:23.615235  9685 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.580s	user 0.000s	sys 0.001s
W20260709 13:03:23.733731  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85869.5us
I20260709 13:03:23.650064  9544 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.734607  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:23.732605  8191 rpcz_store.cc:276] 0709 13:03:22.574026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.582046 (+  8020us) service_pool.cc:224] Handling call
0709 13:03:22.582321 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.582638 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:23.088666 (+506028us) log.cc:844] Serialized 14 byte log entry
0709 13:03:23.645821 (+557155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:23.645877 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:23.645920 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.645989 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.646106 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":625503,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":75742,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":1001571,"threads_started":3,"wal-append.queue_time_us":427796}
I20260709 13:03:23.735437  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:23.611903  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:23.654597  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.736783  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.654412  9216 raft_consensus.cc:1068] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Unable to promote non-voter 17c126976afd40d9a398d13a5ddd222f: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:03:23.690894  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.646445  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:23.637529  9472 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.637837  9667 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:23.770085  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.646682  9511 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:03:23.691287  8272 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:23.654304  8194 pending_rounds.cc:85] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 2
I20260709 13:03:23.731479  8265 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:23.646474  9470 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.646633  9644 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.725317  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:23.646529  9512 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:23.769438  9548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.004s	sys 0.015s
I20260709 13:03:23.730340  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:23.654021  9721 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:23.732115  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:23.720821  9714 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:23.725594  8809 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:23.658301  9696 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:23.732698  9593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.000s	sys 0.019s
I20260709 13:03:23.658879  9704 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:23.766888  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:23.770792  9730 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.775023  8163 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:23.781647  9548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.016s
I20260709 13:03:23.799345  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:23.650141  9657 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:03:23.800665  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 61267.2us
I20260709 13:03:23.691350  8811 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
W20260709 13:03:23.776837  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.729830  9726 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:23.647260  9697 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.732676  9545 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.691632  8267 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.730626  8268 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:23.736930  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:23.800856  9604 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:23.806501  9604 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.806735  8803 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:23.767355  9581 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:23.806877  9604 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:23.728586  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.807116  9581 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:23.807546  9581 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:23.807865  9735 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:03:23.776183  9667 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.811522  9667 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:23.812204  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 422) took 1038 ms. Trace:
I20260709 13:03:23.812558  8803 rpcz_store.cc:276] 0709 13:03:22.774228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.780404 (+  6176us) service_pool.cc:224] Handling call
0709 13:03:23.730772 (+950368us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:23.812144 (+ 81372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410895104}
I20260709 13:03:23.816334  9581 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:23.817240  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.817802  9562 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:23.818609  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:23.819432  9697 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.820336  8270 raft_consensus.cc:2393] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:23.821445  9726 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:23.823868  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:23.824177  9545 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:23.805214  9548 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:23.825374  9726 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.825969  9604 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.829160  9548 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:23.829295  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:23.829576  9548 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.829943  8803 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.830044  9604 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:23.829943  9548 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:23.776676  9610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.011s	sys 0.015s
W20260709 13:03:23.781880  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.006s	sys 0.015s
I20260709 13:03:23.768294  9549 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.650255  9716 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.782694  9216 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:23.766427  9653 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:23.730813  8804 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:23.783119  9470 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.782261  9644 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.782158  9512 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:23.776799  8239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.021s
W20260709 13:03:23.782864  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 50834.1us
I20260709 13:03:23.783825  8272 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:23.784614  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54356.1us
W20260709 13:03:23.784829  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.722872  9531 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:23.787104  8197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.018s	sys 0.025s
W20260709 13:03:23.795549  9593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.000s	sys 0.019s
W20260709 13:03:23.802788  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.783357  9721 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:23.776407  9472 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.776965  8194 pending_rounds.cc:107] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:03:23.804869  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:23.836890  9548 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.785956  9619 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.128019  9533 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:23.867699  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:23.799242  8269 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:23.787490  9696 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:23.848951  8802 raft_consensus.cc:2410] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:23.803399  9522 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.473s
W20260709 13:03:23.862558  9692 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.394s	user 0.001s	sys 0.002s
W20260709 13:03:23.837638  9610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.012s	sys 0.015s
I20260709 13:03:23.837458  9463 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:24.256561  9533 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:23.846423  9715 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
I20260709 13:03:23.803611  9724 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:23.868487  9604 raft_consensus.cc:1064] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:24.218842  9704 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.136420  9511 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.177955  9523 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:24.177871  9694 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.959293  9725 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.890935  9581 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.278852  9721 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.196996  9695 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.863523  9559 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:23.976238  9544 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.277971  9653 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:24.295073  9531 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.289812  9694 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:23.801522  9730 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.296034  9653 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.293893  9533 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.298949  9533 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.289889  9725 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.296950  9694 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.289470  9704 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.297226  9730 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.295884  9680 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.303153  9716 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.303273  9704 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.286574  9724 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.303982  9724 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.295053  9695 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:24.288798  9604 raft_consensus.cc:1068] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Unable to promote non-voter 17c126976afd40d9a398d13a5ddd222f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:24.302469  9725 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.309825  9721 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:24.335805  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.006s	sys 0.029s
I20260709 13:03:24.337337  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1480) took 1550 ms. Trace:
I20260709 13:03:24.337999  8125 rpcz_store.cc:276] 0709 13:03:22.786825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.786942 (+   117us) service_pool.cc:224] Handling call
0709 13:03:22.787232 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.787417 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.787441 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.787826 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:03:23.298663 (+510837us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:23.298697 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.298764 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.777189 (+478425us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:24.336270 (+559081us) raft_consensus.cc:1685] finished
0709 13:03:24.336346 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.337035 (+   689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29595520,"thread_start_us":263448,"threads_started":1,"wal-append.queue_time_us":530205}
I20260709 13:03:24.339754  8118 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:24.341467  8197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.039s	sys 0.041s
I20260709 13:03:24.343544  8124 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:24.343453  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 538496us
I20260709 13:03:24.344540  8194 raft_consensus.cc:2917] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:03:24.344805  8238 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:24.352398  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 484585us
I20260709 13:03:24.352573  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 140) took 1574 ms. Trace:
I20260709 13:03:24.352932  9532 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.353437  9694 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:24.354574  9694 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.355268  9620 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:24.350011  8806 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:24.136833  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1475) took 1355 ms. Trace:
I20260709 13:03:23.889395  8267 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:24.347471  9523 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:23.972801  8193 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:24.257400  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 220813us
I20260709 13:03:24.361536  9562 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:24.362149  9562 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.362643  9562 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.981729  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:23.870635  8266 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:24.365931  8271 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:24.348942  8805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 235) took 2229 ms. Trace:
I20260709 13:03:24.342156  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.367981  8807 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:24.362092  9511 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.371143  9511 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.372344  9581 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:24.341192  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.372843  9581 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.355810  9729 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.373358  9581 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.374027  9729 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.368170  8121 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:23.869786  8274 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:24.353720  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:24.338351  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 1.29004e+06us
I20260709 13:03:23.871850  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.355898  9620 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:24.358557  9548 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:24.278354  8272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1022) took 1173 ms (client timeout 1522 ms). Trace:
I20260709 13:03:23.819224  8191 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:24.395169  9620 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.398413  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:24.356417  8197 rpcz_store.cc:276] 0709 13:03:22.777792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.777894 (+   102us) service_pool.cc:224] Handling call
0709 13:03:22.778159 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.778332 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:23.208542 (+430210us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.351720 (+1143178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:24.351838 (+   118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:24.352053 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.352237 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.352434 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11109,"prepare.queue_time_us":577549,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":12169,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":326,"thread_start_us":1351639,"threads_started":2,"wal-append.queue_time_us":604919}
I20260709 13:03:24.408748  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.414750  8122 rpcz_store.cc:276] 0709 13:03:22.771186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.773439 (+  2253us) service_pool.cc:224] Handling call
0709 13:03:22.773717 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.780524 (+  6807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.780558 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.786360 (+  5802us) log.cc:844] Serialized 26 byte log entry
0709 13:03:23.298348 (+511988us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:23.639191 (+340843us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.124944 (+485753us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800321760. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:03:24.125124 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.125195 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:24.125233 (+    38us) raft_consensus.cc:1685] finished
0709 13:03:24.125325 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.126117 (+   792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28093,"prepare.queue_time_us":348563,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":32066,"raft.queue_time_us":493217,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":24826,"spinlock_wait_cycles":7495552,"thread_start_us":502534,"threads_started":2,"wal-append.queue_time_us":482167}
W20260709 13:03:24.416772  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.418433  9592 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:24.418701  9694 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.418972  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:24.419965  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.421002  8270 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:24.421813  9644 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.422209  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:24.427065  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.427158  9512 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:24.427707  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.428211  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.429296  9523 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.429598  9725 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.430709  8197 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:24.430352  9725 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.429615  9699 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.432821  9699 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.433715  9592 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:24.434803  8271 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:24.435137  9592 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:24.436700  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 83232us
I20260709 13:03:24.437690  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 417) took 1326 ms. Trace:
I20260709 13:03:24.438098  8806 rpcz_store.cc:276] 0709 13:03:23.112175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.187965 (+ 75790us) service_pool.cc:224] Handling call
0709 13:03:23.188303 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.382275 (+1193972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.437392 (+ 55117us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54005654d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:24.437605 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2669440896}
I20260709 13:03:24.367687  8805 rpcz_store.cc:276] 0709 13:03:22.126817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.128623 (+  1806us) service_pool.cc:224] Handling call
0709 13:03:22.224275 (+ 95652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.224629 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.224659 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.225193 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.683341 (+458148us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:22.691379 (+  8038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.701459 (+ 10080us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.861997 (+1160538us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:24.348145 (+486148us) raft_consensus.cc:1685] finished
0709 13:03:24.348195 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.348658 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86204,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":56463104,"thread_start_us":429673,"threads_started":1,"wal-append.queue_time_us":1136646}
W20260709 13:03:24.439041  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.439538  9731 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.440062  8775 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:24.440491  8121 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:24.440227  9731 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.443746  9731 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:24.445524  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.439530  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.439499  9463 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:24.446316  8193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 142) took 1666 ms (client timeout 1812 ms). Trace:
I20260709 13:03:24.446404  9531 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:24.446800  8272 rpcz_store.cc:269] 0709 13:03:23.105004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.181427 (+ 76423us) service_pool.cc:224] Handling call
0709 13:03:23.591690 (+410263us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b58000f5d98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:24.278290 (+686600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5697280}
I20260709 13:03:24.437587  9532 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.448159  8273 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:24.448606  9594 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.430110  9604 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:24.450743  9470 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.452631  9511 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:24.453336  9523 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.453843  9512 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.433246  9725 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.456071  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.452865  8270 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.479842  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.480460  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:24.473129  8193 rpcz_store.cc:269] 0709 13:03:22.778288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.793265 (+ 14977us) service_pool.cc:224] Handling call
0709 13:03:24.444964 (+1651699us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540022c254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:24.445163 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679046912}
I20260709 13:03:24.437872  9730 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:24.482337  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.435981  9619 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.454874  9472 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.474548  9694 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.456727  9653 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.504290  9694 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:24.506265  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.507494  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.507711  9653 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.507874  9694 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.488765  9730 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.508631  9730 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:24.509311  8803 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.003s
I20260709 13:03:24.511346  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.512398  9533 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.510087  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.513134  9533 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:24.513787  8192 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:24.514216  9752 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:24.515228  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.516533  9533 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.516973  9523 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.511848  8803 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:24.517673  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.515029  9752 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.519191  9523 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.519738  9511 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.520058  9752 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.510578  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.521872  9511 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.512835  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.526960  9544 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.528410  9726 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:24.529561  8239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.000s	sys 0.035s
I20260709 13:03:24.529419  9531 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.511174  9704 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.531030  9704 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:24.531905  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.531750  9749 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:24.532904  9749 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.505461  9699 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.509773  9512 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.509625  9605 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.511822  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.534394  9605 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.509467  8197 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:24.535449  8194 raft_consensus.cc:2889] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.512048  9731 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:24.536666  9605 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.536530  9731 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:24.537705  9455 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:24.521142  9721 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.533524  9716 raft_consensus.cc:2764] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:24.540901  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.541704  8267 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:24.511935  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.543421  8191 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:24.547531  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.548072  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.535128  8199 raft_consensus.cc:2393] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:24.548324  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.548854  8804 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 1.
I20260709 13:03:24.511112  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:24.549746  9653 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.550185  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.551951  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:24.552533  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.553704  9216 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:24.553998  8122 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:24.554553  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.555125  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.556304  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.558897  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.559669  8199 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:24.535224  9463 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.562911  9512 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.563251  9619 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.563787  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:24.561434  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 132532us
I20260709 13:03:24.548233  8197 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.482936  8802 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Advancing to term 3
I20260709 13:03:24.560647  9696 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.565941  9216 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.444887  9581 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.580703  8270 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:24.579088  9216 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.517249  9533 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:24.539450  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:24.589386  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 134098us
I20260709 13:03:24.587028  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.587285  8193 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:24.564977  9729 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.550681  9523 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:24.593850  8199 raft_consensus.cc:2410] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:24.529078  9726 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.578631  9605 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:24.585821  9544 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:24.599877  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.600716  8163 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.593070  9533 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:24.607631  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 55860.1us
I20260709 13:03:24.609575  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:24.610250  9619 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.610960  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.611277  9724 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.611836  8198 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:24.612524  8191 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:24.592453  9749 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.586199  9604 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.615939  9532 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.554510  9713 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:03:24.606305  9533 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.613207  9695 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.624584  9721 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:24.642776  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 47223.3us
I20260709 13:03:24.633234  9680 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:24.618105  9531 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.646136  9696 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.648021  9726 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.649674  9522 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:24.659561  8192 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:24.662209  9216 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:24.664662  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 72521.5us
I20260709 13:03:24.674299  9695 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:24.676601  9593 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:24.677213  9593 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:24.677609  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 68153.2us
I20260709 13:03:24.679060  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:24.679972  8119 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:24.680399  9522 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.640403  9731 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.688174  9699 raft_consensus.cc:1064] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
W20260709 13:03:24.688573  9699 raft_consensus.cc:1068] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Unable to promote non-voter 17c126976afd40d9a398d13a5ddd222f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:24.689708  8269 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.690752  8271 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.691418  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:24.691960  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.690002  8272 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:24.635087  9619 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:24.668063  8197 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:24.692193  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:24.667272  8196 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:24.696153  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 141126us
I20260709 13:03:24.696997  8271 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:24.697850  8775 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.698215  9493 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:24.698443  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.699491  9522 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.699659  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:24.700242  9711 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:24.700660  9711 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:24.700809  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.701648  8811 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:24.701798  9725 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:24.702325  9725 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:24.701676  9549 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:03:24.703310  9725 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.638855  9704 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.662345  9721 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.641100  9544 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:24.705287  9721 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.706261  9581 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:24.707333  9756 log.cc:927] Time spent T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:24.709309  9604 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.614781  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1380) took 4075 ms. Trace:
I20260709 13:03:24.705505  9493 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.710232  9493 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.712355  9730 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.714515  8119 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:24.694088  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.665096  8124 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:24.701056  9711 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.696949  8273 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:03:24.718048  9619 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:24.719276  8125 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:24.719866  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.720242  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.720839  8125 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.637707  9605 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:24.692871  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53496.4us
I20260709 13:03:24.722111  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.736207  8122 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:24.735772  8196 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:24.675073  9216 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.679847  9593 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.742023  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.735806  8197 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.744762  8119 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.741891  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.715909  8194 rpcz_store.cc:276] 0709 13:03:20.531440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.534215 (+  2775us) service_pool.cc:224] Handling call
0709 13:03:20.556828 (+ 22613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.536819 (+3979991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.584371 (+ 47552us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b540014d2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:24.603378 (+ 19007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4962392960}
I20260709 13:03:24.746254  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.745077  8117 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:24.747138  8194 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:24.747642  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.719240  9619 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.746207  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.749339  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.750025  8118 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:24.748209  8117 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:24.720772  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.752612  8116 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:24.748172  9617 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:24.754065  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.754216  9617 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.756454  9617 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.741720  9581 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.758405  9581 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.758766  9605 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.742817  8269 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:24.760246  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:24.760382  9581 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.762850  9620 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.764240  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.764914  9620 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.765010  8266 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:24.765553  8123 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.765736  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.765992  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:24.766938  8266 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:24.767103  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.768181  8266 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.768992  8271 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:24.773285  8266 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.777530  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.776772  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.774057  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.780382  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:24.787238  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 49129.1us
I20260709 13:03:24.746284  9730 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.753618  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.777060  8195 raft_consensus.cc:2368] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:24.787236  8124 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.709615  9667 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:03:24.789575  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.802034  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.796600  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:24.804121  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:24.801573  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19747a1b37df480faebc96d93689cda5"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44548
W20260709 13:03:24.836105  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 143343us
I20260709 13:03:24.835152  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:24.838287  8270 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.839304  9610 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:24.840234  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.851313  8125 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 1.
I20260709 13:03:24.840579  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:24.799403  8192 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.842042  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.842453  9562 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.835595  9549 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:24.834535  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:24.834259  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.835904  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.844727  8273 raft_consensus.cc:606] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:03:24.809731  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.850258  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.811172  9592 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.853128  8266 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:24.884414  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.852489  9610 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:24.854143  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.858201  8197 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.856829  9725 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:24.879158  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.861100  8810 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:24.834730  9673 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.891496  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.891657  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.892409  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.892634  8266 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:24.789733  9696 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:03:24.834653  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.860522  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.895714  8198 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:24.799470  9721 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.854945  9549 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:03:24.897555  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.899525  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.898443  8200 pending_rounds.cc:85] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:03:24.886868  9724 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.903174  8265 raft_consensus.cc:2368] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:24.900259  9472 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:03:24.889133  9610 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:24.904282  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 110224us
I20260709 13:03:24.902197  8200 pending_rounds.cc:107] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:24.892396  8194 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.905761  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.907112  8200 raft_consensus.cc:2889] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.908022  8807 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:03:24.907428  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62186.1us
I20260709 13:03:24.908771  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.909312  8266 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.910517  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.911840  9680 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:24.912245  9680 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.912619  9752 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.913261  9752 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.901922  8804 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:24.914363  8120 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.912600  9680 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.910521  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:24.915302  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:24.916111  9562 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:24.912308  9549 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.917333  9549 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.921433  9673 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.921718  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.922971  8272 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:24.923604  9673 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.924402  8120 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:24.924638  8125 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:24.925084  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:24.921449  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:24.926057  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.926644  8271 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:24.929724  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:24.908151  9619 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.890746  9493 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.934291  8199 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:24.916121  8803 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:24.915328  9752 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.931972  8269 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:24.930303  8274 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:24.951835  8270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19747a1b37df480faebc96d93689cda5"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44548
W20260709 13:03:24.951000  9763 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.095s	user 0.000s	sys 0.005s
I20260709 13:03:24.957998  8021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 164) took 3378 ms. Trace:
I20260709 13:03:24.957231  8019 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.960096  9721 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.920301  8194 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:24.964108  8270 raft_consensus.cc:606] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:03:24.977273  9562 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:24.977826  9562 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:24.978371  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:24.957996  9764 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:24.979063  9562 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.965320  8119 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:24.934994  9619 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.982995  9493 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.983762  9619 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:24.985085  9711 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:24.960681  9680 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.989982  9680 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:24.991631  8270 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:24.992265  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.991578  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.992754  8274 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:24.994390  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:24.995062  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63576.8us
I20260709 13:03:24.994308  8274 pending_rounds.cc:85] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 2
I20260709 13:03:24.995733  8274 pending_rounds.cc:107] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:24.995965  8274 raft_consensus.cc:2889] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.996395  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:24.953528  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:24.911295  9592 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:24.969904  8198 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:24.966701  8019 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.951428  9724 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.999461  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.964213  8021 rpcz_store.cc:276] 0709 13:03:21.579520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.583332 (+  3812us) service_pool.cc:224] Handling call
0709 13:03:24.957769 (+3374437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.266239 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.472859 (+206620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.475450 (+  2591us) write_op.cc:435] Acquired schema lock
0709 13:03:23.476864 (+  1414us) tablet.cc:662] Decoding operations
0709 13:03:23.525849 (+ 48985us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.525907 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.525934 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:23.526408 (+   474us) tablet.cc:701] Row locks acquired
0709 13:03:23.526439 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:03:23.526576 (+   137us) write_op.cc:270] Start()
0709 13:03:23.526688 (+   112us) write_op.cc:276] Timestamp: P: 1783602203526535 usec, L: 0
0709 13:03:23.526710 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.527297 (+   587us) log.cc:844] Serialized 2112 byte log entry
0709 13:03:24.290413 (+763116us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.410634 (+120221us) write_op.cc:301] APPLY: starting
0709 13:03:24.410835 (+   201us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:24.411072 (+   237us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:24.411201 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:24.411972 (+   771us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:24.412236 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:03:24.412283 (+    47us) write_op.cc:312] APPLY: finished
0709 13:03:24.412676 (+   393us) log.cc:844] Serialized 47 byte log entry
0709 13:03:24.412900 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.473893 (+ 60993us) write_op.cc:454] Released schema lock
0709 13:03:24.486792 (+ 12899us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:24.516309 (+ 29517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.516346 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45529,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":119788,"apply.run_cpu_time_us":3352,"apply.run_wall_time_us":105695,"num_ops":5,"prepare.queue_time_us":1095094,"prepare.run_cpu_time_us":22636,"prepare.run_wall_time_us":566510,"raft.queue_time_us":476543,"raft.run_cpu_time_us":10783,"raft.run_wall_time_us":252826,"replication_time_us":763550,"thread_start_us":1260361,"threads_started":4,"wal-append.queue_time_us":273729}]]}
I20260709 13:03:25.000065  8273 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
W20260709 13:03:24.999022  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 69349.8us
I20260709 13:03:25.000979  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:25.001830  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 48383.4us
I20260709 13:03:24.974948  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:24.934966  9759 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:03:24.979607  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:24.970137  8802 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:03:24.997788  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.995151  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:24.976248  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:25.007726  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.011785  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.012107  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.998600  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:25.009228  8019 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.014093  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:25.016651  8271 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.019182  8266 raft_consensus.cc:2393] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.018112  8088 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:25.000533  9711 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:25.032862  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:25.033860  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:25.035663  8274 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:25.037955  8199 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.042788  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:25.043479  8806 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:25.043699  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 173) took 1175 ms. Trace:
I20260709 13:03:25.043881  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:25.044186  8265 rpcz_store.cc:276] 0709 13:03:23.868744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.872720 (+  3976us) service_pool.cc:224] Handling call
0709 13:03:25.043459 (+1170739us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400346a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:25.043629 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134805760}
I20260709 13:03:25.014814  9493 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:25.046046  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:25.021705  9680 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:25.041563  8238 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.036304  8019 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.009034  9619 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.051324  8197 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:25.079778  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.039716  9694 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:25.080101  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.053134  8195 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.112287  8266 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.045280  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:25.121806  9694 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:25.049990  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:25.130558  8010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 72586.4us
I20260709 13:03:25.033298  9724 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:25.142309  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.161481  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.052978  9549 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:25.161824  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:25.154220  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 71148.8us
I20260709 13:03:25.083578  9493 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:25.150796  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:25.164690  8271 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:25.133915  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 53877.4us
I20260709 13:03:25.131088  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:25.057130  9680 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.052562  9757 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:25.079464  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:25.169148  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.168509  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.168699  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.174046  8119 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
W20260709 13:03:25.167404  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 137641us
I20260709 13:03:25.154692  8019 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.151201  9605 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:25.218071  8777 leader_election.cc:400] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:25.177628  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:25.219111  8270 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:25.178495  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.179512  9724 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:25.180220  9544 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:25.131821  9523 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:03:25.181458  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:25.159730  8120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:25.170039  8804 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
W20260709 13:03:25.182948  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.183871  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.164083  9619 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:25.184592  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:25.187073  8199 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:25.187291  8806 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:25.188627  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.188884  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19747a1b37df480faebc96d93689cda5"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:25.234195  8271 raft_consensus.cc:606] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:03:25.166332  9694 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.189635  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:25.189793  8265 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:25.190037  8194 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:03:25.181721  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.191195  8274 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:25.193137  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.218446  8777 leader_election.cc:403] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:25.250905  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.251796  8274 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:25.221961  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:25.222899  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.222828  8125 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.225268  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.183972  9592 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:25.226157  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:25.227080  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.192549  9680 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.192396  9757 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.232662  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:25.218420  9605 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.218736  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:25.268433  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 101832us
I20260709 13:03:25.247539  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.255751  8196 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:25.258764  8268 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.254513  8269 raft_consensus.cc:2368] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:25.274528  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.263005  8775 leader_election.cc:400] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:25.265794  8197 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:25.275769  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:25.275877  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:25.250073  8194 pending_rounds.cc:85] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 4
I20260709 13:03:25.270241  8199 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:25.250905  9617 raft_consensus.cc:2764] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:03:25.283094  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.267186  9757 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.284022  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.266733  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.229740  8195 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:25.279533  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.268327  9605 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.276367  8198 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.249889  9673 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:03:25.263907  9493 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:25.290133  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.278518  8194 pending_rounds.cc:107] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:03:25.273077  9544 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:25.285496  9581 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:25.272857  9667 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:25.304369  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.283294  9730 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.315685  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:25.316275  8121 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.285166  8802 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.269450  9610 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:25.297734  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.320600  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:25.313232  8194 raft_consensus.cc:2889] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:25.341799  9773 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:03:25.342218  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.345860  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.309703  9523 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:25.345731  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.321393  8266 raft_consensus.cc:2376] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4. Re-sending same reply.
I20260709 13:03:25.351861  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:25.352461  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.353662  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:25.354172  8116 raft_consensus.cc:2376] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4. Re-sending same reply.
I20260709 13:03:25.320737  9581 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:25.359151  8197 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:25.361110  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:25.361783  8266 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.353534  9523 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:25.362488  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.363626  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.364797  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:25.366310  8197 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:25.373245  8196 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:25.374325  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.374938  8196 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
W20260709 13:03:25.373271  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 113877us
I20260709 13:03:25.381438  8270 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:25.378561  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.350783  9730 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:25.385265  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.386130  8270 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.360198  8195 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:25.388703  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:25.384514  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.391558  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.392097  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.392908  8196 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:25.395346  8200 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
W20260709 13:03:25.393235  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 208708us
I20260709 13:03:25.403822  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:25.404922  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.397203  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.401335  8116 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:25.406652  8266 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.408092  9787 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:25.408521  9787 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.408859  9787 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.409261  9724 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:25.409816  9724 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:25.409225  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.391427  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:25.411845  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.412019  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:25.420256  8200 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:25.413079  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.425516  8196 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:25.440256  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 156275us
I20260709 13:03:25.489842  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.495976  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.496815  8266 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:25.493016  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 83928us
I20260709 13:03:25.414630  9673 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:25.411713  9786 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:25.514973  9788 raft_consensus.cc:2764] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:25.480360  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.497642  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.499605  9619 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:25.620592  8166 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.612s (SENT)
I20260709 13:03:25.624248  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:25.631677  8191 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:25.624190  8269 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.648687  8197 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:25.653075  8191 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:25.654332  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.625805  9532 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:25.626463  9610 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:25.662262  9793 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:25.662642  9619 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:25.663719  8197 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:25.666015  9523 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:25.520939  9581 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:25.670562  9780 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.273s	user 0.001s	sys 0.001s
I20260709 13:03:25.651587  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:25.662298  9785 log.cc:927] Time spent T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:03:25.632483  9694 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:25.680395  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 190618us
I20260709 13:03:25.661192  9724 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:25.679541  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.691339  8267 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
W20260709 13:03:25.678663  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 264932us
W20260709 13:03:25.694945  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 182180us
W20260709 13:03:25.695225  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.692417  8238 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.696147  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:25.707563  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:25.708201  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.707674  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.708475  8272 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:25.708890  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.709249  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.709043  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 94631.4us
I20260709 13:03:25.710194  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:25.669780  9549 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:25.712468  8810 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:25.712395  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:25.687290  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.714246  8119 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:25.714430  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 98840.3us
I20260709 13:03:25.678450  9532 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:25.715726  8265 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:25.698762  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:25.696795  9730 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:25.778399  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49853.9us
W20260709 13:03:25.752179  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53875.1us
W20260709 13:03:25.726297  8166 leader_election.cc:336] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.637s (SENT)
I20260709 13:03:25.720671  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:25.782142  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:25.783854  8272 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:25.716180  9549 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.720397  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.768440  8121 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
W20260709 13:03:25.785833  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.770855  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.799104  8198 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:25.794674  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.820186  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:25.830006  8194 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:25.830700  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:25.831316  8192 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:25.780422  9533 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.112s	user 0.008s	sys 0.004s
W20260709 13:03:25.730515  9784 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:25.872403  8200 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
W20260709 13:03:25.887912  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.902931  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.751950  9802 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:25.720712  9789 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:25.779042  9791 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:03:25.729926  9778 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 13:03:25.981801  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 201999us
I20260709 13:03:25.781667  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:25.977449  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 259823us
W20260709 13:03:25.994221  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 267934us
I20260709 13:03:25.994762  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:25.732998  9673 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:26.003837  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.956863  9790 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:25.764778  9605 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:25.983700  9752 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:25.983348  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:25.990533  9544 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:25.989866  9796 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:26.027281  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.004308  9523 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.028399  9523 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:26.024660  9787 consensus_meta.cc:287] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:03:26.012936  9532 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.029327  9787 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.028801  9523 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.031682  9787 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:26.032871  9787 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.033190  9790 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.033715  9787 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.033932  9790 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.036578  9787 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:26.036734  9790 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.032866  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.037631  9605 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.040076  9523 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.040925  8116 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:25.982858  9533 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:26.054078  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58223.3us
W20260709 13:03:26.054109  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.054853  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.016186  9752 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.062471  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:26.062764  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 188) took 1048 ms. Trace:
I20260709 13:03:26.062896  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 129) took 1100 ms. Trace:
I20260709 13:03:26.060904  9605 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:03:26.064040  9523 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:26.064523  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 836736us
I20260709 13:03:26.065382  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:26.080549  8810 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.065879  9786 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.081693  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.068611  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.025856  9730 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:03:26.026382  9694 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.069955  8117 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:26.050158  9796 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:26.070514  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.070845  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.073546  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.088797  8119 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:26.075673  8121 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:26.088907  8199 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:26.076681  8124 rpcz_store.cc:276] 0709 13:03:24.962448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.962570 (+   122us) service_pool.cc:224] Handling call
0709 13:03:24.977742 (+ 15172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.978173 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.978204 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.978670 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.165559 (+186889us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:25.190175 (+ 24616us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.190356 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.190419 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.062724 (+872305us) raft_consensus.cc:1685] finished
0709 13:03:26.062741 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.062847 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24154,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1090,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"spinlock_wait_cycles":64862592,"thread_start_us":186486,"threads_started":1,"wal-append.queue_time_us":372703}
I20260709 13:03:26.087168  9786 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:26.092124  9541 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:26.092448  8118 raft_consensus.cc:2368] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4.
I20260709 13:03:26.076419  8273 rpcz_store.cc:276] 0709 13:03:25.014202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.014301 (+    99us) service_pool.cc:224] Handling call
0709 13:03:25.033662 (+ 19361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.132310 (+ 98648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.132345 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.167527 (+ 35182us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.318173 (+150646us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:25.318209 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.318272 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.062566 (+744294us) raft_consensus.cc:1685] finished
0709 13:03:26.062590 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.062714 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68995,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10229,"thread_start_us":129053,"threads_started":1,"wal-append.queue_time_us":200802}
I20260709 13:03:26.092950  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.077020  9752 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.095544  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:26.100735  8193 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.097262  8125 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:26.092541  9786 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.098922  8117 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:26.103596  8116 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:26.108858  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.079371  9673 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.125941  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.112257  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:26.104496  8237 connection.cc:256] RPC call timeout handler was delayed by -1.6230632549999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:03:26.051051  9789 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:26.133383  8237 connection.cc:256] RPC call timeout handler was delayed by -1.3503632549999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 13:03:26.098685  9804 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:26.135102  8237 connection.cc:256] RPC call timeout handler was delayed by -1.2810632549999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:03:26.135461  8237 connection.cc:256] RPC call timeout handler was delayed by -1.2414632549999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:03:26.135766  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1046632549999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 13:03:26.136549  9541 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:26.136687  8775 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.111420  9802 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:26.139514  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:26.133767  8802 consensus_meta.cc:287] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.000s
I20260709 13:03:26.141197  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.131174  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.102154  9523 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:03:26.134500  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:26.146301  8091 connection.cc:256] RPC call timeout handler was delayed by -1.0415474509999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:03:26.146625  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:26.147401  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85598.1us
I20260709 13:03:26.147912  8272 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:26.149178  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.140365  9809 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.155094  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.155800  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:26.156579  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.143764  8802 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:26.158731  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.139037  9804 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.164057  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:26.164736  8199 raft_consensus.cc:2368] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:26.165766  8775 leader_election.cc:400] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:26.166044  8775 leader_election.cc:403] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:26.158349  9532 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:26.166711  9802 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.167541  9532 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:26.154609  8268 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:26.150357  8269 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:26.167183  8195 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:03:26.173441  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.154852  9809 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.161676  9694 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.198843  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.167927  9532 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:26.205257  9532 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.206130  9472 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.206528  9472 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:26.207257  9472 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.210747  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.211428  8124 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.214428  9581 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:26.216152  9605 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.216980  9605 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:26.217284  9605 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:26.218170  9605 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.219139  8124 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:26.219280  9605 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.221782  9549 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.223093  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:26.223757  8267 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:26.223861  9549 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:26.186406  8195 pending_rounds.cc:85] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 4
I20260709 13:03:26.226025  8195 pending_rounds.cc:107] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:03:26.226287  8195 raft_consensus.cc:2889] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.168226  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 435) took 1051 ms. Trace:
I20260709 13:03:26.227655  8802 rpcz_store.cc:276] 0709 13:03:25.114627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.150587 (+ 35960us) service_pool.cc:224] Handling call
0709 13:03:26.165771 (+1015184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:26.228216  9807 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:26.163899  9796 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.235067  9819 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.235388  8196 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:26.235570  9819 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.236495  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1024) took 1267 ms. Trace:
I20260709 13:03:26.163702  9812 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.238461  8266 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:26.239306  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.244992  8193 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:26.279793  8810 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:26.255653  8196 rpcz_store.cc:276] 0709 13:03:24.968787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.426066 (+457279us) service_pool.cc:224] Handling call
0709 13:03:26.234857 (+808791us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:26.235155 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.236158 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.236435 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3988736}
I20260709 13:03:26.182149  9820 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:26.190286  9809 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:26.221721  9680 consensus_meta.cc:287] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.939s	user 0.010s	sys 0.000s
I20260709 13:03:26.201014  9493 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.287281  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.307255  8124 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.198607  9694 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.285100  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.308142  8267 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 1.
I20260709 13:03:26.302181  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.221705  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.243649  9812 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.324738  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:26.325433  8193 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:26.326931  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.284422  9721 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.343924  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:26.344000  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 178621us
I20260709 13:03:26.308302  9820 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:26.316941  9694 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.287808  9544 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:03:26.360337  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.320044  9812 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.362360  8806 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:26.358642  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 209452us
I20260709 13:03:26.345295  9549 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:26.365054  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 84585.2us
I20260709 13:03:26.339033  9819 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:26.306113  9817 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 13:03:26.366549  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 292118us
I20260709 13:03:26.366860  8124 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:26.350745  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:26.373479  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.318676  9680 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:03:26.373147  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85690.6us
I20260709 13:03:26.353135  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.240731  9541 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.378343  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:26.367585  9549 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.379779  8806 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:26.369100  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 225102us
I20260709 13:03:26.382405  8124 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 1.
I20260709 13:03:26.359345  9721 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.382601  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.384783  9827 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:26.386067  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44548 (request call id 83) took 1197 ms. Trace:
I20260709 13:03:26.389169  8274 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:26.400568  9549 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:26.427553  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 74012.4us
W20260709 13:03:26.431125  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47795.1us
I20260709 13:03:26.369653  9724 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:03:26.374747  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:26.437232  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:26.441138  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 59275.3us
I20260709 13:03:26.462292  8124 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
W20260709 13:03:26.455742  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 74186.2us
I20260709 13:03:26.437402  8271 rpcz_store.cc:276] 0709 13:03:25.188587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.188740 (+   153us) service_pool.cc:224] Handling call
0709 13:03:26.385706 (+1196966us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54002deea0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24ca5520 00007fbd24d22652 00007fbd29cf060a 00007fbd232767d4 00007fbd23276762 00007fbd23276691 00007fbd2327660c 00007fbd232758c2 00007fbd2306348c 00007fbd230628c6
0709 13:03:26.385929 (+   223us) inbound_call.cc:177] Queueing failure response
Metrics: {"spinlock_wait_cycles":175594752}
W20260709 13:03:26.433852  9821 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:03:26.471717  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.470588  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.432345  8269 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:26.476697  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.482271  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:26.482751  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.483111  8804 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:26.483565  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.484411  8196 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:26.484846  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.480367  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:26.479735  9822 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.470854  9789 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:26.487080  9770 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.339s	user 0.019s	sys 0.026s
I20260709 13:03:26.488325  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:26.479372  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.470182  9804 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.438246  9798 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:03:26.508121  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:26.524698  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.472934  9793 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:03:26.528159  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55515.8us
I20260709 13:03:26.529039  9841 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.490329  9724 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:03:26.486235  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.435390  9820 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.435313  9832 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:03:26.478967  9824 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:26.482769  9777 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.200s	user 0.012s	sys 0.014s
I20260709 13:03:26.645738  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:26.594035  9817 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.594147  9680 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:26.542600  9837 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.491519  9823 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:03:26.542536  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.487313  9789 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:03:26.542318  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.531592  9472 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:26.681128  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 188105us
W20260709 13:03:26.681542  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 209895us
I20260709 13:03:26.682410  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.683385  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.492662  9807 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:26.596227  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.542692  9813 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
I20260709 13:03:26.529743  9843 raft_consensus.cc:2764] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:26.531131  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:26.631713  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.644408  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:26.699389  8810 raft_consensus.cc:2393] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:26.637423  9544 raft_consensus.cc:2764] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:26.593029  9819 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:26.593520  8125 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:26.702777  8125 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:26.559388  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 71044.6us
W20260709 13:03:26.532534  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.531742  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.530718  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:26.661146  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.530992  9829 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:26.670291  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 212240us
W20260709 13:03:26.706570  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.707031  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.675348  8198 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.670729  8268 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:26.698016  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:26.678419  9837 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:26.672260  9812 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.682729  9824 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:26.702342  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 231836us
I20260709 13:03:26.723158  8198 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:26.712703  9831 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.224s	user 0.003s	sys 0.003s
I20260709 13:03:26.705973  9829 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.713065  9804 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:26.713402  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 182744us
I20260709 13:03:26.713838  9835 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:26.714133  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.702420  9721 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.696520  9617 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:26.720562  9848 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:26.726821  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:26.711217  9532 consensus_meta.cc:287] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:03:26.729547  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:26.746408  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 121) took 1965 ms. Trace:
I20260709 13:03:26.733006  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:26.747062  8198 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:26.700927  9807 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:26.703461  8125 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.727694  9827 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:26.746776  8122 rpcz_store.cc:276] 0709 13:03:24.781480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.781607 (+   127us) service_pool.cc:224] Handling call
0709 13:03:24.796812 (+ 15205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.901866 (+105054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.901896 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.933636 (+ 31740us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.052628 (+118992us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:25.052662 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.052722 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.434591 (+1381869us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:26.738275 (+303684us) raft_consensus.cc:1685] finished
0709 13:03:26.738297 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.746348 (+  8051us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47861,"raft.queue_time_us":99018,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4439,"spinlock_wait_cycles":5389184,"thread_start_us":82812,"threads_started":1,"wal-append.queue_time_us":254778}
I20260709 13:03:26.750216  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.751554  8200 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:26.708781  8269 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:26.748153  8199 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:26.782562  8125 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:26.785254  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 71193.7us
I20260709 13:03:26.729076  9695 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:26.749631  9617 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.792073  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.787365  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.787675  9808 raft_consensus.cc:993] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:26.781849  9721 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:26.788373  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:26.788213  9827 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:26.789322  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55243.1us
I20260709 13:03:26.752897  9667 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:26.787102  9830 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:03:26.737545  9523 consensus_queue.cc:1059] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:03:26.794559  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 96631.5us
I20260709 13:03:26.752429  9807 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.790774  9832 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.806403  9826 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:03:26.807231  9832 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:26.796945  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.789248  9812 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:26.807919  9826 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.808663  9826 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:26.809929  9832 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:26.801752  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:26.811064  9617 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.811794  9851 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:26.812252  9851 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.812798  8125 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:03:26.791599  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 109281us
I20260709 13:03:26.806133  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.815833  8803 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:26.816233  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.817173  9812 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.817586  9812 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:26.806394  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:26.817973  9812 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.806252  9824 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.818255  9835 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:26.818477  9617 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:26.819232  9617 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:26.816493  9695 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:03:26.820098  9617 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.814752  8125 pending_rounds.cc:85] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 1
I20260709 13:03:26.818189  8200 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.816437  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.821365  8125 pending_rounds.cc:107] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:26.814632  9851 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:26.798293  9825 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:03:26.794288  9605 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:26.794749  9724 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.817800  9792 raft_consensus.cc:1064] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
W20260709 13:03:26.823179  9757 consensus_meta.cc:287] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.497s	user 0.011s	sys 0.000s
I20260709 13:03:26.826653  8125 raft_consensus.cc:2889] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.800796  9808 raft_consensus.cc:1081] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Signalling peer 65d66cd655cd4400b079b4427061ca5e to start an election
I20260709 13:03:26.781738  9532 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:26.805681  9786 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.005s
I20260709 13:03:26.803162  9667 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:26.816196  9829 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:26.804805  9721 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:26.822286  9843 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.822901  9835 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:26.833523  9605 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.847811  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.796622  9846 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:03:26.832737  9724 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:26.853134  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:26.846378  9809 consensus_meta.cc:287] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:03:26.866833  9809 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.832528  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:26.869362  8269 raft_consensus.cc:2410] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:26.869712  8803 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:26.870216  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:26.870795  8269 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.871193  9721 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.871753  9532 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:26.852762  9667 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.846279  9757 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.873628  8123 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:26.851276  9832 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.874253  9832 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:26.862324  8200 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:26.823066  9694 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.852607  9786 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:26.875598  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:26.876677  9694 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:26.864658  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48303.3us
I20260709 13:03:26.877593  9786 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:26.877784  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.878257  9835 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:26.879249  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:26.879424  8272 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:26.847903  9826 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.880247  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:26.880659  9826 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.883088  9846 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:26.883574  9846 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:26.884374  9846 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.858698  9695 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:26.855000  9843 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:26.832866  9796 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:26.886049  9843 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.886535  8269 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:26.850870  9789 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.887403  9789 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.887737  9789 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.888914  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:26.893239  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 93263.8us
W20260709 13:03:26.875068  9493 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.005s
I20260709 13:03:26.852849  9851 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:26.896490  8774 leader_election.cc:336] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.741s (SENT)
I20260709 13:03:26.862871  9605 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.900668  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:26.903299  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:26.889134  9724 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.898211  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:26.909238  9786 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:26.899101  9562 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:26.918725  9786 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.919081  9786 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:26.919528  9822 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:26.919876  9786 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.921038  9786 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.921442  9532 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:26.921849  9532 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:26.922189  9532 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.923710  8803 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:26.924738  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:26.875003  9832 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.926731  8265 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:26.926554  9562 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:26.927369  9832 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.898155  9796 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:26.928785  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 75716.9us
I20260709 13:03:26.899741  9472 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:26.902231  9493 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:26.933899  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.930845  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:26.935117  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 339178us
I20260709 13:03:26.900032  9851 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:26.939538  9851 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.940721  9532 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:26.941795  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.942876  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.943591  8122 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:26.944305  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.944919  8122 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:26.936033  9472 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:26.945745  9472 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.937621  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.948137  8124 raft_consensus.cc:2368] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:26.889724  9549 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.927796  9562 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:26.933501  9541 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:26.951293  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.894371  9619 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:03:26.952101  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:26.804381  9837 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:26.914536  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:26.961678  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.928089  9819 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:26.953249  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.965003  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.966053  9757 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:26.978241  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 130498us
I20260709 13:03:26.978376  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.980088  9797 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:27.002830  9797 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:26.980877  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:26.981279  9837 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.983743  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.002205  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:26.953430  9796 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:26.954285  9860 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.021533  8808 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:27.021780  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:27.004832  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 106693us
I20260709 13:03:27.004678  8125 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:27.006542  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:27.006615  8163 leader_election.cc:336] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.583s (SENT)
I20260709 13:03:27.003793  9797 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.029492  8116 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.029170  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.048591  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.049281  8116 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:27.015265  8803 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.054543  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.055233  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.055671  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:27.053534  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46928.9us
I20260709 13:03:27.058334  8124 raft_consensus.cc:2368] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:27.063594  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.065299  8122 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:27.014847  9667 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:27.070333  8163 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.777s (SENT)
I20260709 13:03:27.082566  8122 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: [2.3-2.3]
W20260709 13:03:27.086433  8163 leader_election.cc:336] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.869s (SENT)
I20260709 13:03:27.084843  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.064116  9862 raft_consensus.cc:2764] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:27.069726  9549 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.092579  8166 leader_election.cc:400] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:27.094403  8166 leader_election.cc:403] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:27.074446  9797 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.090708  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.100260  8122 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:27.088424  9808 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:03:27.105253  9808 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.069908  9824 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:03:27.108036  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:27.105576  9812 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.118196  9694 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.118362  9868 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:27.094372  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.118431  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.119831  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.123373  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.123647  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.132846  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.107468  9617 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.105626  9808 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:27.108191  9839 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.149556  8237 leader_election.cc:400] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4.
I20260709 13:03:27.149803  8237 leader_election.cc:403] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:27.076653  9860 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:03:27.152699  9801 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.153885  9846 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.154824  9846 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.158258  9846 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.158633  9667 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.159509  9532 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.160126  9592 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:27.162899  8163 leader_election.cc:400] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3.
I20260709 13:03:27.146337  9868 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.162691  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.147573  9862 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.171571  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.160646  9592 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.178110  9863 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.183066  9592 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.183960  9472 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.184959  8118 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.186029  9472 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:27.167259  9752 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.037s	user 0.012s	sys 0.004s
I20260709 13:03:27.121011  9694 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.156482  9839 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.193141  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:27.193979  8811 raft_consensus.cc:2410] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:27.170660  9868 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.150998  9605 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.117213  9796 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:27.203341  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 67083.3us
I20260709 13:03:27.204162  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.205312  8166 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.174935  9680 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.206821  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:27.167712  9801 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4.
I20260709 13:03:27.167821  9851 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.186358  9860 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:03:27.216030  8811 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:27.217980  8122 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:27.190534  9826 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.220562  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.218809  9696 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:27.222118  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.222295  9696 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.222867  9877 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.247870  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:27.214748  9680 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:27.253676  9680 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:27.248874  9869 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:27.255537  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.213876  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:27.258045  9845 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.468s	user 0.002s	sys 0.000s
I20260709 13:03:27.258351  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:27.259682  9724 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.261658  9724 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.249467  9807 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.249962  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.250560  9694 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.202172  9812 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:27.276018  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.282085  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.285174  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.202332  9868 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.286895  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.246528  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.186748  9843 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.190163  9752 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.190255  9617 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:03:27.313949  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.320747  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:27.314694  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 115291us
W20260709 13:03:27.324432  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.280714  9862 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:27.314872  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 141796us
I20260709 13:03:27.315476  8804 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.253087  9789 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.328805  8191 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.329070  8121 raft_consensus.cc:2368] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5.
W20260709 13:03:27.329524  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44429.3us
I20260709 13:03:27.331043  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.315037  9880 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.333091  9857 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:27.333417  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.324559  9829 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.346755  8265 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:27.347090  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.347740  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.330579  8120 raft_consensus.cc:606] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.333721  9605 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:27.337754  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.337574  9861 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.338712  9790 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.340597  9680 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:27.343520  9856 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 13:03:27.343638  9843 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.314325  9787 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:27.345397  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.359997  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:27.370711  9787 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.371098  9617 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.372637  9787 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.372809  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.353001  8270 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:27.373565  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1471) took 2028 ms (client timeout 2185 ms). Trace:
W20260709 13:03:27.373920  8270 rpcz_store.cc:269] 0709 13:03:25.344782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.393969 (+ 49187us) service_pool.cc:224] Handling call
0709 13:03:27.320557 (+1926588us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b58000f5d98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:27.373512 (+ 52955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159647104}
I20260709 13:03:27.374709  9752 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.375089  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.375000  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.375782  8270 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:27.361140  9857 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.376619  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.377491  9801 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.377612  8270 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:27.378180  9801 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.378571  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.379285  8270 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.380352  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.380488  9696 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.382149  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.383246  8270 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:27.367192  9861 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.367313  9797 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:27.348493  8120 raft_consensus.cc:614] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:27.347747  8194 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.326865  9826 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:27.346709  9870 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:03:27.398406  8269 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 2: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:27.366395  9829 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.373483  9884 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.367280  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.368494  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 134) took 2149 ms. Trace:
I20260709 13:03:27.328963  9839 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.368901  8119 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.402719  8122 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:27.383865  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.402697  8123 rpcz_store.cc:276] 0709 13:03:25.219686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.222646 (+  2960us) service_pool.cc:224] Handling call
0709 13:03:27.368288 (+2145642us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400299854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:27.368413 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3703250304}
I20260709 13:03:27.407375  8116 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:27.408586  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:27.416363  9861 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.417471  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.418040  8265 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.419512  9846 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.420296  9877 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.420753  9877 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:27.421149  9877 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.421739  8804 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:27.423019  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.420675  8200 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:27.426158  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1457) took 1595 ms. Trace:
I20260709 13:03:27.426832  9807 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.427474  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1031) took 1269 ms. Trace:
I20260709 13:03:27.427793  8272 rpcz_store.cc:276] 0709 13:03:26.158159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.162411 (+  4252us) service_pool.cc:224] Handling call
0709 13:03:26.162705 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.879800 (+717095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.427250 (+547450us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400405bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:27.427387 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647858944}
I20260709 13:03:27.428874  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.429848  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.431038  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.432516  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.433187  9851 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.433674  9680 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.434484  9680 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.427415  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.435079  9680 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:27.426514  8191 rpcz_store.cc:276] 0709 13:03:25.830764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.877511 (+ 46747us) service_pool.cc:224] Handling call
0709 13:03:26.893385 (+1015874us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:26.893568 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.330042 (+436474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.425958 (+ 95916us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540021af54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:27.426108 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005656576}
I20260709 13:03:27.436515  9680 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.438227  9787 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:27.402204  9826 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.439206  9787 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:27.439604  9787 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:27.440999  9826 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.436646  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.447556  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.448173  8191 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:27.448866  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.450317  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.450882  8271 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.453287  8123 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:27.454268  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.454747  8123 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.449307  8191 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.431524  8272 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:27.440625  9787 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.443859  9884 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:27.438771  9829 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.445617  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.445780  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.445917  8803 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:27.430874  8122 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:27.474313  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:27.460959  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 129952us
I20260709 13:03:27.475996  8166 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.478219  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.478565  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:27.480057  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:27.480625  9829 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.468940  8272 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:27.481105  9829 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.481674  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:27.471966  8125 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.482694  9889 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.480824  8808 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:27.479353  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.484304  8116 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:27.483338  9829 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.485123  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.485333  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:27.486094  9829 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.486552  9829 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:27.486896  9829 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.487128  9868 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.489565  9835 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.490278  9889 raft_consensus.cc:2764] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:27.491662  8265 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:27.489269  9868 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.492636  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.493741  8116 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.494608  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.465415  8123 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:27.492934  8265 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:27.493877  8125 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.496887  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.500495  8122 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 2: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:27.498854  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.499162  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.486172  8266 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:27.503935  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.508215  8122 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.476501  9846 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.516139  8166 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.499338  9868 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.518936  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.519542  8198 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.504204  9787 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:27.517767  8091 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.938s (SENT) [suppressed 36 similar messages]
I20260709 13:03:27.507807  9889 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.521752  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.526419  8122 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:27.526588  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.527565  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:27.527809  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.530400  8122 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.531957  8271 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:27.532541  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1041) took 1313 ms. Trace:
I20260709 13:03:27.532886  8271 rpcz_store.cc:276] 0709 13:03:26.218648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.450061 (+1231413us) service_pool.cc:224] Handling call
0709 13:03:27.532486 (+ 82425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:27.533221  8125 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:27.534721  8271 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:27.535501  8266 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:27.536616  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.537892  9846 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.538157  8265 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:27.539314  8166 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.541815  8166 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.521586  9789 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.524227  9839 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.538381  9846 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.534438  9889 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.540525  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:27.552029  9855 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.643s	user 0.000s	sys 0.001s
W20260709 13:03:26.989279  9827 consensus_queue.cc:1175] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17c126976afd40d9a398d13a5ddd222f" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:27.543576  9886 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.561486  8191 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:27.562039  9846 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.563194  8116 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:27.570080  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.565167  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1501) took 1221 ms. Trace:
I20260709 13:03:27.550568  8122 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:27.569875  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.570391  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.568975  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.572224  9472 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:27.568349  9829 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.572701  9472 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:27.569770  9884 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.573613  9472 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.574218  9829 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.570887  8121 rpcz_store.cc:276] 0709 13:03:26.342229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.342401 (+   172us) service_pool.cc:224] Handling call
0709 13:03:27.563169 (+1220768us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400299d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:27.563308 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223235968}
I20260709 13:03:27.581262  8198 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:27.582003  9868 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.565531  8804 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 1 LEARNER]: Advancing to term 3
I20260709 13:03:27.583392  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.584156  9817 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:27.584605  9817 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:27.587289  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.588387  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.589363  8116 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:27.589491  8271 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:27.591104  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.583190  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.594286  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.597193  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.599186  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.599777  8265 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:27.600049  9837 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:27.600723  9837 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.602478  9857 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.603520  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.606256  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.607813  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:27.608412  8116 raft_consensus.cc:2410] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:27.608996  9752 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:27.612439  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:27.614051  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.615357  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.615585  9790 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.616000  9790 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:27.616427  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.623296  8267 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:27.624047  9834 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.049s	user 0.001s	sys 0.003s
I20260709 13:03:27.604476  9832 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.626173  8272 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:27.626312  8191 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:27.599809  8194 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:27.629621  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.629822  8271 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.630667  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.631801  8196 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:03:27.615222  9892 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:27.625123  8200 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:27.635102  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.635625  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.635129  8200 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:27.599665  9889 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.616349  9790 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.644253  9857 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:27.644762  8116 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:27.645745  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.647090  8200 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.633658  9835 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.648373  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:27.628748  9792 raft_consensus.cc:1068] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Unable to promote non-voter 17c126976afd40d9a398d13a5ddd222f: Illegal state: Replica afd11cff97554063a80d743fdf2b934d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:03:27.648342  8166 connection.cc:256] RPC call timeout handler was delayed by -1.1699705519999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:03:27.637125  9832 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.632457  9752 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.651870  8267 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.652688  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.652103  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.654203  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.590750  9817 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.644670  9694 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.655220  8267 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.651600  9857 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.666667  9808 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.667480  9857 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.638376  9619 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:27.669065  9886 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.671095  9533 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.673678  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:27.674783  9819 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.675159  9792 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.675247  9819 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:27.675928  9819 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.674738  8267 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.677464  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.656046  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:27.656164  9695 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.685267  8804 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.653112  9786 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.662422  9837 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.639269  9798 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:03:27.655867  9752 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:27.664232  8803 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:27.664647  8192 raft_consensus.cc:1217] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:03:27.652103  9472 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.682830  9857 raft_consensus.cc:1064] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:27.679163  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.614100  9877 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.694581  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.655606  8200 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.699817  9792 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:27.700637  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.702140  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.687587  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.696796  9798 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:27.698556  8271 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:27.700898  8192 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:27.704469  9533 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:27.704829  9533 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.705196  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:27.706192  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.694173  9827 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:27.709216  9559 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:03:27.711496  8193 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.693598  9796 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:27.713750  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.715319  8237 leader_election.cc:400] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5.
I20260709 13:03:27.715497  8237 leader_election.cc:403] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:27.718104  9838 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:27.718499  9695 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:27.707441  9619 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:27.719278  9838 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.719497  9619 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.719916  9838 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:27.707955  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:27.720891  9807 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.720724  9838 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.721231  9807 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:27.722093  9807 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.723196  9807 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.707283  9886 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.723944  9886 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.721872  9838 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.726600  9617 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:27.726984  9617 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.727305  9617 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:27.721846  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.728885  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.729338  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:27.730903  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.709946  9837 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:27.708583  9827 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.697383  9694 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:03:27.706507  9798 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:27.708127  9472 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.732355  8271 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:27.732024  9886 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.737632  9851 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.742996  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50538 (request call id 6) took 2697 ms. Trace:
I20260709 13:03:27.727628  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:27.705565  9533 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.747138  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:27.748202  9827 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:27.745716  8266 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:27.720597  9619 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.728056  9889 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:27.775067  8120 rpcz_store.cc:276] 0709 13:03:25.045144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.055613 (+ 10469us) service_pool.cc:224] Handling call
0709 13:03:26.633320 (+1577707us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d04c40 00007fbd29cf0bb9 00007fbd29cf047c 00007fbd232767d4
0709 13:03:27.742780 (+1109460us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b5400299d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d22853 00007fbd29cf060a 00007fbd232767d4 00007fbd23276762 00007fbd23276691 00007fbd2327660c 00007fbd232758c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:27.742889 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558997632}
W20260709 13:03:27.780397  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.751235  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.757196  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:27.769219  9849 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.915s	user 0.004s	sys 0.000s
I20260709 13:03:27.748538  9680 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.761842  9809 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:27.760809  8265 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:27.747443  9819 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.792490  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.765525  9472 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:27.755038  9832 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:03:27.772734  8804 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.783840  9829 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.798779  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.804243  8270 raft_consensus.cc:2393] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:27.767668  9790 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.795400  9886 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.795167  9533 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.794677  9802 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5.
I20260709 13:03:27.781133  8803 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.808301  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:27.797066  9865 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.599s	user 0.000s	sys 0.002s
I20260709 13:03:27.759598  9857 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:27.830974  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.817400  9839 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:27.812319  9886 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.807969  9860 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:03:27.808195  9868 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.825453  9877 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.808645  9832 consensus_queue.cc:1243] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:27.826335  8273 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:27.825906  8274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1460) took 2605 ms (client timeout 2027 ms). Trace:
I20260709 13:03:27.829653  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.827169  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.835479  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 168) took 1605 ms. Trace:
I20260709 13:03:27.838065  8120 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:27.837154  8274 rpcz_store.cc:269] 0709 13:03:25.220835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.255091 (+ 34256us) service_pool.cc:224] Handling call
0709 13:03:27.825581 (+2570490us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400347454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:27.825794 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561707392}
I20260709 13:03:27.833241  9839 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.841907  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.845378  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1044) took 1113 ms. Trace:
I20260709 13:03:27.848155  8200 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.837114  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.798187  9798 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.841207  9833 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:27.853255  9833 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:27.852501  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58249.3us
I20260709 13:03:27.838871  8195 rpcz_store.cc:276] 0709 13:03:26.230082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.249531 (+ 19449us) service_pool.cc:224] Handling call
0709 13:03:26.351338 (+101807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.373143 (+ 21805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.374449 (+  1306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.429437 (+ 54988us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.727585 (+298148us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:26.728162 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.739788 (+ 11626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.768643 (+1028855us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:27.826297 (+ 57654us) raft_consensus.cc:1685] finished
0709 13:03:27.826318 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.835416 (+  9098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1134,"raft.queue_time_us":96198,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7784,"spinlock_wait_cycles":128061824,"thread_start_us":273080,"threads_started":1,"wal-append.queue_time_us":370784}
I20260709 13:03:27.856639  9472 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.857568  9886 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.857488  9786 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.858678  9786 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.860422  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.860627  9786 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.860987  8118 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.857471  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.862783  9860 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.863480  9860 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:27.838546  9752 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.864746  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.865922  8122 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:27.868254  8122 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:27.842506  9868 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:27.851382  9798 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.853878  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:27.840860  9884 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.855562  8120 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.874907  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:27.853816  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.875602  8266 raft_consensus.cc:606] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:27.875973  8266 raft_consensus.cc:614] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:27.841470  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:27.873389  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:27.950549  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77233.4us
I20260709 13:03:27.902447  9877 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:27.875022  9889 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.858346  8195 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:27.961812  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.962296  8120 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:27.962580  8195 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:27.963212  8120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19747a1b37df480faebc96d93689cda5"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:50784
I20260709 13:03:27.963651  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.834813  9617 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:27.871979  8265 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:27.966063  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:27.966606  8265 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.966259  9839 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.968720  8123 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.847781  8192 rpcz_store.cc:276] 0709 13:03:26.731842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.734540 (+  2698us) service_pool.cc:224] Handling call
0709 13:03:27.656279 (+921739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.704031 (+ 47752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.845180 (+141149us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54003c4bd0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:27.845302 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969422080}
I20260709 13:03:27.971095  9808 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.973511  9889 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.975901  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:27.976890  9819 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:27.900801  9903 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:03:27.978367  8197 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:27.979303  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.979717  9827 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:27.980654  8197 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:27.976955  9533 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.966622  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.982220  8195 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:27.982637  9827 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.984357  8195 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:27.932727  8122 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:27.998307  8122 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:27.933161  8118 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:27.933436  8124 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:27.934594  9752 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:27.900008  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:27.906868  9884 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:27.935616  9905 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:03:27.936457  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:27.936964  9790 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:27.931104  8811 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:27.938917  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.940203  8125 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.945226  8117 raft_consensus.cc:2410] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:27.946910  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.948753  8272 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.026924  8125 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:28.025669  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:27.901957  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1029) took 1765 ms. Trace:
I20260709 13:03:27.956661  8269 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:28.034067  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.988058  9533 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.904974  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:27.903860  9694 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:27.996662  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:28.038630  8268 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.000514  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.040833  9752 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.004691  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:28.041656  8266 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.005712  8122 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.043823  8122 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.044798  8122 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.044633  9559 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:28.038704  9694 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:28.003686  9884 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.040246  8197 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.024475  9789 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.039039  9617 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:28.037106  9833 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.002403  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:28.047652  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:27.963781  8120 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:28.036481  8124 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:03:28.053229  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50897.7us
I20260709 13:03:28.036408  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:28.036566  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:28.049019  8197 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:28.054926  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.049855  8122 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.053790  8120 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.048184  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:28.056788  8270 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.035171  8273 rpcz_store.cc:276] 0709 13:03:26.136079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.136429 (+   350us) service_pool.cc:224] Handling call
0709 13:03:27.826166 (+1689737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.837127 (+ 10961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.901781 (+ 64654us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400347450. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:27.901904 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3871280512}
I20260709 13:03:28.060848  8266 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:28.055984  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.062038  8269 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:28.062196  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:28.062645  8238 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:28.002861  9877 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.068183  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:28.073005  8199 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.073181  8200 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.064364  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.006732  9802 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:03:28.051867  9833 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.049723  9789 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.070668  9619 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.049505  9827 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:28.071478  8194 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.068742  9617 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:28.075413  9533 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.075647  9832 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:28.075831  8199 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.076499  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:28.077039  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.110284  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.076349  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:28.111145  8121 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:28.039400  9724 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:28.047789  9786 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:03:28.124612  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 142) took 1046 ms. Trace:
I20260709 13:03:28.079888  8200 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:28.077867  8192 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.072432  9826 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:28.083252  9802 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.102762  9673 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.116182  9819 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:28.106240  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.083493  9868 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.110951  8273 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:28.038650  9889 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:28.050499  9610 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:28.045324  8265 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:28.120738  9797 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.109632  9680 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.121471  9533 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.121647  9829 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.079157  9877 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.109421  9617 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.071691  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1493) took 2001 ms. Trace:
W20260709 13:03:28.126725  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.147627  9826 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:28.126204  8270 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:28.127333  8199 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:28.125005  8121 rpcz_store.cc:276] 0709 13:03:27.078527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.588217 (+509690us) service_pool.cc:224] Handling call
0709 13:03:28.076094 (+487877us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:28.124546 (+ 48452us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5089664}
I20260709 13:03:28.096977  8120 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:28.066588  9798 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.046454  9694 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.130645  9695 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.139956  9837 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.167920  8269 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:28.139770  9832 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:28.139338  9802 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:28.169397  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 96553.4us
I20260709 13:03:28.125962  9472 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:03:28.144733  9724 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:28.174764  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 135786us
I20260709 13:03:28.171804  9721 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:28.227995  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:28.159313  9787 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.183622  8119 rpcz_store.cc:276] 0709 13:03:26.069795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.095357 (+ 25562us) service_pool.cc:224] Handling call
0709 13:03:27.368728 (+1273371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.403346 (+ 34618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.071523 (+668177us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400299850. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:28.071639 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2857571200}
I20260709 13:03:28.228664  8199 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.191484  9617 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.165658  9819 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:28.188311  8123 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 4. Ops: []
W20260709 13:03:28.225800  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.234665  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 71167.2us
W20260709 13:03:28.236478  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.165699  9592 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:03:28.169504  9804 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:03:28.196180  9837 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:28.171485  9581 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:03:28.225458  9752 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:28.234754  9898 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.576s	user 0.005s	sys 0.000s
I20260709 13:03:28.231582  9851 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.267310  8197 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:03:28.200912  9757 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:03:28.175217  9680 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.267736  8197 pending_rounds.cc:85] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 2
I20260709 13:03:28.274871  8197 pending_rounds.cc:107] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:03:28.275170  8197 raft_consensus.cc:2889] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:28.277486  9805 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:28.278273  9533 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:28.279014  9909 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:03:28.280292  9908 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:28.281438  9789 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.243251  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:28.281960  9592 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:28.231153  9673 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:03:28.300765  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.301285  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 165165us
I20260709 13:03:28.301578  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 145) took 1222 ms. Trace:
I20260709 13:03:28.286275  9786 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:28.306648  8116 rpcz_store.cc:276] 0709 13:03:27.079211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.645441 (+566230us) service_pool.cc:224] Handling call
0709 13:03:27.654241 (+  8800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.660393 (+  6152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.660423 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.906390 (+245967us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b2c00000f48. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:03:27.906767 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.128766 (+221999us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:28.128803 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.128873 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.281940 (+153067us) raft_consensus.cc:1685] finished
0709 13:03:28.281961 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.301473 (+ 19512us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3212,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":21369216,"thread_start_us":194746,"threads_started":1,"wal-append.queue_time_us":296305}
I20260709 13:03:28.312516  8200 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.289819  9798 raft_consensus.cc:3055] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.276489  9804 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:03:28.284896  9581 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:03:28.276620  9802 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.284111  9851 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.304250  9592 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:28.325410  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:28.313541  9786 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.316262  9673 consensus_queue.cc:1243] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:28.342679  8120 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:28.423266  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.310189  9724 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.288872  9826 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.424119  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:28.285178  9832 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.308420  9837 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.316617  9798 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:28.424059  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1493) took 1493 ms. Trace:
I20260709 13:03:28.338469  9819 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.432358  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.433540  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1525) took 1050 ms. Trace:
I20260709 13:03:28.443676  8118 rpcz_store.cc:276] 0709 13:03:27.383349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.004286 (+620937us) service_pool.cc:224] Handling call
0709 13:03:28.035862 (+ 31576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.036130 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.036153 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.040421 (+  4268us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.171696 (+131275us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:28.171728 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.171787 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.433334 (+261547us) raft_consensus.cc:1685] finished
0709 13:03:28.433369 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.433486 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":130937,"threads_started":1,"wal-append.queue_time_us":208524}
I20260709 13:03:28.439684  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50784 (request call id 1519) took 1234 ms. Trace:
I20260709 13:03:28.438874  8117 rpcz_store.cc:276] 0709 13:03:26.930871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.931089 (+   218us) service_pool.cc:224] Handling call
0709 13:03:27.944861 (+1013772us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400024ca0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9fdc0 00007fbd24d2be18 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6
0709 13:03:28.422500 (+477639us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540029a254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:28.423981 (+  1481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388750976}
I20260709 13:03:28.444901  8199 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:28.445161  8120 rpcz_store.cc:276] 0709 13:03:27.208144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.963082 (+754938us) service_pool.cc:224] Handling call
0709 13:03:28.342577 (+379495us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4c00107280. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd22ff4a20 00007fbd23005a29 00007fbd2300613f 00007fbd22fca2ab 00007fbd22ff7f3c 00007fbd22ff83fe 00007fbd2328588b 00007fbd24c84495 00007fbd24cd530f 00007fbd24d1fa55 00007fbd29cefcd0
0709 13:03:28.430980 (+ 88403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81419648}
W20260709 13:03:28.430796  9913 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:03:28.429457  9807 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:28.436173  9912 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.169s	user 0.007s	sys 0.002s
I20260709 13:03:28.456652  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.443379  9721 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.467082  8118 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:28.468014  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.478183  9673 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.454742  9802 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.478953  8120 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.485177  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:28.494479  8117 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:28.493907  9877 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:28.454779  9807 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:28.465185  9929 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:28.509837  9786 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:28.512128  9927 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:28.512339  9680 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.512038  9795 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:28.536461  9795 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:28.538050  9786 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.537896  9795 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.538586  9786 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.540030  9617 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.541049  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1047) took 2320 ms. Trace:
I20260709 13:03:28.541652  8270 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:28.477602  9809 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.477028  9592 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.505712  9721 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:28.550562  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:28.559947  8269 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:28.506592  9817 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:28.557078  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:28.571373  9721 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.572747  9592 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.574309  9721 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.576433  9472 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:28.576937  9472 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:28.577945  9472 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.578459  9757 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.579095  9757 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.581316  9757 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.583093  9862 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.583526  9862 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:28.584473  9862 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.586051  9795 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.588114  9694 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.571918  9695 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.599143  9617 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:28.608124  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1521) took 1399 ms. Trace:
I20260709 13:03:28.608546  8123 rpcz_store.cc:276] 0709 13:03:27.208841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.969489 (+760648us) service_pool.cc:224] Handling call
0709 13:03:27.969745 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.233708 (+263963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.607884 (+374176us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400307d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:28.608062 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502232832}
W20260709 13:03:28.612747  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.614230  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.616569  8271 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:28.621639  8124 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 4. Ops: []
I20260709 13:03:28.623081  9926 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:28.623487  9926 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:28.503878  9798 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:28.628180  9798 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.628253  8270 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:28.629613  8270 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:28.630729  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1067) took 1078 ms. Trace:
I20260709 13:03:28.631134  8192 rpcz_store.cc:276] 0709 13:03:27.552776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.970206 (+417430us) service_pool.cc:224] Handling call
0709 13:03:27.970502 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.139395 (+168893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.630517 (+491122us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b540014d7d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:28.630671 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188232960}
I20260709 13:03:28.562629  9817 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:28.633592  9817 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.634518  9817 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.637722  9787 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.638145  9787 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:28.638980  9787 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.640157  9787 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.644596  9837 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.513211  9829 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 13:03:28.651183  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1493) took 1004 ms. Trace:
W20260709 13:03:28.652478  9884 consensus_meta.cc:287] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.001s
I20260709 13:03:28.652993  9884 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.654110  8198 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.655812  9884 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.651746  8274 rpcz_store.cc:276] 0709 13:03:27.647190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.937977 (+290787us) service_pool.cc:224] Handling call
0709 13:03:27.989422 (+ 51445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.995997 (+  6575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.996029 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.001386 (+  5357us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.170045 (+168659us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:28.170086 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.170152 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.581973 (+411821us) raft_consensus.cc:1685] finished
0709 13:03:28.581997 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.650772 (+ 68775us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b5400346f50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:28.651090 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":701,"raft.queue_time_us":92,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7266,"spinlock_wait_cycles":117576960,"thread_start_us":117162,"threads_started":1,"wal-append.queue_time_us":256840}
I20260709 13:03:28.668416  8271 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:28.683043  8269 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:28.686240  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.689762  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.506798  9804 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:03:28.699658  9851 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.541453  8268 rpcz_store.cc:276] 0709 13:03:26.220154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.839542 (+619388us) service_pool.cc:224] Handling call
0709 13:03:26.839900 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.040430 (+1200530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.540816 (+500386us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003b83d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:28.540989 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683115392}
I20260709 13:03:28.708042  9862 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.541065  9786 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:28.717741  9617 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:28.752250  9926 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.777815  8274 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:28.779948  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 144907us
W20260709 13:03:28.791077  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.804178  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.825268  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.082s	sys 0.174s
W20260709 13:03:28.825687  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.082s	sys 0.174s
W20260709 13:03:28.827376  8266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.039s	sys 0.049s
W20260709 13:03:28.828918  8266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.039s	sys 0.050s
W20260709 13:03:28.830449  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.830976  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.831406  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.832333  8091 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.558310  9807 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:28.839349  8267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.051s	sys 0.122s
I20260709 13:03:28.801700  9918 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:28.846448  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.847883  8274 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.844909  8019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 279) took 7840 ms. Trace:
I20260709 13:03:28.826988  9839 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.800271  9915 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:28.835999  9923 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.857194  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:28.857812  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 449) took 1360 ms. Trace:
I20260709 13:03:28.827405  9804 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:28.836252  9786 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.864029  9617 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:28.864451  9617 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:28.864264  9923 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:28.865530  9694 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:28.865270  9617 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.866060  9694 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:28.866420  9617 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.866699  9915 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.866921  9694 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.868642  9915 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:28.866472  9923 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:28.871493  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.872238  9851 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.872429  9786 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.863416  8265 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.836668  9797 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.878718  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.803400  9917 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:03:28.826807  9819 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:03:28.872630  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.899425  8197 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 4. Ops: [2.4-2.4]
I20260709 13:03:28.900743  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:28.905474  8273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.014s	sys 0.037s
W20260709 13:03:28.905989  8273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.037s
I20260709 13:03:28.906771  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.902176  8021 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.850258  8019 rpcz_store.cc:276] 0709 13:03:20.985756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.985897 (+   141us) service_pool.cc:224] Handling call
0709 13:03:21.838277 (+852380us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b54002b0110. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c040b2 00007fbd2ab7da89 00007fbd2ab15da6 00007fbd2aae7088 00007fbd2abe537e 00007fbd290a62a4 00007fbd290a6232 00007fbd290a6161 00007fbd290a60dc
0709 13:03:28.826469 (+6988192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:25.706775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:25.749092 (+ 42317us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:25.750206 (+  1114us) write_op.cc:435] Acquired schema lock
0709 13:03:25.750228 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:25.750957 (+   729us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:25.751085 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:25.751117 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:25.751780 (+   663us) tablet.cc:701] Row locks acquired
0709 13:03:25.751820 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:03:25.751989 (+   169us) write_op.cc:270] Start()
0709 13:03:25.752146 (+   157us) write_op.cc:276] Timestamp: P: 1783602205751933 usec, L: 0
0709 13:03:25.752162 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:03:26.001965 (+249803us) log.cc:844] Serialized 2079 byte log entry
0709 13:03:26.499015 (+497050us) op_driver.cc:464] REPLICATION: finished
0709 13:03:26.849961 (+350946us) write_op.cc:301] APPLY: starting
0709 13:03:26.853745 (+  3784us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:26.895404 (+ 41659us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:26.909274 (+ 13870us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:26.935634 (+ 26360us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:26.999206 (+ 63572us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:03:27.001471 (+  2265us) write_op.cc:312] APPLY: finished
0709 13:03:27.001718 (+   247us) log.cc:844] Serialized 47 byte log entry
0709 13:03:27.001871 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:27.001971 (+   100us) write_op.cc:454] Released schema lock
0709 13:03:27.002022 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:27.002383 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:27.002409 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":171073,"reported_tablets":12,"spinlock_wait_cycles":4011904,"child_traces":[["op",{"apply.queue_time_us":305480,"apply.run_cpu_time_us":2889,"apply.run_wall_time_us":157276,"num_ops":5,"prepare.queue_time_us":314342,"prepare.run_cpu_time_us":34315,"prepare.run_wall_time_us":438150,"raft.queue_time_us":226976,"raft.run_cpu_time_us":19695,"raft.run_wall_time_us":281680,"replication_time_us":724174,"thread_start_us":682330,"threads_started":4,"wal-append.queue_time_us":149547,"wal-append.run_cpu_time_us":8551,"wal-append.run_wall_time_us":1840236}]]}
I20260709 13:03:28.912873  8809 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:03:28.839905  8267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.052s	sys 0.123s
I20260709 13:03:28.906695  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 205) took 1124 ms. Trace:
I20260709 13:03:28.907902  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.918303  8197 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:28.905812  9851 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.911325  9757 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:28.931440  9757 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:28.931828  9757 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.862413  8808 rpcz_store.cc:276] 0709 13:03:27.497633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.498481 (+   848us) service_pool.cc:224] Handling call
0709 13:03:27.520763 (+ 22282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.528559 (+  7796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.528588 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.529065 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.596008 (+ 66943us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:27.597869 (+  1861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.604307 (+  6438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.124168 (+519861us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:28.801222 (+677054us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540050bf20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9ddbe 00007fbd24ca8930 00007fbd24ca88d8 00007fbd24ca8858 00007fbd24ca8813 00007fbd24ca7a9c 00007fbd2ab93626 00007fbd2ab8ddd8 00007fbd24ce47cb 00007fbd24ce72c0
0709 13:03:28.844207 (+ 42985us) raft_consensus.cc:1685] finished
0709 13:03:28.844226 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.857753 (+ 13527us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1019,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":1056190976,"thread_start_us":49309,"threads_started":1,"wal-append.queue_time_us":123353}
I20260709 13:03:28.910887  9928 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.917658  8021 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.916131  8273 rpcz_store.cc:276] 0709 13:03:27.782005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.158738 (+376733us) service_pool.cc:224] Handling call
0709 13:03:28.183916 (+ 25178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.184115 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:28.203141 (+ 19026us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.906314 (+703173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.906442 (+   128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:28.906485 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.906549 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.906647 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19282,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3173,"raft.queue_time_us":60178,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8182,"thread_start_us":702924,"threads_started":1}
I20260709 13:03:28.875564  9839 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.914749  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:28.886392  9797 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:28.951804  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:28.955591  8802 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.960952  9786 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:28.916706  8192 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:28.928467  9923 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:28.854460  9918 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:28.928798  9804 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:03:28.966029  9918 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:28.911867  9805 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:28.968243  8021 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 2 to 3, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.978639  8021 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.938097  9695 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:28.940601  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:28.981791  8021 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.983155  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.027s	sys 0.083s
W20260709 13:03:28.983994  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.027s	sys 0.083s
I20260709 13:03:28.926160  9930 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:03:28.986649  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 722836us
W20260709 13:03:28.985837  8191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.017s	sys 0.042s
W20260709 13:03:28.985392  8193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.022s
W20260709 13:03:28.989168  8193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.022s
W20260709 13:03:28.988863  8191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.017s	sys 0.042s
I20260709 13:03:28.984951  8021 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 2 to 3, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.994747  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.985064  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45765us
I20260709 13:03:28.985759  9928 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:29.002637  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:28.985780  9857 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.011s	sys 0.048s
W20260709 13:03:29.002202  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.004992  8021 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:29.009546  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.991822  8804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.015s
W20260709 13:03:28.992081  9846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.012s	sys 0.017s
W20260709 13:03:29.079831  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77267.2us
W20260709 13:03:29.082321  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.015s	sys 0.013s
W20260709 13:03:29.082687  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.015s	sys 0.014s
W20260709 13:03:29.082970  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 602296us
W20260709 13:03:29.084532  8811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.019s
W20260709 13:03:29.084853  8811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.000s	sys 0.020s
W20260709 13:03:29.096242  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.084216  8021 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.022523  9857 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.011s	sys 0.048s
W20260709 13:03:29.098521  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.136217  8123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:29.138391  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:29.079527  8804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.005s	sys 0.016s
W20260709 13:03:29.141788  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44142us
W20260709 13:03:29.087034  9846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.012s	sys 0.017s
I20260709 13:03:29.146811  9921 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:29.136348  9790 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.148727  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:29.149911  9931 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:29.150857  9839 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.150776  9857 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:29.151849  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:29.136494  9851 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.139568  9798 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.153128  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:29.148756  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:29.002187  9610 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:03:29.156479  9757 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.085917  9837 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:29.168107  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:29.169158  9917 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:29.136418  9928 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:29.182694  9926 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:29.183485  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:29.255188  8119 raft_consensus.cc:2410] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:29.184543  8116 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:29.185945  8122 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:29.187723  9889 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.189713  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:29.196801  9807 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:29.198700  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.198975  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:29.200191  9921 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:29.141503  9838 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.202364  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53712.7us
I20260709 13:03:29.210667  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:29.234931  9802 consensus_meta.cc:287] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.727s	user 0.000s	sys 0.009s
I20260709 13:03:29.212494  8121 raft_consensus.cc:2410] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:29.163455  9787 consensus_meta.cc:287] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.001s
I20260709 13:03:29.086203  9819 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:29.289961  8269 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:29.292315  8271 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:29.210086  9790 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.213946  9851 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.216142  8021 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.249994  9917 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:29.209715  9857 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:29.210465  9817 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:29.207300  9841 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:29.250654  8117 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
W20260709 13:03:29.309412  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.255252  8807 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:29.311614  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.152760  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:29.284689  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.041s	sys 0.063s
I20260709 13:03:29.285245  9837 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:29.278828  8265 raft_consensus.cc:2410] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:29.300240  8021 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 3, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.232184  9804 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:03:29.218173  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 122058us
I20260709 13:03:29.306367  8116 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:29.284169  9921 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:29.280980  8811 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:29.283757  8118 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:03:29.314703  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.041s	sys 0.063s
I20260709 13:03:29.231376  9798 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.318655  8123 raft_consensus.cc:606] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:29.322299  8118 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:29.278148  9928 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.283284  9889 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.322649  8117 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:29.322014  8123 raft_consensus.cc:614] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:29.318351  8021 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 2, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:29.402089  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.410146  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 89411.2us
I20260709 13:03:29.325544  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:29.389933  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:29.305228  9857 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:29.326277  9832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.009s	sys 0.022s
I20260709 13:03:29.319543  9817 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:29.398416  8806 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:29.319434  9937 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.289072  9838 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.504642  8125 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:29.476219  8118 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:29.319259  9724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.019s	sys 0.076s
I20260709 13:03:29.296792  9819 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:29.524211  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 197157us
I20260709 13:03:29.327206  9915 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.527067  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 201580us
I20260709 13:03:29.735555  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:29.737044  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:29.527591  8021 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.305197  9797 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:29.537878  8120 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
W20260709 13:03:29.507561  9868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.024s	sys 0.025s
W20260709 13:03:29.389194  9826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.017s	sys 0.028s
W20260709 13:03:29.754984  9826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.018s	sys 0.028s
I20260709 13:03:29.406700  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:29.552711  8266 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.055s	sys 0.054s
I20260709 13:03:29.755734  8194 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:29.756814  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:29.756953  9610 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:29.757632  9610 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:29.533169  9832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.012s	sys 0.025s
W20260709 13:03:29.536559  9694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.062s
W20260709 13:03:29.617125  9619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.022s	sys 0.048s
I20260709 13:03:29.522244  9787 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.528635  9796 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.533635  9533 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:29.791368  9533 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.793098  9862 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:29.793417  9533 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:29.767501  9619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.023s	sys 0.049s
I20260709 13:03:29.798398  9787 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.800181  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:29.800654  9787 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:29.801105  9832 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:29.801608  9832 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.801945  9832 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:29.802207  9796 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.803313  8807 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:29.804330  9796 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:29.806109  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.326639  9841 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.550803  9592 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.162s
I20260709 13:03:29.712586  8805 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:03:29.628371  9724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.020s	sys 0.077s
W20260709 13:03:29.713188  9938 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:03:29.624619  9937 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.627050  9934 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 13:03:29.713922  9942 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:03:29.714411  9839 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:29.714607  9940 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 13:03:29.716538  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.718143  9857 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.719112  9798 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:29.720341  9889 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.617724  9829 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:03:29.620033  9617 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:03:29.632728  9837 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.722133  9817 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:29.630486  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:29.722774  9838 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.531505  9802 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.177s
W20260709 13:03:29.712512  9935 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 13:03:29.505424  9931 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.831130  9931 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.833087  9931 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:29.833787  8809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.019s	sys 0.030s
W20260709 13:03:29.649127  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.837808  8809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.019s	sys 0.030s
W20260709 13:03:29.838428  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.741803  9941 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:29.534204  9923 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 13:03:29.742298  9930 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:29.721601  9928 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:29.751039  8021 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 2 to 3, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 3 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:29.754541  9851 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:29.755689  8266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.060s	sys 0.058s
W20260709 13:03:29.769136  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.749817  9868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.024s	sys 0.026s
I20260709 13:03:29.716555  9819 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.551637  9921 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.788149  9610 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:29.788050  9846 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:29.788893  9790 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.727906  9808 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:03:29.786624  9757 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:29.790557  8265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1084) took 1551 ms (client timeout 1952 ms). Trace:
W20260709 13:03:29.760793  9694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.016s	sys 0.063s
I20260709 13:03:29.810638  8271 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:03:29.812836  8199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.008s	sys 0.088s
W20260709 13:03:29.943926  8199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.009s	sys 0.088s
I20260709 13:03:29.525112  9917 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:29.811560  9472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.026s	sys 0.021s
I20260709 13:03:29.811666  9797 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.758821  9915 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:29.821396  8802 consensus_meta.cc:287] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.865s	user 0.005s	sys 0.005s
I20260709 13:03:29.833982  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1074) took 1571 ms. Trace:
W20260709 13:03:29.711234  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.838547  8267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.010s	sys 0.036s
W20260709 13:03:29.966384  8267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.010s	sys 0.036s
I20260709 13:03:29.821882  9724 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.822124  9730 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.812407  9862 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:29.841154  8088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.024s	sys 0.026s
W20260709 13:03:29.846498  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.969781  8088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.025s	sys 0.026s
I20260709 13:03:29.848176  8806 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:29.970077  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 1.03251e+06us
W20260709 13:03:29.971474  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.855743  8198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.014s	sys 0.051s
W20260709 13:03:29.972749  8198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.015s	sys 0.051s
W20260709 13:03:29.857820  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.825809  9889 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:29.983670  9889 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:29.946780  9933 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:29.986351  9889 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:29.861841  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1501) took 2174 ms. Trace:
I20260709 13:03:29.987630  9915 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:29.986936  8266 rpcz_store.cc:276] 0709 13:03:27.687858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.072172 (+384314us) service_pool.cc:224] Handling call
0709 13:03:28.072545 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.072866 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.072892 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.077037 (+  4145us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.830349 (+753312us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:29.860825 (+1030476us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.861289 (+   464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.861435 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:29.861490 (+    55us) raft_consensus.cc:1685] finished
0709 13:03:29.861503 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.861767 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3739,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":1837,"thread_start_us":1760992,"threads_started":2,"wal-append.queue_time_us":939146}
I20260709 13:03:29.818354  9839 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.988363  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1501) took 1179 ms. Trace:
I20260709 13:03:29.988729  9798 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:29.989120  9798 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:29.946359  9472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.026s	sys 0.021s
I20260709 13:03:29.840196  9857 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:29.833212  9832 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:29.848922  9807 consensus_meta.cc:287] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.004s
I20260709 13:03:29.968880  8802 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:29.866751  8197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.004s	sys 0.038s
I20260709 13:03:29.989967  9798 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.990034  9472 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.991103  9826 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:29.991518  9826 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:29.861863  9930 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:29.992435  9826 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.864684  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:29.993643  9928 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.994258  9695 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.994122  9928 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.994705  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:29.995381  9694 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.995829  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:29.893857  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:03:29.939667  8195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.000s	sys 0.021s
I20260709 13:03:29.996022  9928 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.896675  9617 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.863399  9926 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:29.996207  9797 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:29.997169  9926 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.998582  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:29.988698  8200 rpcz_store.cc:276] 0709 13:03:28.809181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.898455 (+ 89274us) service_pool.cc:224] Handling call
0709 13:03:28.918646 (+ 20191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.927300 (+  8654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.927334 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.938739 (+ 11405us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.315619 (+376880us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:29.315656 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.315716 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:29.988163 (+672447us) raft_consensus.cc:1685] finished
0709 13:03:29.988182 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.988311 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":711,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11752,"thread_start_us":369915,"threads_started":1,"wal-append.queue_time_us":955431}
I20260709 13:03:30.000667  9926 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:29.944828  8193 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.049s	sys 0.076s
W20260709 13:03:30.001536  8193 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.049s	sys 0.076s
I20260709 13:03:30.001487  9838 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.002045  9797 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:30.002218  9932 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.002625  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 185) took 1710 ms. Trace:
I20260709 13:03:30.002741  9932 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.002959  8193 rpcz_store.cc:276] 0709 13:03:28.292200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.292334 (+   134us) service_pool.cc:224] Handling call
0709 13:03:28.292640 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.304804 (+ 12164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.304833 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:28.316769 (+ 11936us) log.cc:844] Serialized 52 byte log entry
0709 13:03:28.600062 (+283293us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b4800002dd8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
0709 13:03:28.989685 (+389623us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:30.002038 (+1012353us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.002255 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.002320 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.002357 (+    37us) raft_consensus.cc:1685] finished
0709 13:03:30.002445 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.002575 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178586,"prepare.queue_time_us":995524,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":8739,"raft.run_cpu_time_us":2955,"raft.run_wall_time_us":295131,"spinlock_wait_cycles":4238080,"thread_start_us":1544842,"threads_started":2,"wal-append.queue_time_us":897553}
W20260709 13:03:29.990659  8197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.004s	sys 0.038s
I20260709 13:03:29.947047  9846 consensus_queue.cc:1243] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:30.007087  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.007872  8273 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
W20260709 13:03:30.010150  9947 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:29.993067  9930 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:29.965523  8191 rpcz_store.cc:276] 0709 13:03:28.262540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.262728 (+   188us) service_pool.cc:224] Handling call
0709 13:03:28.278334 (+ 15606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.287339 (+  9005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.287373 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.293101 (+  5728us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.991123 (+698022us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:29.003083 (+ 11960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.003163 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:29.833738 (+830575us) raft_consensus.cc:1685] finished
0709 13:03:29.833759 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.833927 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4888,"raft.queue_time_us":6251,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5607,"thread_start_us":671421,"threads_started":1,"wal-append.queue_time_us":987089}
I20260709 13:03:30.011911  9841 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.995823  9694 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.015326  9694 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.943005  9868 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.980006  9730 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.016939  8194 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:30.016942  9868 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.020357  9868 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.986843  9757 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:30.021839  9757 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.023849  9757 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:30.027249  9832 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:30.028556  9937 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:30.028693  9936 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:30.029121  9936 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:30.002238  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1497) took 1195 ms. Trace:
I20260709 13:03:30.030628  8196 rpcz_store.cc:276] 0709 13:03:28.807073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.807999 (+   926us) service_pool.cc:224] Handling call
0709 13:03:28.840730 (+ 32731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.858289 (+ 17559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.858317 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.858705 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.324437 (+465732us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:29.324473 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.324531 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.002020 (+677489us) raft_consensus.cc:1685] finished
0709 13:03:30.002046 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.002178 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17137,"raft.queue_time_us":17394,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":465398,"threads_started":1,"wal-append.queue_time_us":1035901}
I20260709 13:03:29.978319  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:29.978849  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:30.033857  8270 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:29.981897  9724 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:29.941710  8265 rpcz_store.cc:269] 0709 13:03:28.238852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.242994 (+  4142us) service_pool.cc:224] Handling call
0709 13:03:29.790332 (+1547338us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54003b8dd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:29.790493 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289681280}
I20260709 13:03:29.991222  9472 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:29.996570  8195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.000s	sys 0.022s
I20260709 13:03:29.994719  9695 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.032716  8274 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:29.981519  9862 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.977491  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:30.037221  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64675us
I20260709 13:03:30.066540  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:30.041800  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.068687  8200 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
W20260709 13:03:29.942317  9884 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.008s	sys 0.014s
I20260709 13:03:30.043171  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.044808  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:29.989907  9839 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:29.990679  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 467) took 1138 ms. Trace:
I20260709 13:03:30.070552  9826 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.070832  8802 rpcz_store.cc:276] 0709 13:03:28.852310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.905814 (+ 53504us) service_pool.cc:224] Handling call
0709 13:03:29.990608 (+1084794us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.071939  9695 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.073724  9472 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.074723  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 183) took 1795 ms. Trace:
W20260709 13:03:30.072261  9884 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.008s	sys 0.014s
I20260709 13:03:30.075098  8195 rpcz_store.cc:276] 0709 13:03:28.279519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.279676 (+   157us) service_pool.cc:224] Handling call
0709 13:03:28.280121 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.291829 (+ 11708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.301553 (+  9724us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:28.456241 (+154688us) log.cc:844] Serialized 52 byte log entry
0709 13:03:28.989208 (+532967us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.074171 (+1084963us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.074408 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.074486 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.074527 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:30.074541 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.074670 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39234,"prepare.queue_time_us":994329,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":11960,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4368,"thread_start_us":1404020,"threads_started":2,"wal-append.queue_time_us":810215}
I20260709 13:03:30.076330  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:30.077924  8200 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.043059  9798 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.080928  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:30.058027  9932 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.081899  8270 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
W20260709 13:03:30.084077  8124 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.012s	sys 0.019s
W20260709 13:03:30.084421  8124 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.012s	sys 0.019s
I20260709 13:03:30.077188  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.086766  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.087980  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.002103  9838 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.092363  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.072044  9937 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:30.095036  9917 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:30.095480  9730 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.095779  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.085314  9472 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.039842  9617 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.096817  9936 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.098276  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1496) took 1291 ms. Trace:
I20260709 13:03:30.100252  8196 raft_consensus.cc:2410] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:30.108208  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1077) took 1104 ms. Trace:
I20260709 13:03:30.108573  8196 rpcz_store.cc:276] 0709 13:03:29.004136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.061793 (+1057657us) service_pool.cc:224] Handling call
0709 13:03:30.108151 (+ 46358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.109228  9838 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.109618  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.110278  9617 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:30.110805  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.111524  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.113636  8193 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.114502  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1078) took 1107 ms. Trace:
I20260709 13:03:30.115032  8193 rpcz_store.cc:276] 0709 13:03:29.006815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.112645 (+1105830us) service_pool.cc:224] Handling call
0709 13:03:30.112909 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.114106 (+  1197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.114419 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.106560  8199 rpcz_store.cc:276] 0709 13:03:28.806592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.807364 (+   772us) service_pool.cc:224] Handling call
0709 13:03:28.807691 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.843892 (+ 36201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.843921 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.853451 (+  9530us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.944314 (+1090863us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:29.944353 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.944422 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.098089 (+153667us) raft_consensus.cc:1685] finished
0709 13:03:30.098109 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.098224 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35822,"raft.queue_time_us":36134,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":9520,"thread_start_us":1046503,"threads_started":1,"wal-append.queue_time_us":1216170}
I20260709 13:03:30.118117  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.119985  8199 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:30.120585  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1082) took 1109 ms. Trace:
I20260709 13:03:30.120903  8199 rpcz_store.cc:276] 0709 13:03:29.011687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.119503 (+1107816us) service_pool.cc:224] Handling call
0709 13:03:30.119786 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.120371 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.120536 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.127880  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1083) took 1115 ms. Trace:
I20260709 13:03:30.128247  8199 rpcz_store.cc:276] 0709 13:03:29.012834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.127130 (+1114296us) service_pool.cc:224] Handling call
0709 13:03:30.127425 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.127596 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.127619 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.127660 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:30.127690 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.127738 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.127829 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.100768  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.130195  8191 raft_consensus.cc:2410] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:30.136729  8274 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:30.138860  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.140059  8274 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:30.143016  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.145895  8199 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.146567  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1084) took 1132 ms. Trace:
I20260709 13:03:30.146874  8199 rpcz_store.cc:276] 0709 13:03:29.013877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.129257 (+1115380us) service_pool.cc:224] Handling call
0709 13:03:30.145573 (+ 16316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.146304 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.146511 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.148164  8199 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:30.148665  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1085) took 1133 ms. Trace:
I20260709 13:03:30.150765  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:30.150631  9838 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.141701  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.152843  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.081583  9757 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:03:30.154701  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1080) took 1145 ms. Trace:
I20260709 13:03:30.161228  8193 rpcz_store.cc:276] 0709 13:03:29.008864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.115770 (+1106906us) service_pool.cc:224] Handling call
0709 13:03:30.116165 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.154400 (+ 38235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.154424 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.154476 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:30.154505 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.154554 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.154652 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.155494  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 192) took 1006 ms. Trace:
I20260709 13:03:30.162915  8191 rpcz_store.cc:276] 0709 13:03:29.148798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.154451 (+1005653us) service_pool.cc:224] Handling call
0709 13:03:30.154742 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.154905 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.154930 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.155074 (+   144us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.155160 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.155310 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.155438 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.086079  9928 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:03:30.148953  8199 rpcz_store.cc:276] 0709 13:03:29.015066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.147609 (+1132543us) service_pool.cc:224] Handling call
0709 13:03:30.147874 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.148461 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.148618 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.101989  8195 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:30.153853  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:30.159210  8274 pending_rounds.cc:85] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 1
I20260709 13:03:30.175300  8274 pending_rounds.cc:107] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:30.175588  8274 raft_consensus.cc:2889] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.157161  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.106319  9472 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:30.179545  8776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.018s	sys 0.075s
W20260709 13:03:30.179955  8776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.018s	sys 0.075s
I20260709 13:03:30.152283  9932 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.177037  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1508) took 1018 ms. Trace:
I20260709 13:03:30.116899  8194 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:30.185699  8193 rpcz_store.cc:276] 0709 13:03:29.158608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.162356 (+1003748us) service_pool.cc:224] Handling call
0709 13:03:30.176519 (+ 14163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.176706 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.176732 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.176773 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:30.176802 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.176854 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.176979 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.179658  9730 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.184016  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:30.180260  9472 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:30.203307  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.220826  8200 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:30.182004  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.185052  9851 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.179487  9695 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:03:30.216305  9832 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:30.231251  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.001s	sys 0.044s
W20260709 13:03:30.231626  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.001s	sys 0.044s
I20260709 13:03:30.186692  9694 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:03:30.224814  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.020s	sys 0.038s
W20260709 13:03:30.227332  8804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.012s	sys 0.030s
W20260709 13:03:30.188151  8192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.015s	sys 0.038s
I20260709 13:03:30.210227  9926 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.227210  9851 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:30.234428  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.017s	sys 0.029s
W20260709 13:03:30.234637  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.020s	sys 0.038s
W20260709 13:03:30.234315  8166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.008s	sys 0.021s
I20260709 13:03:30.233103  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:30.187602  9921 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.239705  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.188858  9730 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:30.238598  8192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.015s	sys 0.038s
I20260709 13:03:30.189865  9932 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.234213  9829 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:30.245806  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.017s	sys 0.030s
W20260709 13:03:30.270092  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 715893us
W20260709 13:03:30.269862  8810 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.012s	sys 0.034s
W20260709 13:03:30.270884  8810 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.012s	sys 0.034s
I20260709 13:03:30.271056  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:30.277403  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.278800  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.280771  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.250305  8166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.008s	sys 0.021s
W20260709 13:03:30.250372  8272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.024s
W20260709 13:03:30.251494  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.026s	sys 0.011s
W20260709 13:03:30.282989  8272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.013s	sys 0.024s
I20260709 13:03:30.239656  9832 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:30.233739  9592 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.246236  9851 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:30.186062  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 191) took 1217 ms. Trace:
I20260709 13:03:30.252622  9838 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:30.230212  8265 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
W20260709 13:03:30.238399  8804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.012s	sys 0.030s
I20260709 13:03:30.290342  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:30.269654  8194 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:30.296228  8266 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:30.296626  9592 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.297621  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:30.336728  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 46470.1us
W20260709 13:03:30.283027  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.029s	sys 0.015s
W20260709 13:03:30.327072  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.246114  9862 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.312367  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.350867  8269 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
W20260709 13:03:30.314411  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.288281  9829 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:30.342052  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 603417us
W20260709 13:03:30.299994  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.342434  8091 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:30.343215  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.353096  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:30.298522  9797 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:30.246142  9926 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.354732  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.361968  8273 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:30.360178  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:30.325524  8803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.020s	sys 0.047s
W20260709 13:03:30.385824  8803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.020s	sys 0.047s
I20260709 13:03:30.314118  9798 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.386745  9798 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.314347  9694 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.320565  9943 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.078s
I20260709 13:03:30.363986  9786 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.364383  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.367885  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:30.388463  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:30.389894  9915 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.390273  9915 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.390579  9915 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:30.393554  8273 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:30.315294  9787 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:30.394718  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.394809  9787 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.395448  8273 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:30.388954  9786 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.396504  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.396667  9932 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.397073  8273 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:30.397634  9786 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.342797  9839 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:30.397666  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.395444  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:30.398669  8194 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:30.399611  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.400398  8194 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:30.369438  9819 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:30.370290  9730 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.354532  9889 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:30.374752  9832 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.298228  8195 rpcz_store.cc:276] 0709 13:03:28.968982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.076954 (+1107972us) service_pool.cc:224] Handling call
0709 13:03:30.182791 (+105837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:30.375890  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:30.381620  9957 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:03:30.381122  9851 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.350039  9937 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:30.388859  9943 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.006s	sys 0.078s
I20260709 13:03:30.429934  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:30.368213  9958 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:03:30.397884  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.398453  9839 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.368870  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:30.402400  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1507) took 1435 ms. Trace:
I20260709 13:03:30.394112  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:30.368959  9961 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:03:30.402236  9889 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.411955  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:30.442812  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.443356  8125 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:30.409394  8123 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.423281  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:30.426575  9730 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:30.427769  8120 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:30.446825  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:30.447696  8116 raft_consensus.cc:2410] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:30.394829  9970 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:30.363356  9838 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:30.445080  8118 raft_consensus.cc:2410] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:30.447083  8120 pending_rounds.cc:85] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 1
I20260709 13:03:30.451464  8120 pending_rounds.cc:107] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:30.451932  8120 raft_consensus.cc:2889] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.429073  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:30.438457  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 69659us
I20260709 13:03:30.393630  9971 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.454905  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:30.388794  9694 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:30.455621  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.005s	sys 0.019s
W20260709 13:03:30.465234  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.005s	sys 0.019s
W20260709 13:03:30.464354  8021 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.001s	sys 0.023s
I20260709 13:03:30.466660  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:30.466614  8021 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.002s	sys 0.023s
I20260709 13:03:30.468196  8809 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:30.436086  9819 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:30.446120  8194 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:30.360450  9862 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:30.551702  8121 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:30.574293  8121 pending_rounds.cc:85] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 1
I20260709 13:03:30.574573  8121 pending_rounds.cc:107] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:30.574808  8121 raft_consensus.cc:2889] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.443710  9966 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:30.552847  9930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.022s
I20260709 13:03:30.569772  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:30.592882  8117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.011s	sys 0.036s
W20260709 13:03:30.593672  8117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.011s	sys 0.036s
I20260709 13:03:30.594460  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1540) took 1385 ms. Trace:
I20260709 13:03:30.605857  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1087) took 1315 ms. Trace:
I20260709 13:03:30.606406  8191 rpcz_store.cc:276] 0709 13:03:29.290624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.169711 (+879087us) service_pool.cc:224] Handling call
0709 13:03:30.229092 (+ 59381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.229730 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.229752 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.229788 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.229813 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.229858 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.605606 (+375748us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b54002071d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:30.605788 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135922048}
I20260709 13:03:30.468370  9868 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:03:30.622428  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:30.601608  9884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.016s	sys 0.027s
W20260709 13:03:30.601771  9930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.007s	sys 0.022s
W20260709 13:03:30.601452  9837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.010s	sys 0.019s
I20260709 13:03:30.558650  9970 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:30.457635  9971 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.626112  8809 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:30.594854  8117 rpcz_store.cc:276] 0709 13:03:29.209375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.522681 (+313306us) service_pool.cc:224] Handling call
0709 13:03:29.625018 (+102337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.594083 (+969065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.594115 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.594164 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.594194 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.594268 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.594403 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91948,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":73,"thread_start_us":968653,"threads_started":1}
I20260709 13:03:30.661713  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1076) took 2896 ms. Trace:
I20260709 13:03:30.573530  9730 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.649205  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 444) took 1327 ms. Trace:
I20260709 13:03:30.649523  8807 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:03:30.655074  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.601461  9966 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:30.601555  9786 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:30.668112  8810 rpcz_store.cc:276] 0709 13:03:29.322185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.322413 (+   228us) service_pool.cc:224] Handling call
0709 13:03:29.322689 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.627667 (+304978us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:30.271299 (+643632us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.648416 (+377117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.648693 (+   277us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:30.648909 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.648984 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.649144 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8304,"prepare.queue_time_us":923216,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":6359,"thread_start_us":859793,"threads_started":2}
I20260709 13:03:30.625406  9923 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.622642  9926 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:30.669013  9786 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:30.632728  9884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.016s	sys 0.027s
I20260709 13:03:30.667250  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:30.668731  9966 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.662144  8267 rpcz_store.cc:276] 0709 13:03:27.753506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.141614 (+388108us) service_pool.cc:224] Handling call
0709 13:03:28.158681 (+ 17067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.915530 (+756849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.915557 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.921170 (+  5613us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.966730 (+1045560us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:29.966770 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.966839 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.650047 (+683208us) raft_consensus.cc:1685] finished
0709 13:03:30.650073 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.650237 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12268,"raft.queue_time_us":61977,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":15429,"thread_start_us":1707487,"threads_started":2,"wal-append.queue_time_us":1209552}
W20260709 13:03:30.648131  9837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.011s	sys 0.019s
W20260709 13:03:30.647003  9817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.020s	sys 0.021s
I20260709 13:03:30.682241  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 149) took 1532 ms. Trace:
I20260709 13:03:30.684578  8124 rpcz_store.cc:276] 0709 13:03:29.149751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.176130 (+ 26379us) service_pool.cc:224] Handling call
0709 13:03:29.176545 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.176776 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:30.084778 (+908002us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.680550 (+595772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.680658 (+   108us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.680730 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.680932 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.682183 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3671,"prepare.queue_time_us":1187829,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"spinlock_wait_cycles":1792,"thread_start_us":1499027,"threads_started":3,"wal-append.queue_time_us":590455}
W20260709 13:03:30.679076  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 320661us
I20260709 13:03:30.603595  9819 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:30.695962  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.704244  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:30.649381  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.650527  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:30.705159  8267 raft_consensus.cc:2410] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:30.666102  9971 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:30.684476  9817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.020s	sys 0.022s
I20260709 13:03:30.709697  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:30.707710  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 152765us
I20260709 13:03:30.681247  9730 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.727867  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:30.751097  8237 connection.cc:256] RPC call timeout handler was delayed by -1.3110077580000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:03:30.714604  9832 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.755228  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.757579  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56633.5us
I20260709 13:03:30.757659  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.745589  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.759799  8267 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:30.764359  9972 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:03:30.764976  9787 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:30.765516  9787 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.765980  9787 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.767822  9787 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:30.724836  9996 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.725392  9851 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.724573  9592 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:30.809254  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.815769 10008 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:30.815611  9979 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:30.816797 10005 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.814960  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:30.817269 10005 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:30.817148  9979 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:03:30.827666  9987 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:03:30.441052  8192 rpcz_store.cc:276] 0709 13:03:28.967040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.976407 (+  9367us) service_pool.cc:224] Handling call
0709 13:03:29.020257 (+ 43850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:29.159380 (+139123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.163523 (+  4143us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:29.292859 (+129336us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.294248 (+1001389us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:30.294322 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.294407 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.402165 (+107758us) raft_consensus.cc:1685] finished
0709 13:03:30.402198 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.402345 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5029,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":868341,"threads_started":1,"wal-append.queue_time_us":1095345}
I20260709 13:03:30.760936  9868 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:30.761152  9839 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:30.841662  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 83140.5us
I20260709 13:03:30.845212  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:30.820878  9994 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:30.855300  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1506) took 2035 ms. Trace:
I20260709 13:03:30.854188  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:30.814903  9730 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.855880  8197 rpcz_store.cc:276] 0709 13:03:28.820193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.951612 (+131419us) service_pool.cc:224] Handling call
0709 13:03:28.981559 (+ 29947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.991339 (+  9780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.991367 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.991740 (+   373us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.005922 (+1014182us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:30.005962 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.006035 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.767306 (+761271us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b24002bee18. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21ac19c4 00007fbd21abfacb 00007fbd21c7adc9 00007fbd21c7aa55 00007fbd21c79fb0 00007fbd248f0488 00007fbd248f0be8 00007fbd248c8398 00007fbd248c376a 00007fbd248c2bb6
0709 13:03:30.842737 (+ 75431us) raft_consensus.cc:1685] finished
0709 13:03:30.842757 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.855242 (+ 12485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4006,"raft.queue_time_us":16652,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":19625,"spinlock_wait_cycles":9050368,"thread_start_us":907258,"threads_started":1,"wal-append.queue_time_us":1172264}
I20260709 13:03:30.760541  9832 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.838034  9694 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.870868  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1075) took 1882 ms. Trace:
W20260709 13:03:30.873798  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 123981us
I20260709 13:03:30.873719  8196 rpcz_store.cc:276] 0709 13:03:28.988601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.111685 (+1123084us) service_pool.cc:224] Handling call
0709 13:03:30.150771 (+ 39086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.151070 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.151097 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.151634 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.350387 (+198753us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:30.350426 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.350489 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.870646 (+520157us) raft_consensus.cc:1685] finished
0709 13:03:30.870666 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.870814 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1959,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":13417,"thread_start_us":198415,"threads_started":1,"wal-append.queue_time_us":667757}
I20260709 13:03:30.880139  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:30.854507  9889 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.882830  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:30.872378  9974 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:03:30.884794  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:30.866047  9797 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.869411  9862 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.806897  9996 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.852276  9868 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:30.894363  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:30.896714  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:30.883870  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:30.913975  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:30.914602  8810 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.916705  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.890064  9797 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.922039  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.923156  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.923669  8270 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:30.924396  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.924891  8270 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
W20260709 13:03:30.897761  9989 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:03:30.916620  9841 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:03:30.927680  9985 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:30.929544  9819 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:30.930244  9965 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:30.888618  9915 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:30.931391  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.897861  9889 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:30.932277  8271 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:30.893308  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:30.821370  9970 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:30.937187  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.940621  8810 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:30.943041  8163 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:30.912765  9730 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:30.945961  9959 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.721s	user 0.002s	sys 0.001s
I20260709 13:03:30.946401  8274 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:30.974189  8274 pending_rounds.cc:85] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:03:30.974465  8274 pending_rounds.cc:107] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:30.974704  8274 raft_consensus.cc:2889] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.912523  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:30.913071  9862 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:30.946883  9839 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:30.948019  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 215) took 1754 ms. Trace:
I20260709 13:03:30.949764 10002 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:30.950120  9472 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.002s
W20260709 13:03:30.929590  9982 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:03:30.950476  8270 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:30.916802 10008 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:30.965234  8271 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:30.921636  9797 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.967129  8196 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:30.940848  9943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.030s
I20260709 13:03:30.950409  9724 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:30.999935  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.990787  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.070981  8271 pending_rounds.cc:85] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 1
I20260709 13:03:31.071679  8271 pending_rounds.cc:107] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:31.072307  8271 raft_consensus.cc:2889] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:31.063510  8274 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:31.061177  8272 rpcz_store.cc:276] 0709 13:03:29.193129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.194380 (+  1251us) service_pool.cc:224] Handling call
0709 13:03:29.194687 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:29.531398 (+336711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.531430 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.700957 (+169527us) log.cc:844] Serialized 52 byte log entry
0709 13:03:30.283572 (+582615us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.283618 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.713139 (+429521us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400076554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:30.713180 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.947734 (+234554us) raft_consensus.cc:1685] finished
0709 13:03:30.947753 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.947961 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96915,"raft.queue_time_us":8819,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":88121,"spinlock_wait_cycles":754253696,"thread_start_us":571279,"threads_started":1,"wal-append.queue_time_us":948767}
I20260709 13:03:31.073593  8271 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:31.076678  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:31.076072  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 901282us
I20260709 13:03:30.968631  9730 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:31.077960  8810 raft_consensus.cc:2376] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5. Re-sending same reply.
I20260709 13:03:31.077325  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:31.062486  9943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.045s
I20260709 13:03:31.080541  9787 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.973809  9884 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.006188  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.086763  9787 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.089814  9787 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.073179  9724 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:31.091116  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.091820  8166 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.094609  9868 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.083220  9730 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.095679  8810 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:31.096053 10018 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.096496  9832 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.095480  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.069578  9862 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:31.097018  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1499) took 2288 ms. Trace:
I20260709 13:03:31.098834  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:31.106178  9966 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.103932  8198 rpcz_store.cc:276] 0709 13:03:28.808734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.860851 (+ 52117us) service_pool.cc:224] Handling call
0709 13:03:28.881357 (+ 20506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.988597 (+107240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.988629 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.998496 (+  9867us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.973117 (+974621us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:29.973155 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.049892 (+ 76737us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540014c3d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:30.049938 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.945511 (+895573us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:31.096814 (+151303us) raft_consensus.cc:1685] finished
0709 13:03:31.096833 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.096962 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6125,"raft.queue_time_us":15812,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":237500928,"thread_start_us":972028,"threads_started":1,"wal-append.queue_time_us":1155905}
W20260709 13:03:31.109921  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.103044  9808 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.114252  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:31.095275  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 470) took 2127 ms. Trace:
I20260709 13:03:31.086339  9884 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.117628  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:31.126055  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.126700  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.127210  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.127261  8270 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:31.128587  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.128846  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.130231  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.130332  8272 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:31.103294 10018 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:31.077185  9472 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.131394  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.131999  8166 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:31.108747  9862 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:31.109871  9841 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:31.135847  8272 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:31.135018 10018 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.165658  9996 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.151564 10005 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:31.165880  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 320750us
I20260709 13:03:31.167994  9610 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.168419  9966 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.169456  9966 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.168352  9610 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:31.170199  9610 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.172029  9472 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.117313  8192 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:31.173291  8805 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:31.152868  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.119233  8803 rpcz_store.cc:276] 0709 13:03:28.965700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.966518 (+   818us) service_pool.cc:224] Handling call
0709 13:03:28.967035 (+   517us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.967564 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.967590 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.233085 (+265495us) log.cc:844] Serialized 582 byte log entry
0709 13:03:30.386274 (+1153189us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:30.386327 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.386411 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.083755 (+697344us) raft_consensus.cc:1685] finished
0709 13:03:31.083780 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.092906 (+  9126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":684,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":7693,"thread_start_us":1090635,"threads_started":1,"wal-append.queue_time_us":1550398}
I20260709 13:03:31.174917  8808 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:31.175181  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.175825  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.176124 10018 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.176458  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.176669  8808 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:31.099961  9724 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.154913  8804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 461) took 2841 ms. Trace:
I20260709 13:03:31.178480 10018 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.178714  9839 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:31.180572  9991 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:03:31.181674  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 196) took 1360 ms. Trace:
I20260709 13:03:31.134788  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.182025  8200 rpcz_store.cc:276] 0709 13:03:29.820902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.221578 (+400676us) service_pool.cc:224] Handling call
0709 13:03:30.221890 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.230057 (+  8167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.230083 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.240860 (+ 10777us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.617772 (+376912us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.618554 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.618656 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.181384 (+562728us) raft_consensus.cc:1685] finished
0709 13:03:31.181404 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.181600 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7900,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7617,"thread_start_us":328841,"threads_started":1,"wal-append.queue_time_us":712123}
I20260709 13:03:31.164958  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:31.162577  8122 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:31.131114  9915 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.169883  9966 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.178957  9724 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.119359  9808 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.176584  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:31.129115  8271 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:31.183801  8272 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.131672  9884 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.114800  9971 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.186089  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:31.186767  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:31.188416  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.191394  8270 raft_consensus.cc:2410] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:31.192672  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.193529  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.194983  8270 raft_consensus.cc:2410] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:31.192095  8268 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:31.196985  9971 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.197465  9790 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:03:31.197722  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:31.198812  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:31.199275  9819 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.199733  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:31.200935  8191 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:31.201150 10020 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:31.183282  9841 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.202416  9841 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:31.203071  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.204145  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.206084  8273 raft_consensus.cc:2368] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:31.207046  8810 raft_consensus.cc:2410] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:31.207197  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.185029 10008 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.208842  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:31.207501  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:31.215777  8191 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.173310  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:31.235507  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49486.2us
I20260709 13:03:31.199653  9819 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:31.190218  9808 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:31.237929  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.238767 10033 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:31.239882  8811 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:31.239315  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.244380  8191 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:31.187772  9619 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:03:31.252059 10033 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:31.252068  8806 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Advancing to term 3
I20260709 13:03:31.205391  9559 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:03:31.246057  9819 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.185820 10016 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:31.255832 10011 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:31.257473  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.257853  9610 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.191848  9839 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:03:31.258282  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:31.242800  9918 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:31.199656  9862 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.217661 10008 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.226393  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.239466  9617 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:31.278796  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:31.254630  9786 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.261300 10003 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:31.290932  8809 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:31.262473 10033 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:31.236644  9939 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:03:31.262429  9787 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:03:31.291471 10008 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.305544  8191 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:31.287463  9943 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:31.309077  8806 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:03:31.293229  8194 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:03:31.296660  9969 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:31.293680  9993 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:31.317533  8806 pending_rounds.cc:85] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 2
I20260709 13:03:31.325423  8806 pending_rounds.cc:107] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:03:31.325707  8806 raft_consensus.cc:2889] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:31.294071  9617 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.303308 10003 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:31.305190  9829 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.332217  9617 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:31.338922 10024 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:03:31.340934  9610 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.313407  9730 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:31.347406  9966 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.308701 10019 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:03:31.356036  9862 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.359951  8198 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:31.177560  8804 rpcz_store.cc:276] 0709 13:03:28.314027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.316136 (+  2109us) service_pool.cc:224] Handling call
0709 13:03:28.325131 (+  8995us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:29.231624 (+906493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.233575 (+  1951us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.318556 (+ 84981us) log.cc:844] Serialized 52 byte log entry
0709 13:03:30.351150 (+1032594us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.664375 (+313225us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.154208 (+489833us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18003d4500. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:03:31.154380 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.154466 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.154514 (+    48us) raft_consensus.cc:1685] finished
0709 13:03:31.154727 (+   213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.154859 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24589,"prepare.queue_time_us":303127,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":18398,"raft.queue_time_us":511351,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":17022,"spinlock_wait_cycles":25646976,"thread_start_us":1693513,"threads_started":3,"wal-append.queue_time_us":978339}
I20260709 13:03:31.361909  8804 raft_consensus.cc:1217] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:03:31.362390  8804 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:31.366994 10033 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.368448 10033 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.386281  8272 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
W20260709 13:03:31.387576  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 92404.1us
W20260709 13:03:31.387678  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 202701us
I20260709 13:03:31.389667  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.336871 10003 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:31.393920  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:31.511198  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 117344us
W20260709 13:03:31.428442  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.501784  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.336387  9993 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:31.528357  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:31.508910  9862 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:31.530740  9967 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:31.555016  9943 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:31.555977  9993 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.531555 10005 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:31.557837 10019 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:31.574434  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.586477  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.509116  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:31.385799  9841 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.603777  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:31.551280  9862 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.604023  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.610718  8272 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:31.588732  9943 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.539252  9797 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.594425  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.597098  9619 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.557245  9617 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.612229  9862 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:31.604939  9969 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.594018  9839 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:03:31.621205  8266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1106) took 1477 ms (client timeout 1855 ms). Trace:
W20260709 13:03:31.636718  8266 rpcz_store.cc:269] 0709 13:03:30.144132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.152608 (+  8476us) service_pool.cc:224] Handling call
0709 13:03:31.621040 (+1468432us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54004060d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:31.621146 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320851200}
I20260709 13:03:31.603084  9975 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:31.617718 10034 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:31.630295  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:31.638285  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.625686  9943 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:31.645537  8271 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:31.625288  9619 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.623631  9819 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.671475  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:31.656054  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:31.650027  8266 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:31.684506  8272 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.700806  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:31.704217  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.706272  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:31.710444  9724 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.710983  9724 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:31.713765  8193 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:31.714120  8193 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:31.716604  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 450) took 2391 ms. Trace:
I20260709 13:03:31.716987  9970 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.717468  9970 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.717021  8807 rpcz_store.cc:276] 0709 13:03:29.324786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.805333 (+480547us) service_pool.cc:224] Handling call
0709 13:03:30.649125 (+843792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.668192 (+ 19067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.716438 (+1048246us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002f4ed0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:31.716553 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919046528}
I20260709 13:03:31.719422  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.720412  9996 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.720861  9996 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:31.666556 10004 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 13:03:31.687052 10019 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:31.652779  9943 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.655741  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:31.656328 10034 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:31.669140  9841 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.668035  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.688249  9619 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.647271  9975 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.784835  9839 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:31.785362  9839 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:31.786376  8807 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:31.786219  9839 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.647508  9969 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:31.657406  9884 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.663444  9808 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.767343  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:31.768503  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:31.770437  9798 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.765498  9917 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:31.794451  9917 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:31.795382  9917 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.796784  9917 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:31.658684 10008 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.757072  9617 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.791008  8269 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:31.809729  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 102190us
I20260709 13:03:31.810552  8269 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:31.786240  9975 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.789987  9724 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.811743  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.818905  8269 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:31.829918  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:31.830269  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 747075us
I20260709 13:03:31.830891  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.831154  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.831678  8117 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:31.833137  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.833907  8119 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
W20260709 13:03:31.803063  8802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 262) took 1347 ms (client timeout 1672 ms). Trace:
I20260709 13:03:31.837669  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.838871  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.839494  8117 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:31.840754  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:31.842854  8123 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:03:31.847662  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.847793  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.848310  8121 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:31.818290  9996 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.824162  9724 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:31.871964  9724 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.789095  9969 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:31.855269 10028 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:31.865542  9920 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:03:31.842458  9472 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.847365  9798 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:31.880218  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49394.7us
I20260709 13:03:31.851825 10034 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.886826  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:31.849455  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:31.900811  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:31.842394  8802 rpcz_store.cc:269] 0709 13:03:30.453613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.455665 (+  2052us) service_pool.cc:224] Handling call
0709 13:03:31.768351 (+1312686us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:31.801203 (+ 32852us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32838016}
I20260709 13:03:31.902768  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:31.903504  8124 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:31.898051  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:31.905902  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:31.910550 10008 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.912927  9921 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.912748  9862 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.899154 10028 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:31.932031  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45284.2us
I20260709 13:03:31.883853  9928 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:31.914508  9819 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:31.904410  9472 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.906744  9798 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.913338  9921 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:31.927717 10021 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 0.802s	user 0.005s	sys 0.012s
I20260709 13:03:31.915946 10003 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.930380  9995 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:03:31.930614  9617 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:31.931054  8805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 274) took 1119 ms. Trace:
I20260709 13:03:31.931298  9996 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:31.906198 10022 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.764s	user 0.007s	sys 0.009s
I20260709 13:03:31.932763  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:32.006636  8809 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:31.933095  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:03:31.940770 10017 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.830s	user 0.001s	sys 0.012s
I20260709 13:03:31.914355  9619 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.998162  9937 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.937774  9857 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:03:31.981856  9819 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.025758  9819 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:32.027503  8122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1547) took 1605 ms (client timeout 1873 ms). Trace:
I20260709 13:03:32.027745  9819 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.006500  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:32.028971  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 267) took 1461 ms. Trace:
I20260709 13:03:32.029387  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:32.029757  9923 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:32.030224  9923 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.032094  9808 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:31.990253  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.992556  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52798.5us
I20260709 13:03:32.000679  9757 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:32.035466  9757 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.003140  9694 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.948498  9928 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:31.931924  8803 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:31.942422  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.043112  8197 raft_consensus.cc:2410] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:32.009461  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 76427.9us
W20260709 13:03:31.942350  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.010890  9970 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.012035  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.010321  9969 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.008489  9592 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:32.006512  9996 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.044375  9969 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:32.044646  9996 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.044901  9969 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.043797  9928 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.012952  9724 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.015496  8270 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:32.014007  8193 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.042649  8809 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:32.000494  8805 rpcz_store.cc:276] 0709 13:03:30.812143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.814648 (+  2505us) service_pool.cc:224] Handling call
0709 13:03:31.930865 (+1116217us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54004e16d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:31.930999 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707937152}
I20260709 13:03:32.048893  8805 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEARNER]: Advancing to term 4
I20260709 13:03:32.017907  9936 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.045027  9592 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:32.019625  9619 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.056115  9592 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:31.998965  9884 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:32.020500  8273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1519) took 1655 ms (client timeout 1750 ms). Trace:
W20260709 13:03:32.057834  8273 rpcz_store.cc:269] 0709 13:03:30.365133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.442547 (+ 77414us) service_pool.cc:224] Handling call
0709 13:03:32.020318 (+1577771us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001be9d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:32.020441 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753507712}
I20260709 13:03:32.020756  9937 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.938184  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.002681  8268 raft_consensus.cc:2410] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:31.942201  9838 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.025244  9472 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:32.033413  8122 rpcz_store.cc:269] 0709 13:03:30.422340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.422480 (+   140us) service_pool.cc:224] Handling call
0709 13:03:32.027323 (+1604843us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540028afd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:32.027442 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631373568}
I20260709 13:03:32.029337  8811 rpcz_store.cc:276] 0709 13:03:30.567715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.567847 (+   132us) service_pool.cc:224] Handling call
0709 13:03:31.239581 (+671734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.244862 (+  5281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.028789 (+783927us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b540062e650. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:32.028906 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540604160}
I20260709 13:03:32.007946 10028 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.037660  9694 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:31.814553  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:32.080276  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 265785us
I20260709 13:03:31.649811  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:32.039918  9808 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:03:32.041646 10009 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.042275  9943 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.042999  9787 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.043777  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.044849  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:32.047369  8193 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.939721  8272 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:32.016850 10003 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:31.989939  9921 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.061832  8196 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:32.064565  9937 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.037693  9757 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.065698  9592 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:32.086510  9724 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.073716  9798 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.040308  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:32.116506  8199 raft_consensus.cc:2393] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:32.076928  9617 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.088780  9943 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.090432  8267 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.093808  8811 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:32.095791  8238 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:32.097265  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.087170  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 437398us
I20260709 13:03:32.069608  9996 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.086783 10011 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.115561  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 71856.4us
I20260709 13:03:32.104559  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.090435 10028 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.078831  9969 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.126401  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.089617  9787 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.133949  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:32.137908  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.079546  9838 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:32.136580  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.139428  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.121299 10003 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.149693  8272 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:03:32.150058  8193 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:32.106693 10009 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.156749  9971 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:32.162715  8265 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 13:03:32.169868  9797 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.171622  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:32.198151  8267 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:32.198633  8196 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:32.172912  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.133899 10028 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.124962  9617 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.180049  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:32.179312 10002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.063s	sys 0.138s
I20260709 13:03:32.171411  8268 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:32.128167 10011 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.174551  9937 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.174407  9757 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:32.179814 10005 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:32.152143 10003 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:32.197417  9868 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:03:32.219643  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.221616  9838 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.195695  9971 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:32.201280 10028 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.180083  9936 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.201882  9472 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.226060  9472 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.201287  9943 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:32.205636 10002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.063s	sys 0.138s
I20260709 13:03:32.161085  9923 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.217839  9937 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.226858  9694 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.218883 10003 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.227813  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:32.227464  9936 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.248338  8267 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:03:32.251003  8267 pending_rounds.cc:85] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 4
I20260709 13:03:32.251255  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.252580  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.252866  8196 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:32.251291  8267 pending_rounds.cc:107] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:03:32.253556  8267 raft_consensus.cc:2889] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:32.256436  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 181060us
I20260709 13:03:32.257122  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.258284  9943 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:32.219578  9757 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:32.266398  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 412592us
I20260709 13:03:32.269529  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.311369  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.313079  8117 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:32.313958  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.274242  9943 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:32.274263  9917 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:32.315971  9917 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.316291  9943 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.318055  9917 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.320072  9996 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.321600  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:32.315672  8122 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:32.386018  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.386768  8197 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:32.251835  9936 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.345321  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:32.348516  9730 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.352331  9923 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.353318 10002 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.354650  9787 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.354811 10018 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:32.356071  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.409808  8196 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:32.272078 10033 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.385151  9995 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:32.357434  9969 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.357143 10009 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.367838  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 476) took 1193 ms. Trace:
I20260709 13:03:32.275323 10000 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.311302  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:32.373330  9862 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.373840  9921 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.273077  9971 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.381532  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:32.267575  9993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.008s	sys 0.019s
I20260709 13:03:32.238708  9857 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:32.314473  8117 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:32.392586  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 195) took 2574 ms. Trace:
I20260709 13:03:32.431457  8193 rpcz_store.cc:276] 0709 13:03:29.818222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.190565 (+372343us) service_pool.cc:224] Handling call
0709 13:03:30.190814 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.713680 (+1522866us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b540008e420. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9fdc0 00007fbd24d2a1c0 00007fbd24d2b231 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c
0709 13:03:32.013696 (+300016us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b4c00502f80. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd22ff4a20 00007fbd23005a29 00007fbd22fcb644 00007fbd22ff2f2d 00007fbd22ff2b93 00007fbd24d2318b 00007fbd24d23cb5 00007fbd24d1ef30 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416
0709 13:03:32.186037 (+172341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.392348 (+206311us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400365454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:32.392524 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270969216}
I20260709 13:03:32.241950 10036 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:03:32.395357  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.405226  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:32.387560  9839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.026s
I20260709 13:03:32.379606  9838 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:32.357115 10014 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.269s	user 0.003s	sys 0.000s
I20260709 13:03:32.384971 10011 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.424625  8811 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:32.426759 10000 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.405387  9472 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:32.433506  9993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.008s	sys 0.020s
I20260709 13:03:32.410425  8808 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:32.418227  9930 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:32.431483  8124 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:32.430147  8269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.016s	sys 0.010s
I20260709 13:03:32.433322  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.409446 10002 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.455881  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.432204  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:32.450766  9979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.050s
W20260709 13:03:32.450804  9839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.011s	sys 0.026s
I20260709 13:03:32.431041  9857 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:32.481386  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.485301  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52060.1us
I20260709 13:03:32.450136  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:32.417677 10018 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:32.485793  8269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.016s	sys 0.010s
I20260709 13:03:32.422319 10033 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.485033  9971 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:32.497243  8274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.040s	sys 0.099s
W20260709 13:03:32.533056  8274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.040s	sys 0.102s
I20260709 13:03:32.471805  8805 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:03:32.524751  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 68972.3us
I20260709 13:03:32.425221  8803 rpcz_store.cc:276] 0709 13:03:31.174540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.374474 (+199934us) service_pool.cc:224] Handling call
0709 13:03:31.931698 (+557224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.042735 (+111037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.367638 (+324903us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54004e16d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:32.367777 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280676608}
W20260709 13:03:32.519719  9979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.009s	sys 0.051s
I20260709 13:03:32.451985  9969 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.559631  9969 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.560065  9969 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.560159 10033 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.524720  9937 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.533576 10003 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.562570  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.531394  8266 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:03:32.456779 10000 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.520985 10011 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:32.455062  9838 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.522840  8117 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:32.529443 10014 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:32.519857  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 456) took 1334 ms. Trace:
I20260709 13:03:32.547019  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:32.525688  9857 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:32.590296  8163 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.620s (SENT) [suppressed 14 similar messages]
I20260709 13:03:32.594095  9730 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:32.595122 10045 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:32.595474 10045 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:32.596241 10045 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.597369  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1549) took 2172 ms. Trace:
I20260709 13:03:32.597535 10045 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.598354  8805 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:32.598959  9838 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.571574 10011 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.599834 10011 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.565431  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.532531  9797 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.525636 10046 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:32.576244  8273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.009s	sys 0.025s
I20260709 13:03:32.581820  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.560189 10018 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:32.585608  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:32.586436  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1552) took 2160 ms. Trace:
I20260709 13:03:32.626372  8116 rpcz_store.cc:276] 0709 13:03:30.426166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.456763 (+ 30597us) service_pool.cc:224] Handling call
0709 13:03:30.553102 (+ 96339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.553560 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.553660 (+   100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.713860 (+1160200us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b2c00000f48. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:03:31.714208 (+   348us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.184315 (+470107us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:32.184352 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.184415 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.586130 (+401715us) raft_consensus.cc:1685] finished
0709 13:03:32.586150 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.586359 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97994,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":17786,"spinlock_wait_cycles":3513728,"thread_start_us":469763,"threads_started":1,"wal-append.queue_time_us":742874}
I20260709 13:03:32.574252  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.588529  8272 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:32.589392  8808 rpcz_store.cc:276] 0709 13:03:31.154463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.344987 (+1190524us) service_pool.cc:224] Handling call
0709 13:03:32.489043 (+144056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:32.605595  8118 rpcz_store.cc:276] 0709 13:03:30.424544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.450490 (+ 25946us) service_pool.cc:224] Handling call
0709 13:03:30.450820 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.451134 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:30.548618 (+ 97484us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.871013 (+322395us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.871503 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.871627 (+   124us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.871835 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.799311 (+927476us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b18003233e0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:03:31.799478 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.799550 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.846845 (+ 47295us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18003233e0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:03:32.356615 (+509770us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:32.597164 (+240549us) raft_consensus.cc:1685] finished
0709 13:03:32.597184 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.597294 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76712,"prepare.queue_time_us":97840,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":7885,"raft.queue_time_us":1079715,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":8745,"spinlock_wait_cycles":49273344,"thread_start_us":297739,"threads_started":1,"wal-append.queue_time_us":529636}
I20260709 13:03:32.604744  9617 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.604619  9757 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:32.607450  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.620460  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 459) took 1465 ms. Trace:
I20260709 13:03:32.630934  8810 rpcz_store.cc:276] 0709 13:03:31.155269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.203944 (+ 48675us) service_pool.cc:224] Handling call
0709 13:03:32.620241 (+1416297us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b54004e02d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:32.620392 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5059328}
I20260709 13:03:32.521752  9930 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:32.622381  8273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.009s	sys 0.025s
I20260709 13:03:32.622594  8193 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:32.586655  9921 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.638621  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.633277  8270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:32.640393  8270 raft_consensus.cc:606] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.643412  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:32.608083 10033 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:03:32.645113  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:32.629741  9808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.049s
I20260709 13:03:32.647682  8272 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:32.628295 10046 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:32.647006  8125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.037s
W20260709 13:03:32.648327  8125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.000s	sys 0.037s
W20260709 13:03:32.645540  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.023s	sys 0.016s
W20260709 13:03:32.649986  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.024s	sys 0.016s
W20260709 13:03:32.650549  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 511133us
W20260709 13:03:32.651665  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.653261  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.653174  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.641253  9798 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.628932  9730 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:32.674695  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:32.643853  9617 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:32.655527  9926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.031s
I20260709 13:03:32.646793  9917 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:32.651038  9808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.013s	sys 0.049s
I20260709 13:03:32.701593  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:32.656271 10021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.014s	sys 0.021s
I20260709 13:03:32.729267  8116 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
W20260709 13:03:32.678349 10034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.003s	sys 0.029s
I20260709 13:03:32.729669  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:32.731403 10021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.014s	sys 0.021s
I20260709 13:03:32.698585  9839 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:32.730674 10040 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.728942  9926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.037s
W20260709 13:03:32.740391  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 65753.1us
W20260709 13:03:32.715463  9619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.017s	sys 0.020s
I20260709 13:03:32.740653  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.716177  9617 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:32.731138  8265 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:32.746462  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:32.733882  8802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.012s	sys 0.028s
W20260709 13:03:32.737049 10034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.003s	sys 0.029s
W20260709 13:03:32.755290  8121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.010s	sys 0.026s
I20260709 13:03:32.732685  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.741675  9917 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:03:32.766400  8121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.010s	sys 0.026s
W20260709 13:03:32.756856  9619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.018s	sys 0.021s
I20260709 13:03:32.745291  9808 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.769913  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.767918  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:32.768067  8802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.012s	sys 0.029s
W20260709 13:03:32.766803  9928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.022s	sys 0.016s
I20260709 13:03:32.761751  9617 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:32.764046 10010 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.812322  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 44478.6us
I20260709 13:03:32.764310  9993 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:32.757264 10045 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.762135 10055 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:32.763365 10002 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.764107 10009 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:32.816629  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.766125  9839 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:32.818714  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:32.813450  9928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.022s	sys 0.016s
I20260709 13:03:32.766954 10033 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:32.773504  9807 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.021s	sys 0.025s
I20260709 13:03:32.745200 10040 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.820439 10045 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.824291  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.828341  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.842336  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.842471  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.835963  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:32.813711  9832 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:32.772783  8268 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:32.768222  9923 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:03:32.824816  9993 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:32.823320  9917 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.768318  9979 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:03:32.835121  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:32.840287  9807 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.021s	sys 0.026s
I20260709 13:03:32.822198 10055 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:32.841665  8116 raft_consensus.cc:2368] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:32.843390  8272 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:32.843344  8119 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:03:32.842690 10028 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.005s
I20260709 13:03:32.848865  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:32.837165  9472 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:32.841554  8123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.010s	sys 0.028s
I20260709 13:03:32.859305  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.843461 10045 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.860737  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:32.847008  9724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.011s	sys 0.029s
I20260709 13:03:32.822114 10010 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.860648  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:32.866173  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:32.838166 10009 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:32.866686  8123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.011s	sys 0.028s
W20260709 13:03:32.849812  9943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.042s
I20260709 13:03:32.871166  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:32.860644  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 962804us
I20260709 13:03:32.769421 10046 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.871744  8119 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.840732 10033 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.906517  8272 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:32.861693  9928 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:32.875841  9943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.015s	sys 0.046s
I20260709 13:03:32.907999  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.870187  9838 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:32.863591  9921 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:32.871542  9724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.011s	sys 0.029s
I20260709 13:03:32.925608  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:32.933495  8272 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:32.929132  8117 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:32.864112 10028 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.941754  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.942611  8117 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:32.944785  8272 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:32.945809  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:32.951150  9889 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:32.951581  9889 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:32.952353  9889 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.953926  9798 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:32.954440  9798 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:32.954875 10060 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:03:32.961779  8165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.057s	sys 0.067s
W20260709 13:03:32.962145  8165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.058s	sys 0.067s
I20260709 13:03:32.962809 10009 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.965483  9724 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:32.966053  9724 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:32.966648  9936 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.002s
I20260709 13:03:32.967149  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1543) took 1331 ms. Trace:
I20260709 13:03:32.967042  9936 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:32.922354  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:32.875999  9839 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.952967  8266 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:32.974007  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:32.967517  8273 rpcz_store.cc:276] 0709 13:03:31.635674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.058649 (+422975us) service_pool.cc:224] Handling call
0709 13:03:32.059054 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:32.059409 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.059434 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.059851 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.638329 (+578478us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.638369 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.638439 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.966963 (+328524us) raft_consensus.cc:1685] finished
0709 13:03:32.966982 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.967099 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10516,"raft.queue_time_us":33954,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":10280,"thread_start_us":578205,"threads_started":1,"wal-append.queue_time_us":802528}
I20260709 13:03:32.970080  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.986124  8193 raft_consensus.cc:2410] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:32.947675  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:32.987685  8119 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:32.969702  8199 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:32.988699  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.947782  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:32.991487  8117 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:32.992522  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 478) took 1817 ms. Trace:
I20260709 13:03:32.990139  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:32.994078  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.994772  8117 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:32.992889  8806 rpcz_store.cc:276] 0709 13:03:31.175283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.236430 (+1061147us) service_pool.cc:224] Handling call
0709 13:03:32.236790 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:32.238641 (+  1851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.238672 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.239822 (+  1150us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.364796 (+124974us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18004005a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:03:32.850055 (+485259us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:32.850096 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.850162 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.976693 (+126531us) raft_consensus.cc:1685] finished
0709 13:03:32.976715 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.992454 (+ 15739us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1855,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7521,"spinlock_wait_cycles":8508160,"thread_start_us":485084,"threads_started":1,"wal-append.queue_time_us":733960}
I20260709 13:03:32.985085  8196 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:03:32.954020 10047 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:03:32.995044  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.000041  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.000685  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1564) took 1156 ms. Trace:
I20260709 13:03:32.917111  9969 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:32.970216 10059 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:03:33.035180  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 226) took 1436 ms. Trace:
I20260709 13:03:33.035488  9857 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.036798  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.034726  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1554) took 1205 ms. Trace:
I20260709 13:03:33.037599  8268 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:33.026362  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1542) took 1391 ms. Trace:
I20260709 13:03:33.028025  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:32.974434 10028 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:32.969977 10040 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:33.038494  8268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:33.039355  8268 raft_consensus.cc:606] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:33.043665  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.024533  8198 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:32.937219  9993 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.989873  9790 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:33.025941  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.037678  8120 rpcz_store.cc:276] 0709 13:03:31.828803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.832581 (+  3778us) service_pool.cc:224] Handling call
0709 13:03:31.850420 (+ 17839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.884218 (+ 33798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.884245 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.895023 (+ 10778us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.383241 (+488218us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:32.383266 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.383315 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.969721 (+586406us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:33.034462 (+ 64741us) raft_consensus.cc:1685] finished
0709 13:03:33.034481 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.034668 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41208,"raft.queue_time_us":33715,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15210,"spinlock_wait_cycles":32968960,"thread_start_us":487916,"threads_started":1,"wal-append.queue_time_us":746585}
I20260709 13:03:33.037948  8269 rpcz_store.cc:276] 0709 13:03:31.635104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.819596 (+184492us) service_pool.cc:224] Handling call
0709 13:03:31.820281 (+   685us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:31.828260 (+  7979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.828289 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:31.854053 (+ 25764us) log.cc:844] Serialized 582 byte log entry
0709 13:03:32.526010 (+671957us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.526046 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.526115 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.026179 (+500064us) raft_consensus.cc:1685] finished
0709 13:03:33.026197 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.026314 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402,"raft.queue_time_us":85,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12673,"thread_start_us":629861,"threads_started":1,"wal-append.queue_time_us":894954}
I20260709 13:03:32.970062  8808 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:33.042387  8116 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:33.041808  9969 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:32.969009  9730 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:33.035774  8274 rpcz_store.cc:276] 0709 13:03:31.598912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.599107 (+   195us) service_pool.cc:224] Handling call
0709 13:03:31.599757 (+   650us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:31.603408 (+  3651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.603437 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:31.609119 (+  5682us) log.cc:844] Serialized 52 byte log entry
0709 13:03:32.533481 (+924362us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:32.533517 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.533580 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.034847 (+501267us) raft_consensus.cc:1685] finished
0709 13:03:33.034867 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.035095 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3151,"raft.queue_time_us":6580,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6149,"thread_start_us":901176,"threads_started":1,"wal-append.queue_time_us":1204560}
I20260709 13:03:32.990197  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:33.032907  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.971005 10010 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:33.049518  8123 rpcz_store.cc:276] 0709 13:03:31.843896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.844050 (+   154us) service_pool.cc:224] Handling call
0709 13:03:31.844342 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.844552 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.844577 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.845015 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.875374 (+1030359us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.875415 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.875492 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.000371 (+124879us) raft_consensus.cc:1685] finished
0709 13:03:33.000398 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.000564 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1030057,"threads_started":1,"wal-append.queue_time_us":1130262}
I20260709 13:03:33.050678  8119 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:33.003180  8809 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:32.992048  9930 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.003583  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:33.124529  9928 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:33.094627  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1565) took 1243 ms. Trace:
I20260709 13:03:33.066686  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:33.132761  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:33.074119  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 223567us
I20260709 13:03:33.143278  9798 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:32.930394 10055 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.146514 10055 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:33.149477 10072 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:03:33.150406  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.151029  8266 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:33.151839  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:33.152340  8266 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:33.153697 10000 consensus_meta.cc:287] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.005s
I20260709 13:03:33.154361 10000 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.155239  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.156507  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.006778  8199 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:33.158388  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:33.159682 10049 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.783s	user 0.000s	sys 0.002s
I20260709 13:03:33.158417  9797 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:33.161759  9797 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:33.162344 10011 consensus_meta.cc:287] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.562s	user 0.000s	sys 0.008s
I20260709 13:03:33.162746 10011 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.158764  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1566) took 1277 ms. Trace:
I20260709 13:03:33.139197 10019 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:33.165941 10019 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:32.989598  9472 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:33.171201  8804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 461) took 1777 ms (client timeout 1792 ms). Trace:
W20260709 13:03:33.171697  8804 rpcz_store.cc:269] 0709 13:03:31.393316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.667752 (+274436us) service_pool.cc:224] Handling call
0709 13:03:33.170995 (+1503243us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54004e0f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:33.171141 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284452224}
I20260709 13:03:32.968086  9724 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.174333  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:33.176223  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.177547  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.177974  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.178869  8123 raft_consensus.cc:2368] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:33.141165  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.179419  8269 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:33.179646  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.180182  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.180655  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.180919  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 483) took 1006 ms. Trace:
I20260709 13:03:33.181170  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:33.156697  9798 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:33.181715  8269 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.184264 10002 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:33.184682 10002 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:33.186077 10054 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.832s	user 0.006s	sys 0.000s
I20260709 13:03:33.187249  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1541) took 1554 ms. Trace:
I20260709 13:03:33.187330  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 463) took 1591 ms. Trace:
I20260709 13:03:33.187642  8271 rpcz_store.cc:276] 0709 13:03:31.633288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.772490 (+139202us) service_pool.cc:224] Handling call
0709 13:03:31.772814 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.773122 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.773146 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.773586 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.087827 (+314241us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:32.087870 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.087939 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.185573 (+1097634us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:33.186940 (+  1367us) raft_consensus.cc:1685] finished
0709 13:03:33.186961 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.187176 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4481,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2120,"spinlock_wait_cycles":48746368,"thread_start_us":313949,"threads_started":1,"wal-append.queue_time_us":548479}
I20260709 13:03:33.138383 10084 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:33.139417  8121 rpcz_store.cc:276] 0709 13:03:31.850928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.851082 (+   154us) service_pool.cc:224] Handling call
0709 13:03:31.852352 (+  1270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.901666 (+ 49314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.901694 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.902012 (+   318us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.769016 (+867004us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:33.093406 (+324390us) log.cc:844] Serialized 14 byte log entry
0709 13:03:33.093701 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.093773 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.093813 (+    40us) raft_consensus.cc:1685] finished
0709 13:03:33.093824 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.094541 (+   717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55076,"prepare.queue_time_us":205531,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":50219,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":51093,"thread_start_us":1146151,"threads_started":2,"wal-append.queue_time_us":1035565}
I20260709 13:03:33.144246  9619 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:32.970391  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.003353  9889 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.170017  9915 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:33.170455  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:33.170699  9790 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.178714  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.179602  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1113) took 1330 ms. Trace:
I20260709 13:03:33.142159 10033 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.160534  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.164654  8125 rpcz_store.cc:276] 0709 13:03:31.881610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.881732 (+   122us) service_pool.cc:224] Handling call
0709 13:03:31.882078 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.888717 (+  6639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.888745 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.898106 (+  9361us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.648679 (+750573us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.876003 (+227324us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.906160 (+ 30157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.906233 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.146733 (+240500us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18002b4da0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b522 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:03:33.158475 (+ 11742us) raft_consensus.cc:1685] finished
0709 13:03:33.158567 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.158702 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34746,"prepare.queue_time_us":325645,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":70305,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":20962,"spinlock_wait_cycles":4290816,"thread_start_us":889197,"threads_started":2,"wal-append.queue_time_us":1033909}
I20260709 13:03:33.140465  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:33.196255  8807 rpcz_store.cc:276] 0709 13:03:32.174049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.418882 (+244833us) service_pool.cc:224] Handling call
0709 13:03:32.419216 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.650199 (+230983us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:32.650227 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.650265 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.650292 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.180726 (+530434us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54004493d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:33.180766 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.180873 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530728704}
I20260709 13:03:33.129760  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.198191  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:33.198776  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:33.181854  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:33.139189  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 72613.5us
I20260709 13:03:33.203922  8123 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:03:33.244010  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 73633.1us
I20260709 13:03:33.160005  9617 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.244056  8269 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:33.245800  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:33.246140  8267 rpcz_store.cc:276] 0709 13:03:31.849401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.198885 (+349484us) service_pool.cc:224] Handling call
0709 13:03:32.199191 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.274516 (+ 75325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.179394 (+904878us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400345b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:33.179551 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81657600}
I20260709 13:03:33.197768  8271 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:33.247692  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 485) took 1068 ms. Trace:
I20260709 13:03:33.290483  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:33.291237  8271 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:33.128932  8268 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:33.130738  8265 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:33.249740  8197 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:33.292811  8116 raft_consensus.cc:2368] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:33.292168  8120 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.291900  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:33.128901  8117 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.294361  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.294449  8266 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:33.288990  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:33.247375  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.296006  8269 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:33.081336  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:33.051445  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.297827  8269 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:33.295887  8266 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:33.289991  8273 raft_consensus.cc:606] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:33.292227  8267 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:33.302695  9920 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:33.303112  9920 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:33.303732  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 222469us
I20260709 13:03:33.303853  9920 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.304307  9786 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:33.288708  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:33.198387  9928 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:33.188439  9826 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:33.307255  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:33.308446  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:33.317051  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.308676  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:33.307008  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.310709  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.319995  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 160) took 1049 ms. Trace:
I20260709 13:03:33.311398  8122 raft_consensus.cc:2368] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:33.311739  8269 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:33.165138 10011 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:33.315476  8271 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:33.324643  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.319872  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:33.308362  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:33.325754  8272 raft_consensus.cc:2393] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:33.320375  8125 rpcz_store.cc:276] 0709 13:03:32.271051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.310492 (+1039441us) service_pool.cc:224] Handling call
0709 13:03:33.319923 (+  9431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.317010 10078 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:03:33.316612 10046 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.321848  8269 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 13:03:33.327251  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.328212  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.328504  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 157) took 1058 ms. Trace:
I20260709 13:03:33.333448  8124 rpcz_store.cc:276] 0709 13:03:32.270386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.311130 (+1040744us) service_pool.cc:224] Handling call
0709 13:03:33.328450 (+ 17320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.245476  9619 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:33.333448  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:33.335278  8237 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.792s (SENT)
I20260709 13:03:33.332540  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:33.333294  8121 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:33.338864  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 156) took 1068 ms. Trace:
I20260709 13:03:33.245607  9915 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:33.247934  9868 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:33.339221  8125 rpcz_store.cc:276] 0709 13:03:32.270157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.332312 (+1062155us) service_pool.cc:224] Handling call
0709 13:03:33.338810 (+  6498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.341588  8125 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:33.342132  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 163) took 1070 ms. Trace:
I20260709 13:03:33.342638  8125 rpcz_store.cc:276] 0709 13:03:32.271704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.341132 (+1069428us) service_pool.cc:224] Handling call
0709 13:03:33.341424 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.341918 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.342082 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.345494  8267 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:33.346431  8120 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:33.353163  9790 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.353622 10019 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:33.353714  9790 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.317641  9819 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:33.346398  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 162) took 1074 ms. Trace:
I20260709 13:03:33.357676  8121 rpcz_store.cc:276] 0709 13:03:32.271484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.338239 (+1066755us) service_pool.cc:224] Handling call
0709 13:03:33.345964 (+  7725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.346119 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.346144 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.346182 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:33.346211 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.346256 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.346346 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.327764 10033 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:33.310178  9936 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:33.360726  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:33.364696  8117 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
W20260709 13:03:33.367439  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.354501  8265 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:33.338333 10010 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.322568  9862 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:33.382195  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:33.355206  9920 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.337793  9798 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:33.288236  9730 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.338423  9694 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:33.331756  9786 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:33.339177  9619 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.400377  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:33.361203  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.244529 10002 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.344585 10046 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.382985 10033 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:33.328043  9826 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.449942  8197 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:33.397045 10078 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.440570  9694 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.452000  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:33.432515  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 124143us
I20260709 13:03:33.327924 10045 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:33.380174  9868 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:33.405395  9921 raft_consensus.cc:2764] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:33.444118 10034 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.380868  9851 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:03:33.492393  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:33.396795  9807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.012s	sys 0.042s
I20260709 13:03:33.478675  8192 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:33.405581  9862 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.477995  9472 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:03:33.406507 10010 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.475039 10033 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.464617  9995 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:33.776911  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 637311us
I20260709 13:03:33.471110 10003 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:33.620373  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.697242  8191 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:03:33.591609  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 273576us
W20260709 13:03:33.560942  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 230413us
W20260709 13:03:33.799180  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 306833us
I20260709 13:03:33.799662  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:33.503305  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:33.528697  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 196271us
W20260709 13:03:33.778981  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 305107us
I20260709 13:03:33.708305  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.801307  8196 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:33.648031 10095 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:03:33.768920 10099 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
W20260709 13:03:33.647357 10097 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:03:33.772039 10103 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
W20260709 13:03:33.680814 10047 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:03:33.728137 10098 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:03:33.193629  8802 rpcz_store.cc:276] 0709 13:03:31.595861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.030298 (+434437us) service_pool.cc:224] Handling call
0709 13:03:32.030620 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:32.030989 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.031021 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.031500 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.809410 (+777910us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:33.131527 (+322117us) log.cc:844] Serialized 14 byte log entry
0709 13:03:33.186898 (+ 55371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.187048 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.187117 (+    69us) raft_consensus.cc:1685] finished
0709 13:03:33.187134 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.187272 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":146925,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":22,"raft.queue_time_us":9828,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":19646,"thread_start_us":1061505,"threads_started":2,"wal-append.queue_time_us":883612}
I20260709 13:03:33.469494  9730 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:33.803301  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:33.800706  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:33.760900  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.802285  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.824070  8196 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.800698  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:33.497910  9694 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.503191  9928 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:33.805552  9787 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.648501  9857 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:33.479965 10028 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.318s
I20260709 13:03:33.782094  9617 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:33.720558  9797 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.000s
I20260709 13:03:33.844430 10028 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.844130  9797 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.844920 10028 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.804982  9921 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:03:33.848771  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.849617  8197 raft_consensus.cc:2410] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:33.787487  9995 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.568276 10078 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.252s
I20260709 13:03:33.832186  8196 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:33.863412  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.864009  8196 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.815294  9936 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.818372  9841 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:33.536521  9838 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.284s
I20260709 13:03:33.474931  9915 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.865636  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.650697  9786 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.828128  9819 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:33.870631  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.648315  9868 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.850270 10034 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.873167  8196 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:33.889230  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.886495  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.848285  9928 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:33.895542  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.897192  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.893471  8197 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:33.898011 10113 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:03:33.872614  9936 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.833184  9730 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:03:33.909686 10010 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:33.910084  9730 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:33.841831  9930 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:03:33.901556  9838 consensus_queue.cc:1243] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:03:33.904098 10074 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.835s	user 0.000s	sys 0.003s
I20260709 13:03:33.906522  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.871219  8195 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:33.908604  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.867273  9995 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.861444  9857 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:33.926157  9915 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.926712  9857 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.897289  9928 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.928766  9857 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.890666 10002 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.928974  9975 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.929675  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:33.930225  9851 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:03:33.696803  9889 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:33.871066  9841 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:33.931980  9920 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:33.910553  9730 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.850054  9787 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:33.923513  8123 raft_consensus.cc:2410] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:33.923885  8200 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.918588  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.936362  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.922185  9839 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:03:33.907832 10034 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:33.922664  9862 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.941911 10111 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:33.942754  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1121) took 1306 ms. Trace:
I20260709 13:03:33.982942  8270 rpcz_store.cc:276] 0709 13:03:32.635880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.647405 (+ 11525us) service_pool.cc:224] Handling call
0709 13:03:33.929534 (+1282129us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b58000f5d98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:33.942686 (+ 13152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7057792}
I20260709 13:03:33.932701  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:33.915081 10028 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:33.938694  9975 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:33.986393  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.993937  8197 raft_consensus.cc:2410] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:33.939669  9857 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:33.992051  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:33.942742  9936 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:33.958024  9841 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:33.995978  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.044s
I20260709 13:03:33.959642  9920 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:33.979199 10034 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.005043  8200 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:34.017372  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.007s	sys 0.044s
W20260709 13:03:34.028708  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 539321us
I20260709 13:03:33.981055 10000 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.029135  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:33.982879 10111 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:34.032511  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:34.033121  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:34.033293  8200 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:33.996062  9975 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.032289 10000 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:34.042801 10000 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:34.045290 10000 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.049860  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:34.051146  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:34.058446  9787 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:33.289713  8811 rpcz_store.cc:276] 0709 13:03:32.178794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.455348 (+276554us) service_pool.cc:224] Handling call
0709 13:03:32.456747 (+  1399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.456938 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:32.843621 (+386683us) log.cc:844] Serialized 14 byte log entry
0709 13:03:33.247356 (+403735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.247406 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:33.247461 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.247525 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.247636 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499276,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":68,"thread_start_us":789735,"threads_started":2}
I20260709 13:03:34.060856  9975 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:33.999512 10109 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.063443  9975 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:34.032228  9936 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:34.068528 10052 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:34.080475  8125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.030s	sys 0.015s
W20260709 13:03:34.070756  9619 consensus_meta.cc:287] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.003s
I20260709 13:03:34.011164  9857 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:34.082393  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 249365us
I20260709 13:03:34.091544  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.049111  9694 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.093724  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.094596  8266 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:34.081224  8195 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:33.990163  9819 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.099699  8266 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:34.106721  8266 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:34.108412  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1112) took 1119 ms. Trace:
I20260709 13:03:34.109503  8266 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:34.087229  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 284921us
I20260709 13:03:34.082836  9936 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:34.088341  8125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.030s	sys 0.015s
I20260709 13:03:34.081897 10052 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:34.108778  8193 rpcz_store.cc:276] 0709 13:03:32.989202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.992569 (+  3367us) service_pool.cc:224] Handling call
0709 13:03:32.992831 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.993009 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:33.362064 (+369055us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.108107 (+746043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:34.108155 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:34.108193 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.108264 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.108361 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23691,"prepare.queue_time_us":484705,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":119475,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":22131,"thread_start_us":1054454,"threads_started":3,"wal-append.queue_time_us":580361}
W20260709 13:03:34.110190  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 309535us
I20260709 13:03:34.080570  9920 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.112598 10112 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:34.084013  8117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.026s
I20260709 13:03:34.086071 10111 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.099756  9730 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.094271  9619 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:34.086503  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 298307us
I20260709 13:03:34.111783  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:34.578089  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 466346us
W20260709 13:03:34.578743  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 152223us
I20260709 13:03:34.578926  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:34.428480  9936 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.579072  9868 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:34.423882  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.186118  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.582430  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.584156 10131 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:34.584281 10135 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.584671 10131 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.584793 10135 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.586787 10135 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.586948 10131 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.145666  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:34.291455  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.137852  9941 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.315s
I20260709 13:03:34.587707  8191 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:34.467798  8196 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:34.113714  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:34.519964 10050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.001s	sys 0.035s
I20260709 13:03:34.588265 10134 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:34.430547  9619 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.469213  9838 raft_consensus.cc:3055] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:34.588617 10050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.002s	sys 0.037s
I20260709 13:03:34.588815  9838 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:34.589103  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:34.589756  8266 raft_consensus.cc:606] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.590108  8266 raft_consensus.cc:614] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:34.589612  9838 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:34.589157  8191 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:34.590909  9838 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.588630 10134 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:34.593303 10134 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.594430 10134 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.584298  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:34.439250  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1110) took 1451 ms. Trace:
I20260709 13:03:34.540040  8019 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:34.502010  8090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.021s	sys 0.018s
I20260709 13:03:34.146922  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1570) took 1278 ms. Trace:
I20260709 13:03:34.507225  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 164) took 2235 ms. Trace:
I20260709 13:03:34.580096  8163 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:34.116955  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.130509  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:34.418174  8199 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:34.427719  8238 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:34.664505  9838 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:34.665419  9838 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:34.613665  8266 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:34.666013  9838 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.667761  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
W20260709 13:03:34.451066  8122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 169) took 2144 ms (client timeout 1669 ms). Trace:
I20260709 13:03:34.413934  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:34.501760  9786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.014s	sys 0.023s
W20260709 13:03:34.548981  8091 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.031s	sys 0.051s
I20260709 13:03:34.209602  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1126) took 1080 ms. Trace:
W20260709 13:03:34.675302  9786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.014s	sys 0.027s
I20260709 13:03:34.152184  8198 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:34.138736  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:34.142917  8117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.026s
W20260709 13:03:34.501416  8118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.015s	sys 0.024s
I20260709 13:03:34.163516  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.189844  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.149232  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1130) took 1099 ms. Trace:
I20260709 13:03:34.680720  9941 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:34.681851  8267 rpcz_store.cc:276] 0709 13:03:33.050169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.312878 (+262709us) service_pool.cc:224] Handling call
0709 13:03:33.313210 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.345957 (+ 32747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.149011 (+803054us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400345dd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:34.149176 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56042240}
I20260709 13:03:34.140224  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.173084  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.427152  8270 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:34.136190  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.684427  8269 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.684461  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1127) took 1554 ms. Trace:
I20260709 13:03:34.172477  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:34.425559 10033 consensus_meta.cc:287] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.611s	user 0.014s	sys 0.000s
I20260709 13:03:34.685050  8198 rpcz_store.cc:276] 0709 13:03:33.130048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.151653 (+1021605us) service_pool.cc:224] Handling call
0709 13:03:34.152002 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.683936 (+531934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.684275 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:34.686199  9619 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.686316 10033 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.141381 10052 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:34.131352  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:34.245813  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.444993  8021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 244) took 7858 ms. Trace:
I20260709 13:03:34.468390 10112 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:34.697441 10112 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.178529 10111 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.580175 10115 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:34.150146 10116 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:34.139053 10118 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.236s
I20260709 13:03:34.179224  9797 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.141598  9841 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:34.119846  9918 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.002s	sys 0.012s
W20260709 13:03:34.711066  9918 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.009s	sys 0.014s
I20260709 13:03:34.135335  9920 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.711184  8197 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:34.191418  9979 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:34.663009  8125 rpcz_store.cc:276] 0709 13:03:32.272079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.343428 (+1071349us) service_pool.cc:224] Handling call
0709 13:03:33.343859 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.361676 (+ 17817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.361706 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.381192 (+ 19486us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.129980 (+748788us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:34.177726 (+ 47746us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b48000801d8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
0709 13:03:34.506638 (+328912us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.506850 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.506919 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.506955 (+    36us) raft_consensus.cc:1685] finished
0709 13:03:34.507034 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.507164 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17330,"prepare.queue_time_us":328276,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":19963,"raft.run_cpu_time_us":2305,"raft.run_wall_time_us":812008,"spinlock_wait_cycles":9749888,"thread_start_us":1035249,"threads_started":2,"wal-append.queue_time_us":1013133}
I20260709 13:03:34.713454  9979 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:34.203564  9995 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.715411  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.138770 10000 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.314s
W20260709 13:03:34.576646 10002 consensus_meta.cc:287] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
W20260709 13:03:34.160310 10123 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:03:34.722748  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 142620us
I20260709 13:03:34.707139  8019 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:34.150703 10120 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:03:34.166008 10119 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 13:03:34.575378 10034 consensus_meta.cc:287] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:03:34.150164 10045 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.452654 10079 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:34.151217 10046 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.185635  9857 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.415122  9787 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.735350  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 161) took 2464 ms. Trace:
I20260709 13:03:34.735002  9787 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.192550  9826 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.600718  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:34.656595  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 72234.2us
I20260709 13:03:34.735764  8124 rpcz_store.cc:276] 0709 13:03:32.271273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.334144 (+1062871us) service_pool.cc:224] Handling call
0709 13:03:33.339581 (+  5437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.339802 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.339827 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.345257 (+  5430us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.819588 (+474331us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:34.107263 (+287675us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.107461 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.107525 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.734881 (+627356us) raft_consensus.cc:1685] finished
0709 13:03:34.734916 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.735175 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":602062,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":3299,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":15605,"thread_start_us":691817,"threads_started":2,"wal-append.queue_time_us":679072}
I20260709 13:03:34.738314  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:34.660688  8090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.021s	sys 0.021s
W20260709 13:03:34.668115  8199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1122) took 1540 ms (client timeout 1711 ms). Trace:
I20260709 13:03:34.425055  9694 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:34.665910  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 238119us
W20260709 13:03:34.668902  8122 rpcz_store.cc:269] 0709 13:03:32.306706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.449852 (+143146us) service_pool.cc:224] Handling call
0709 13:03:34.450857 (+2001005us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54000e2254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:34.450985 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808672000}
I20260709 13:03:34.672811  9936 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:34.743063  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.668816  8266 raft_consensus.cc:606] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.744283  9868 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:34.745199  8266 raft_consensus.cc:614] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:34.673511  8273 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.744728  9936 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:34.744767  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 613343us
I20260709 13:03:34.745609  9868 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.747740  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.749787  8270 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.683331  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1556) took 2151 ms. Trace:
I20260709 13:03:34.653913  8192 rpcz_store.cc:276] 0709 13:03:32.988311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.989848 (+  1537us) service_pool.cc:224] Handling call
0709 13:03:33.094525 (+104677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.801515 (+706990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.438965 (+637450us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540035cad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:34.439189 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695035776}
W20260709 13:03:34.680549  8118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.018s	sys 0.025s
I20260709 13:03:34.750201  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.752545  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1559) took 2176 ms. Trace:
W20260709 13:03:34.751518  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 150770us
I20260709 13:03:34.685130  8119 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:34.675861  8195 rpcz_store.cc:276] 0709 13:03:33.129491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.052960 (+923469us) service_pool.cc:224] Handling call
0709 13:03:34.053239 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.097647 (+ 44408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.209524 (+111877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:34.753994  8775 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.752688  8122 raft_consensus.cc:2410] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:34.754220  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.754319  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:34.755604  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.756367  9826 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:34.720163 10000 consensus_queue.cc:1243] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:34.694303  9619 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.724479  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 158) took 2453 ms. Trace:
W20260709 13:03:34.156390 10122 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:03:34.725502  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:34.725903  8194 raft_consensus.cc:2410] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:34.696195  8021 rpcz_store.cc:276] 0709 13:03:26.587046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.591868 (+  4822us) service_pool.cc:224] Handling call
0709 13:03:27.343863 (+751995us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540006bb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c92090 00007fbd24d30f3a 00007fbd2aae71cc 00007fbd2abe537e 00007fbd290a62a4 00007fbd290a6232 00007fbd290a6161 00007fbd290a60dc 00007fbd290a5392 00007fbd2306348c 00007fbd230628c6
0709 13:03:34.444926 (+7101063us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:30.805393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:30.823689 (+ 18296us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:30.823726 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:03:30.823740 (+    14us) tablet.cc:662] Decoding operations
0709 13:03:30.927839 (+104099us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:30.927900 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:30.927937 (+    37us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:03:30.929082 (+  1145us) tablet.cc:701] Row locks acquired
0709 13:03:30.929096 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:03:30.929273 (+   177us) write_op.cc:270] Start()
0709 13:03:30.929474 (+   201us) write_op.cc:276] Timestamp: P: 1783602210929215 usec, L: 0
0709 13:03:30.929499 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:03:30.930147 (+   648us) log.cc:844] Serialized 5187 byte log entry
0709 13:03:31.898658 (+968511us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:32.965522 (+1066864us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.633575 (+668053us) write_op.cc:301] APPLY: starting
0709 13:03:33.649476 (+ 15901us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.728630 (+ 79154us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.728655 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.756440 (+ 27785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.756682 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:03:33.756733 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:33.757062 (+   329us) log.cc:844] Serialized 95 byte log entry
0709 13:03:33.766514 (+  9452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.766667 (+   153us) write_op.cc:454] Released schema lock
0709 13:03:33.766719 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.767086 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.767111 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":411458,"reported_tablets":22,"spinlock_wait_cycles":343563008,"child_traces":[["op",{"apply.queue_time_us":597318,"apply.run_cpu_time_us":3676,"apply.run_wall_time_us":171499,"num_ops":13,"prepare.queue_time_us":803338,"prepare.run_cpu_time_us":33880,"prepare.run_wall_time_us":230807,"raft.queue_time_us":883406,"raft.run_cpu_time_us":33168,"raft.run_wall_time_us":401021,"replication_time_us":1995511,"spinlock_wait_cycles":6215424,"thread_start_us":1657745,"threads_started":4,"wal-append.queue_time_us":185434}]]}
I20260709 13:03:34.732688 10034 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.732736 10079 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:34.722523  9941 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:34.658902  8123 rpcz_store.cc:276] 0709 13:03:32.869016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.333234 (+464218us) service_pool.cc:224] Handling call
0709 13:03:34.146704 (+813470us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54000e3dd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:34.146861 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353114368}
I20260709 13:03:34.747356  9936 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:03:34.675453  8091 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.034s	sys 0.052s
W20260709 13:03:34.764448  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 720539us
I20260709 13:03:34.755429  8238 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:34.756142  8019 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.756902  9826 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:34.722218  8274 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:34.783397  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.755430  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.784340 10052 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.784909  9619 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.787920  9619 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.788626  9841 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.789310  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.790344  8119 raft_consensus.cc:2410] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:34.791213  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.792362  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.794173 10040 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:34.794684 10040 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:34.795054 10040 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.796177 10000 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.796765  9694 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.797854  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.798416  9786 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:34.799013  9786 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:34.799500  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.800203  9969 raft_consensus.cc:993] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:03:34.800408  9786 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.801924  9941 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:34.802340  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:34.742012  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:34.742255  8199 rpcz_store.cc:269] 0709 13:03:33.127867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.160014 (+ 32147us) service_pool.cc:224] Handling call
0709 13:03:34.667756 (+1507742us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540021b954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:34.667921 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588264704}
I20260709 13:03:34.752903  8118 rpcz_store.cc:276] 0709 13:03:32.577120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.847775 (+1270655us) service_pool.cc:224] Handling call
0709 13:03:33.848117 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.848311 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.848334 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.848757 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.752062 (+903305us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:34.752145 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.752242 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.752290 (+    48us) raft_consensus.cc:1685] finished
0709 13:03:34.752303 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.752465 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":902799,"threads_started":1,"wal-append.queue_time_us":650326}
I20260709 13:03:34.773777  8777 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.804580  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.805425  8118 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:34.750262  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.757613  8116 rpcz_store.cc:276] 0709 13:03:32.270605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.333329 (+1062724us) service_pool.cc:224] Handling call
0709 13:03:33.349781 (+ 16452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.361478 (+ 11697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.361520 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.383729 (+ 22209us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.871894 (+488165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:34.414959 (+543065us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.415394 (+   435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.415477 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.723989 (+308512us) raft_consensus.cc:1685] finished
0709 13:03:34.724027 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.724279 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11249,"prepare.queue_time_us":549994,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":11650,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":29793,"thread_start_us":836778,"threads_started":2,"wal-append.queue_time_us":674065}
W20260709 13:03:34.774021  8194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1103) took 1809 ms (client timeout 1654 ms). Trace:
I20260709 13:03:34.774343 10079 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.807317 10138 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:34.773921  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1555) took 2252 ms. Trace:
I20260709 13:03:34.807603 10079 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.779247  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:03:34.806417  8194 rpcz_store.cc:269] 0709 13:03:32.964347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.970160 (+  5813us) service_pool.cc:224] Handling call
0709 13:03:34.773752 (+1803592us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002062d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:34.773956 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3403238144}
W20260709 13:03:34.808480  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58407.9us
I20260709 13:03:34.715467  9979 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.810670  9979 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.807909  9786 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.807927  8121 rpcz_store.cc:276] 0709 13:03:32.522539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.358788 (+836249us) service_pool.cc:224] Handling call
0709 13:03:33.366832 (+  8044us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:33.367304 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.367332 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:33.396311 (+ 28979us) log.cc:844] Serialized 52 byte log entry
0709 13:03:33.872167 (+475856us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:34.155575 (+283408us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:34.431168 (+275593us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.431852 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.431948 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.457993 (+ 26045us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b18002ac5e0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:03:34.773488 (+315495us) raft_consensus.cc:1685] finished
0709 13:03:34.773524 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.773735 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52576,"prepare.queue_time_us":549929,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":410,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":16875,"spinlock_wait_cycles":17609344,"thread_start_us":804353,"threads_started":2,"wal-append.queue_time_us":632564}
I20260709 13:03:34.776511  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.779176  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1544) took 2471 ms. Trace:
I20260709 13:03:34.779107  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.745719  9857 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:34.750805  8117 rpcz_store.cc:276] 0709 13:03:32.531874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.368307 (+836433us) service_pool.cc:224] Handling call
0709 13:03:33.368604 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:33.369814 (+  1210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.369845 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:33.396880 (+ 27035us) log.cc:844] Serialized 52 byte log entry
0709 13:03:34.142996 (+746116us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b48000801d8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
0709 13:03:34.682439 (+539443us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:34.682529 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.682635 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.682697 (+    62us) raft_consensus.cc:1685] finished
0709 13:03:34.682708 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.683074 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12266,"raft.run_cpu_time_us":3833,"raft.run_wall_time_us":746738,"spinlock_wait_cycles":5193600,"thread_start_us":1208384,"threads_started":1,"wal-append.queue_time_us":983280}
I20260709 13:03:34.779934  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.813935  9969 raft_consensus.cc:1081] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:03:34.780267  9995 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.780573  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.780822 10118 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.815469  8268 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.815709 10033 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.782521  8267 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:34.775332  9472 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:34.783907  9826 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.739106  9787 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:34.805837  9819 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:34.782688 10034 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:34.813804  8123 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.801048  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.818836  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.819432  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.826915  8269 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:34.813606  8120 rpcz_store.cc:276] 0709 13:03:32.307477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.347128 (+1039651us) service_pool.cc:224] Handling call
0709 13:03:33.347413 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.347618 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.347640 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.348303 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.822560 (+474257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:33.832382 (+  9822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.832470 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.778670 (+946200us) raft_consensus.cc:1685] finished
0709 13:03:34.778710 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.778979 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":466045,"threads_started":1,"wal-append.queue_time_us":733407}
I20260709 13:03:34.813472 10069 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:34.831342 10155 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:03:34.831285  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 105984us
I20260709 13:03:34.830003  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.815060  9857 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:34.833896  8273 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:34.820317  9472 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:34.837066 10000 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:34.832525 10069 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.803117  9941 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.844066 10069 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.847865  9472 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.849428  9472 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.850714 10115 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.851473 10134 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:34.852706  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.840554  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.856729  8267 raft_consensus.cc:2393] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:34.857769  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:34.861734 10046 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:34.843005 10033 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.865063  8268 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:34.866850  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:34.867589  8268 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:34.867865  9619 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:34.869374  9619 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:34.870168  9619 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:34.872222  9619 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:34.872577  9619 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:34.873457  9841 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:34.873839  9841 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:34.874828  9841 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.836362  9857 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.876837  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.884166  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.876574  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:34.876227  9841 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:34.890317  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 54113.5us
I20260709 13:03:34.891312  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1561) took 2266 ms. Trace:
I20260709 13:03:34.895324  8123 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
W20260709 13:03:34.896808  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 155050us
I20260709 13:03:34.898495  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.895805  8119 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:34.891772  8118 rpcz_store.cc:276] 0709 13:03:32.621602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.806062 (+2184460us) service_pool.cc:224] Handling call
0709 13:03:34.816857 (+ 10795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.853288 (+ 36431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.853319 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.855956 (+  2637us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.886082 (+ 30126us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:34.886127 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.886210 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.887789 (+  1579us) raft_consensus.cc:1685] finished
0709 13:03:34.887808 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.888201 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4587,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":280,"spinlock_wait_cycles":16128,"thread_start_us":29624,"threads_started":1,"wal-append.queue_time_us":29974}
I20260709 13:03:34.904095  8163 leader_election.cc:400] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:34.842379  8019 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 3, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 3 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:34.904304  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.904845  8125 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:34.907617  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 153857us
I20260709 13:03:34.910318  8122 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:34.913985  8088 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.569s (SENT)
I20260709 13:03:34.914465  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.914901 10052 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:34.916489  8269 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:34.916846 10000 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.918906  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:34.919631  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:34.920202  8163 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:34.921648 10111 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:34.922389 10111 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:34.922861  8019 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.923935 10115 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:34.924373 10115 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:34.924249  9838 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.924787 10115 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.926719  8774 leader_election.cc:400] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 2 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3.
I20260709 13:03:34.929632  9619 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:34.931917  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.932665  9619 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.934404  9868 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.934742  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:34.921479 10128 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:34.944377  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.943687  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.946085  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.950278  8121 raft_consensus.cc:2410] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:34.951143  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.950654  8019 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.951864  8121 raft_consensus.cc:2410] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:34.952602  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.952191  8019 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.953714  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:34.955417  8163 leader_election.cc:400] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:34.955681  8163 leader_election.cc:403] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.957310  8117 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:34.958107 10046 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:34.958846 10046 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:34.959477 10046 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:34.959756  9838 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:34.960656 10137 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:34.961462  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:34.962277  8269 raft_consensus.cc:2368] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:34.963171  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:34.964039  8811 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:34.965755 10040 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:34.967021  8272 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:34.958280  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.953156  8121 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.965914  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.964931  8122 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:34.972788  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.976049  8119 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.981549  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.977995  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.982585  8122 raft_consensus.cc:2410] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:34.983767  8166 leader_election.cc:400] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:34.984125  8166 leader_election.cc:403] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.984251  8270 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:34.990909  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:34.993064  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.993134  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.968297  9920 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:34.995734  9619 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.000653  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:35.001526  8123 raft_consensus.cc:2376] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5. Re-sending same reply.
I20260709 13:03:35.002851  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.003641  8123 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.003515  9857 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:34.996194  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:34.990561  8019 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.015270  8116 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:35.016170  8019 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:35.005264  8265 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:35.018203  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:34.997802  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:35.004860  8122 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.004866  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:35.009058  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.021323  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.016162  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1564) took 2340 ms. Trace:
I20260709 13:03:35.022169  8123 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:35.022462  8116 rpcz_store.cc:276] 0709 13:03:32.675724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.806520 (+2130796us) service_pool.cc:224] Handling call
0709 13:03:35.014546 (+208026us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:35.014929 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.015787 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.016076 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8635136}
I20260709 13:03:35.019541  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.005071  8237 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.024775  8118 raft_consensus.cc:2410] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:35.025792  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.026814  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.027091  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.027544  9920 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:35.028419  8088 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 2.137s (SENT)
I20260709 13:03:35.028585  9920 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.029592  8117 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.030089  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:35.031039  8117 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:03:35.031419  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 74740.6us
I20260709 13:03:35.031744  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1565) took 2296 ms. Trace:
I20260709 13:03:35.032094  8117 rpcz_store.cc:276] 0709 13:03:32.734897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.030398 (+2295501us) service_pool.cc:224] Handling call
0709 13:03:35.030774 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.031427 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.031678 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:35.028007 10052 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.028875  8088 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.017119  9857 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.010314  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1560) took 2402 ms. Trace:
I20260709 13:03:35.027907  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.019057  8019 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:03:35.038923  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.035413  8117 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:35.040442  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 43616.6us
I20260709 13:03:35.038857  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.040829  8122 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:35.043148  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:35.050559  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64139.1us
I20260709 13:03:35.052011  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.053823  8118 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:35.039510  8124 rpcz_store.cc:276] 0709 13:03:32.607576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.738394 (+2130818us) service_pool.cc:224] Handling call
0709 13:03:34.758438 (+ 20044us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:34.781776 (+ 23338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.781806 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:34.783088 (+  1282us) log.cc:844] Serialized 582 byte log entry
0709 13:03:34.877201 (+ 94113us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:34.877243 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.877308 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.943726 (+ 66418us) raft_consensus.cc:1685] finished
0709 13:03:34.943744 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.010045 (+ 66301us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54000b09d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:35.010235 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4740,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"spinlock_wait_cycles":44486912,"thread_start_us":93698,"threads_started":1,"wal-append.queue_time_us":158481}
I20260709 13:03:35.055920  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1577) took 2025 ms. Trace:
I20260709 13:03:35.056308  8117 rpcz_store.cc:276] 0709 13:03:33.021891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.032842 (+2010951us) service_pool.cc:224] Handling call
0709 13:03:35.033142 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.042242 (+  9100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.046850 (+  4608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:35.057660  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:35.055298  8811 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:35.035621 10052 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:35.067181  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:35.070824  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.075042  8123 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:35.102852  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.066234  9826 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.135566  9826 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.137622  9826 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:35.138475  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:35.140758  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 112374us
W20260709 13:03:35.142069  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.068464 10052 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:35.104646  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 171) took 1075 ms. Trace:
W20260709 13:03:35.147750  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 119951us
I20260709 13:03:35.106081 10019 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:35.106216  8811 raft_consensus.cc:2410] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:35.066462  9786 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:03:35.100314  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.109472  9790 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.113327 10134 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:35.113924  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54213.4us
I20260709 13:03:35.114662  9857 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.116757  8196 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:35.120261  8116 raft_consensus.cc:2410] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:35.120676  8198 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:35.121768  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.122316  9819 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:35.124368  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.125295  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.118330  8197 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:35.127751 10163 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:35.130589  9920 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.130878 10069 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.132622 10112 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:35.134279  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 91213.3us
I20260709 13:03:35.134908  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.101995  8123 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:35.072942  9694 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:35.147171  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.098814 10130 raft_consensus.cc:2764] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:35.147722  8125 rpcz_store.cc:276] 0709 13:03:34.029925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.041418 (+1011493us) service_pool.cc:224] Handling call
0709 13:03:35.064582 (+ 23164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.104314 (+ 39732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.104344 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.104387 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:35.104417 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.104475 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.104591 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:35.164428  8120 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.147456  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.148344 10052 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.183905  8807 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:03:35.170845  8163 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.179872  8125 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:35.175622  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.220472  8123 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:35.198324  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.231882  8123 pending_rounds.cc:85] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 1
I20260709 13:03:35.194818  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.235383  8119 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.205821  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.238231  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:35.241919  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.166193 10019 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:35.241598  8200 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:35.245849  8121 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.196549  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.197598  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.195264  8811 pending_rounds.cc:85] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 6
I20260709 13:03:35.261919  8198 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.209939  8192 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:35.268038  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.201050  9790 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.274287  9694 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:35.183751 10134 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.274945  9694 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:35.274210  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.276314  9694 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.211647 10052 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.265652  8267 raft_consensus.cc:1217] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-4.6]   Dedup: 3.5->[4.6-4.6]
I20260709 13:03:35.270027  8806 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:35.278926  8267 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 13:03:35.279742  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.280665  8806 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:35.280855  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.279770  8268 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:35.271872  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 73676.6us
I20260709 13:03:35.267753  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.283187  8197 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:35.283315  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:35.283612  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.284106  8197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50482
I20260709 13:03:35.284680  8197 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.284767  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:35.285286 10040 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:35.285542 10000 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.286168 10000 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:35.286487 10000 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.286777 10000 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.262185  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.287691  8807 raft_consensus.cc:2410] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:35.288496  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.288508  9918 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:35.289335  9918 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:35.283190  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.278404  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.199857  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.232295  8123 pending_rounds.cc:107] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:35.290514  8123 raft_consensus.cc:2889] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.197832  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:35.290689  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 59976.4us
I20260709 13:03:35.269901  8811 pending_rounds.cc:107] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:03:35.273536  9841 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:35.282528  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 87790.3us
I20260709 13:03:35.293447  8806 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:35.267217  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.291195  8197 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.289557  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:35.296657  8803 raft_consensus.cc:2410] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:35.297374  8809 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:35.297870  8810 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:35.291424  8811 raft_consensus.cc:2889] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.298959  8191 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.216821 10046 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.210112  9928 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:35.303540  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.307971  9928 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.308310  8091 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.309829  9787 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.286883 10112 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.313580 10079 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:35.314469 10079 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:35.315913  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.316557  9995 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:35.316753  8810 raft_consensus.cc:2410] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:35.316983  9995 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:35.317363  9995 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.317893  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:35.318624  8810 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.295182 10134 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.319798  9918 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.321930  9619 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4.
I20260709 13:03:35.307868  9857 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.323002 10130 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.323081  9857 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:35.294384 10115 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.324131  9857 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.325733  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:35.321817  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54678.4us
I20260709 13:03:35.326328 10115 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:35.327180  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.328158  8195 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:35.328336  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.330318  9826 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:35.330410 10040 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:35.330886 10040 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.331269 10040 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.209569 10129 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.199333  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:35.198747  8808 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:35.324012  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:35.347630  8267 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.348038  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.351501  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:35.321254  9918 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.190980  8194 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:35.198977 10137 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:03:35.308591  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.344561  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.364113  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.315735 10079 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.308146  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:35.357069  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:35.330819  9826 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:35.337723  8199 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:35.393187  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.373519 10115 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.414733  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:35.423362  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 91395.2us
I20260709 13:03:35.426486  8807 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.428305  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.428311  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 172) took 1397 ms. Trace:
I20260709 13:03:35.434137  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.430251  8197 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:35.436477  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.439118  8807 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:35.344183 10046 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:35.439288  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.446813  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.446982  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.447721  8808 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:35.448712  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:35.452059  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 88035.2us
I20260709 13:03:35.443707  8809 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:35.455284  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:35.456418  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 108451us
I20260709 13:03:35.435020  8122 rpcz_store.cc:276] 0709 13:03:34.030888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.046204 (+1015316us) service_pool.cc:224] Handling call
0709 13:03:35.069771 (+ 23567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.158674 (+ 88903us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:35.184247 (+ 25573us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.428012 (+243765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.428073 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:35.428108 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.428164 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.428260 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59564,"prepare.queue_time_us":23381,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":53542,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3752,"thread_start_us":197926,"threads_started":1}
I20260709 13:03:35.431939 10130 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:35.351686 10129 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.475000  8197 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.438683  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:35.479140  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:35.483995  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.465909  9838 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.465781  9941 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:03:35.486096  9936 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:35.486523  9941 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:35.486922  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:35.487509  9786 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.492266  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.493485  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.494719  8199 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:35.500741  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62050.7us
I20260709 13:03:35.486693  9936 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.550783  8198 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
W20260709 13:03:35.556726 10191 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:03:35.557827 10172 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:03:35.561805 10186 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:35.562139 10129 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.562481 10178 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.563293 10186 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.565860 10186 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:35.568902  8809 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:35.573681  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:35.590590  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 123484us
I20260709 13:03:35.488210 10046 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:35.590437  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 88708.5us
I20260709 13:03:35.614308  8200 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:35.610085  8191 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
W20260709 13:03:35.611665  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 111207us
I20260709 13:03:35.611694  8193 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:35.552846  9941 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:35.551925 10069 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:35.620189  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.563349  9786 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:35.630800  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:35.639459  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.440442 10019 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:35.617238 10163 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:35.650484  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:35.655784  8200 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:35.657775  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:35.659214  8088 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.661957  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:35.665149  9920 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:35.665586  9920 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:35.666488  9920 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.667472  9920 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.669868  8266 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:35.670527  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:35.640419 10052 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:35.677963  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.641013  9786 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:35.656213  8200 pending_rounds.cc:85] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 1
I20260709 13:03:35.681963  8272 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:35.688333  8200 pending_rounds.cc:107] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:35.686022  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:35.686538  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.688647  8200 raft_consensus.cc:2889] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.690698  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:35.689112  8274 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:35.693338  8810 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:35.702437  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.703213  8191 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
W20260709 13:03:35.705744  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54965us
I20260709 13:03:35.707594  8118 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.706061  8197 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:35.616947  9826 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.712275  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:35.715530  8267 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:35.688300  9786 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.716975  9941 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.718075  9941 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.654299  8265 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:35.719153  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.727032  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:35.729277 10197 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:35.729947 10197 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.735944  9995 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:35.723754  9936 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:35.738847  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 47680.1us
I20260709 13:03:35.739612  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.711925 10186 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:35.710050  9619 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:35.748497  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.749236  8200 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:35.747871  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:35.722772 10178 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:35.687285 10176 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:03:35.766867  8198 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:35.767820  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.767307  8199 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:03:35.768507  8199 pending_rounds.cc:85] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:03:35.747596 10186 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.753827 10128 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:35.782392  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 62744.4us
I20260709 13:03:35.756135  9928 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.780145 10193 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:35.782569  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.780606 10187 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:35.758837 10130 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.758472  9619 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:35.766829 10178 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.760593 10115 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:35.718672 10000 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.791750  8199 pending_rounds.cc:107] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:03:35.732322 10197 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:35.810007  9928 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:35.822279  9928 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:35.823237  9928 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.810527 10193 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.812110  9995 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.769553  8805 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
W20260709 13:03:35.816578 10185 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:03:35.818866 10112 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.820567  8199 raft_consensus.cc:2889] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.821048  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.788847 10186 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.766628  9936 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:03:35.837128  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 245854us
I20260709 13:03:35.815367  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.830729  8265 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:35.845132  9995 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.850422 10112 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:35.844503 10193 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:35.845310 10129 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:35.863469  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.837592  9787 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:35.865231 10129 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:35.867786  9787 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:35.868212  9787 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:35.868605 10000 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:35.868258 10129 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:35.844973  8268 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:35.869315  9787 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:35.869720 10129 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.870503  9787 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.816352 10187 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:03:35.808735  9619 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.814580 10178 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.857501  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.876128  8200 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:35.877475  8118 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:35.885461 10194 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:35.886126  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 44378.2us
I20260709 13:03:35.863050  9936 consensus_queue.cc:1243] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:03:35.948029  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 176837us
I20260709 13:03:35.895088 10046 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.950018  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:35.950846 10034 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.951864  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.952239  8194 raft_consensus.cc:1217] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-5.7]   Dedup: 2.5->[3.6-5.7]
I20260709 13:03:35.952831  8194 pending_rounds.cc:85] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:03:35.953338  8194 pending_rounds.cc:107] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:03:35.953878  8194 raft_consensus.cc:2889] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.954733 10034 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.887521 10069 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:03:35.955633  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 92256.1us
I20260709 13:03:35.965629  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:35.894718  9918 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:35.887212  8804 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
W20260709 13:03:35.971634  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 84603.2us
I20260709 13:03:35.973794  8198 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:35.977010  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:35.982769  8117 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:35.984829  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 217053us
I20260709 13:03:35.990437  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:35.996240 10194 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.998809  9786 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:36.004119  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.006937  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.013803 10194 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:36.027310  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.044003  8193 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:36.008172 10112 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:36.081454  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.095659  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.096997  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.107687  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.133306  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.134933  9928 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.135551  9928 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.136945  9619 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.138792 10209 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.139106  9619 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.139241 10209 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.076730  9826 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:03:36.142903  9928 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.143343  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:36.143452 10130 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:36.141196 10209 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.144668 10184 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:36.145080 10184 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:36.145706  9826 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:36.146500  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:36.130318  9786 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.144989 10128 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.159826  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:36.160451  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 84759.9us
I20260709 13:03:36.145015 10130 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:36.148339 10194 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:36.162649  8270 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:36.146127  9826 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:36.144492 10178 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.171319  8124 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:36.169950  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:36.159485 10069 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:36.175256 10130 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.157629 10000 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:03:36.177553 10194 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:36.177815  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.171464  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:36.173517  9787 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:03:36.179498  8805 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:03:36.180414 10069 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:36.181677  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.162133  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:36.182407  8265 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:36.182230  9826 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.183519  9826 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.184495  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:36.181361 10069 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.181216  8810 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:36.185889  8810 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:36.188336 10000 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:36.188800 10194 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.146095 10184 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.193989 10184 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:36.199702  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.200722  8124 raft_consensus.cc:2376] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6. Re-sending same reply.
I20260709 13:03:36.201812  8810 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.202986  8810 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.219007  8265 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:36.221262  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.227185  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.227423  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.228094  8121 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:36.227219  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.228850  8120 raft_consensus.cc:2376] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3. Re-sending same reply.
I20260709 13:03:36.230247  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.232292  8269 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:36.203199  9918 consensus_queue.cc:1175] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" responder_term: 3 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:03:36.235075 10216 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:03:36.206409  9694 consensus_queue.cc:1175] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 13:03:36.239022  8811 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.243764  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.244319  8807 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.246728  8809 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:36.247872  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.248286  8810 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:03:36.248548  8802 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:36.249042  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.249776  9941 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:36.250473 10208 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 13:03:36.250298  9941 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.250931 10033 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.252455  9941 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:36.252480  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.243757  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.256556  8810 pending_rounds.cc:85] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 4
I20260709 13:03:36.256850  8810 pending_rounds.cc:107] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 13:03:36.246675  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.257205  8810 raft_consensus.cc:2889] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:36.254277  8806 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
W20260709 13:03:36.263096  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 51345.7us
I20260709 13:03:36.264719  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:36.266858  8197 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:36.267282  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.256929  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:36.276827  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:36.278704  8199 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.270905  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.279482  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.286168  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.287787  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.270195 10000 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:36.319778  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.320750  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.325829  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:36.325073  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:36.323761  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.335035  8191 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:36.339803  8116 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:03:36.340226  8116 pending_rounds.cc:85] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 3
I20260709 13:03:36.340457  8116 pending_rounds.cc:107] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:36.340698  8116 raft_consensus.cc:2889] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:36.341936  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.268687  9819 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:03:36.345240  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.348759  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.349258  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.333084  9857 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.352236  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.334136 10019 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:36.333084 10115 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.353394  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.355199  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:36.355851  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.363775  8199 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:36.270437 10079 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:03:36.262825 10186 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.367642  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.334182 10000 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:36.364939  8198 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:36.365888  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.323113  8268 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:36.368661  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.385913  8124 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:36.386444  8117 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:36.373399  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51396.7us
I20260709 13:03:36.373317  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:36.383313  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60101.7us
I20260709 13:03:36.368211  8116 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:36.324249 10187 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:03:36.337095  9838 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:03:36.366448 10040 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.020s	user 0.015s	sys 0.004s
I20260709 13:03:36.358289 10192 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:36.396993  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63182us
I20260709 13:03:36.399732  8118 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:36.364593  9857 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.400938  8191 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:36.401204  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.387183  9995 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.387349 10033 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.425064  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:36.387424 10019 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:36.399030 10215 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 13:03:36.432717  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 155437us
I20260709 13:03:36.432919  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.427487  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.425884  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:36.426944  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.439699  8199 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:36.387126 10134 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:03:36.443176  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:36.442440  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:36.387017 10115 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:36.443143  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.435375 10226 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:03:36.449431  8119 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:03:36.455719  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 102705us
I20260709 13:03:36.456653  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.457860  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.458437  8116 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:36.433480 10222 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:36.462956  8806 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEARNER]: Advancing to term 5
I20260709 13:03:36.421330 10040 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.463944  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.449573 10128 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:36.446797  8195 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:36.472003  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:36.469681  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.434358 10220 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:03:36.438953 10033 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.460461  9936 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.451448  9928 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:03:36.447079  9995 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:36.546358  8123 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:36.534189  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52694.1us
I20260709 13:03:36.481161  8810 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:36.543704  8199 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:36.485481 10203 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.188s
I20260709 13:03:36.474387  9819 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:03:36.554211 10223 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:03:36.554996 10224 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:36.555965 10033 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:36.480193  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.479127 10233 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:03:36.556988  9936 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:36.561695  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 105022us
I20260709 13:03:36.491581  8191 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.569295  8117 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:36.571487  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:36.562729  8116 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:36.573272  9995 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.500097 10112 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:36.574838  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.485762 10222 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:03:36.606187  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 154935us
I20260709 13:03:36.534368 10134 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:03:36.530660 10019 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.598012 10040 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.599053 10186 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:36.602084 10238 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:36.602965 10115 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.603742 10240 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.604943 10046 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:36.617272  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:36.618139  8237 leader_election.cc:336] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.981s (SENT)
I20260709 13:03:36.617961  8807 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Advancing to term 5
I20260709 13:03:36.618641  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.589258  8811 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:36.605890  9936 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.608660 10079 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:36.608283 10112 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:36.615864  8806 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:36.625475 10193 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.618345  8808 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:36.634565 10174 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:36.634953 10174 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:36.635700 10174 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.636600 10174 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.617776 10046 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:36.480237 10000 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:36.641741  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.639719  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:36.626540 10186 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.640120  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.657698  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.629702 10079 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.620137 10240 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.676776 10193 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.687780  8807 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:36.693337  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.695600  8195 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:36.686198 10115 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:36.699846  9936 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.659447 10186 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.661552 10222 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.692730 10231 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.707618 10079 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.708084 10244 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.720695  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:36.707948 10251 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:03:36.705497 10115 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:36.696511 10193 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.734556  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.730015 10115 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:36.736335  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.727594 10249 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.716364  9936 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.738247 10249 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:36.742502 10219 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.409s	user 0.004s	sys 0.000s
I20260709 13:03:36.725330 10244 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.782516  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.740057 10204 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:36.793601 10193 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:36.746169  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.726738 10112 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:36.794642  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:36.796444  9936 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.806025 10130 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.816736  9819 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:36.730547 10231 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:36.818717 10253 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:03:36.819480 10231 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:36.821388  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 85118.3us
I20260709 13:03:36.800822  8196 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:36.801703 10178 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.802098 10240 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.804476  8194 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:36.807857 10261 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:36.808537  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 70172.9us
W20260709 13:03:36.808977 10255 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:03:36.800164 10249 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.809859 10046 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.817412  9819 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:36.797955 10186 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.830310 10046 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.831920 10233 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:36.832345 10233 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:36.833930 10244 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.817149  8198 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:36.796867  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:36.827816  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.838508 10178 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:36.839360 10261 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.833333 10233 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.841606  9819 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.842641  9819 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.839303 10178 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.846143 10178 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.849627  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:36.851590  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54797.3us
I20260709 13:03:36.858706  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.855592  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:36.863025  8274 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:36.855636  9786 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:36.865093  9786 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.865463  9786 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:36.866894  8268 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:36.867311 10250 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:03:36.867832  8119 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.865396  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:36.855705 10079 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:36.868559 10079 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.870508  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.871061 10079 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.864109  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:36.871893  8266 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 2.
I20260709 13:03:36.872686  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:36.872519  9786 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.873121 10232 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:36.873548 10232 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:36.865629 10229 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:36.874498  9786 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.874328 10232 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:36.875479 10232 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:36.882197  8091 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.889283  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:36.889791  8119 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.864243  9936 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:36.893581 10186 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:36.894207 10186 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:36.895229 10186 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.897835  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.899040  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:36.850492 10261 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:36.915330  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 89960.7us
I20260709 13:03:36.916242  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.900660  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.862180 10178 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.919724  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.920934  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:36.889197  9995 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:36.925556  8191 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:36.919651 10214 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.023s	sys 0.049s
I20260709 13:03:36.928543  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.930588  8119 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:36.914937  9472 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:36.932446  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.933651  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:36.920428 10187 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:36.914430 10079 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:03:36.926267 10046 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.933102  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:36.951496  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 74279.3us
I20260709 13:03:36.952292  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:36.953965  8119 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:36.952342  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.954782  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:36.955756  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.931298 10069 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:36.932226 10214 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.024s	sys 0.049s
I20260709 13:03:36.948172  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:36.917721 10178 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:36.953284  9936 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.956622  9995 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:36.951473 10187 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.931448 10176 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:03:36.970824 10178 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:36.972606 10204 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:36.973239  9838 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:36.966533 10199 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:36.974587  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:36.975402  8194 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:36.961556 10244 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:36.980340  8274 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:36.959756  8805 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.986052  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:36.970484 10115 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.003290 10115 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:37.004628  9995 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:36.979840 10187 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.989878  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:36.990244  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.010164  8196 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:36.992182  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.011085  8267 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:36.972784 10249 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.012418  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.008865 10128 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.014197 10128 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.015640 10233 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.016150 10128 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:36.995981  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:36.965441 10188 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:36.961591 10069 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:37.001086 10178 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:37.001403  8266 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:36.992503 10222 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:37.027936  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:37.029023  9787 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:37.029385  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:37.030125  8804 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:37.036707  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:37.037889 10188 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:37.038400 10188 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.038697 10188 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:37.040475 10259 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:03:37.042498 10222 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:37.042951 10222 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:37.043880 10222 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.045737 10188 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.048377 10188 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:37.048523  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.049283  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.025624 10174 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:37.051321 10174 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.051664 10174 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.026949 10069 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.054905 10199 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:37.055440 10199 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:37.026906  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:37.045089 10222 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.060163  8191 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:37.057130 10261 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:37.061558  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.024344 10232 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:37.068022  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.066215  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:37.092855  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.093719  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:37.099671 10266 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:37.101107  8194 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.103128  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:37.103691  8804 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.098278 10251 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.067304 10232 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.105934 10251 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:37.098316 10240 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:37.107009 10240 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.107336 10217 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:37.056277 10199 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.092118 10186 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.067037 10115 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:37.115758 10186 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:37.117496 10246 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.530s	user 0.002s	sys 0.000s
I20260709 13:03:37.117123 10174 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.118207 10186 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.119520  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1591) took 1071 ms. Trace:
I20260709 13:03:37.119861  8193 rpcz_store.cc:276] 0709 13:03:36.048398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.048642 (+   244us) service_pool.cc:224] Handling call
0709 13:03:36.069401 (+ 20759us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:36.169715 (+100314us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:36.209666 (+ 39951us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.725272 (+515606us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:36.734404 (+  9132us) log.cc:844] Serialized 582 byte log entry
0709 13:03:36.734531 (+   127us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:36.734552 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.734594 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.116843 (+382249us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:37.119217 (+  2374us) raft_consensus.cc:1685] finished
0709 13:03:37.119304 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.119436 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8000,"prepare.queue_time_us":40094,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4637,"raft.queue_time_us":50956,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8571,"spinlock_wait_cycles":5242624,"thread_start_us":543495,"threads_started":3,"wal-append.queue_time_us":358593}
I20260709 13:03:37.122165  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.096055 10046 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:37.123564 10046 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:37.123956 10046 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.120512 10174 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.126230 10128 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.126678 10128 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.128770 10128 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.108064 10221 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.131548  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:37.132079  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64679us
I20260709 13:03:37.132221  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:37.136201  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:37.135715  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:37.137168  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:37.134785  8197 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:37.145068  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.107367 10240 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.092535 10204 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:03:37.148470  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:37.108155 10251 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.171962  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.163092  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:37.172791  8193 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.110067 10249 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:37.112910 10232 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.092785 10244 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:03:37.174793  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.249804  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.249961  8273 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:37.250874  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.251398  8273 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:37.147840 10128 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:37.252038  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 91256.6us
I20260709 13:03:37.147330 10231 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.115718  9787 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:03:37.256031  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.254999  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.162732  9928 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:37.264797  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:37.165380 10052 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:37.269143  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.266690  8119 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:37.274327 10230 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:37.274899 10230 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:37.275871 10230 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.114897 10217 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:03:37.280877  8271 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:37.281834  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.248514 10130 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:37.134159 10069 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.291586  8119 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:37.276243 10046 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.293851  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:37.296372  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:37.297467  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:37.278640 10217 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:37.165618 10186 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:03:37.255776  9472 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.269205  9928 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.299216 10052 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:37.302340  8811 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.298501  8274 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:37.304664  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:37.299902  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.249104 10188 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:37.278935 10178 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.252727 10197 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:03:37.310516  8271 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:37.319177  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.299453 10130 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:37.324028  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:37.327524  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:37.327368  8274 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.331017  8807 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 3: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:37.333909  8811 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:37.334051  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.306649 10217 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:37.340248  8197 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:37.310956  9928 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:37.321939  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:37.335565 10130 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.329281 10197 consensus_queue.cc:1243] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:37.311275  9472 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.328857 10249 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.384828  9787 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:37.341116 10243 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:37.464895  9694 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.340421 10209 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.384969 10174 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
W20260709 13:03:37.453496 10272 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:37.329514 10178 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.341581 10220 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 13:03:37.472620  8119 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:37.340972 10188 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.477768  8274 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:37.472707  9694 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.475055 10209 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.485595  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.493623  8265 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:03:37.485791 10279 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:03:37.486586 10273 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:03:37.466413 10243 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.464792 10193 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:03:37.508078 10276 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:03:37.517859  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:37.497318 10217 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:37.504242 10245 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.915s	user 0.002s	sys 0.002s
I20260709 13:03:37.570207  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:37.570880  8125 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:37.546249 10277 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:37.540525  8193 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:37.565182 10231 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:37.586627  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.535450 10243 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.568339  8804 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:37.598248  8197 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:37.600093  8123 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:37.592847  8120 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:03:37.591675  8116 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:37.595160 10069 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:37.608691  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:37.608951  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 263195us
I20260709 13:03:37.611989  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:37.612982  8120 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:37.615768  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:37.506564 10052 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.621781  8123 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:37.591432 10281 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.631388  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:37.632867  8124 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:37.593672 10046 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:37.638087  8116 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:37.638180  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:37.624086 10222 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:03:37.618248 10231 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:37.621045 10217 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.642392  8125 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:37.644667 10188 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:37.645404  8194 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:03:37.646121 10240 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:37.647795 10187 consensus_meta.cc:287] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.003s
I20260709 13:03:37.649935  9472 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.651912  9936 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:37.678102  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.624637 10197 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:03:37.653424 10233 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.638408 10281 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.657315 10243 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.642374  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 308) took 1198 ms. Trace:
I20260709 13:03:37.667100  8197 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:37.682201  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:37.671878  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:37.672501  8123 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:37.676466  8200 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:37.652889  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1161) took 1086 ms. Trace:
I20260709 13:03:37.642740 10069 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:03:37.681768  8809 rpcz_store.cc:276] 0709 13:03:36.440098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.443234 (+  3136us) service_pool.cc:224] Handling call
0709 13:03:36.461050 (+ 17816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.461255 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.461280 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.466287 (+  5007us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.580847 (+114560us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:36.580878 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.580935 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.308621 (+727686us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:37.637793 (+329172us) raft_consensus.cc:1685] finished
0709 13:03:37.637812 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.637979 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5872000,"thread_start_us":49967,"threads_started":1,"wal-append.queue_time_us":106937}
I20260709 13:03:37.693182 10232 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.699308 10232 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:37.699928  9995 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:37.700429  9995 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:37.701651  8803 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:37.701264  9995 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.702205 10284 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:37.702559 10284 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:37.703377 10282 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:03:37.703281 10284 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.686388 10233 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.706651 10233 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.707996 10243 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:37.710300  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.714875  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:37.715168  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.715735  8196 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:37.715783  8200 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:37.675691 10187 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.720564  8118 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:37.725284  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:37.691663  8194 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:37.694545 10069 consensus_queue.cc:1243] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:37.755471  8266 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:37.733186  9694 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.745698 10176 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:37.690130  8192 rpcz_store.cc:276] 0709 13:03:36.566457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.571201 (+  4744us) service_pool.cc:224] Handling call
0709 13:03:37.652699 (+1081498us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b540014d7d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:37.652827 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1617142656}
I20260709 13:03:37.757808 10128 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:37.808601  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 149581us
I20260709 13:03:37.809141  8117 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:37.814268  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.808367  8805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 497) took 1565 ms. Trace:
I20260709 13:03:37.823228  8811 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:37.824482  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 182883us
I20260709 13:03:37.774413 10176 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.828995  8199 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:37.830209  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:37.830817  8809 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:37.832428  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.833033  8199 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:37.834111  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:37.834874  8806 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.810587  9928 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.820472 10292 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:37.821641 10240 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.842361  8809 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:03:37.842902  8200 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:37.845829  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.820039 10197 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:03:37.846443  8200 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:37.850081  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:37.850857  8199 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:37.856459  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:37.859618  8807 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:37.860636  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:37.861689  8806 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:37.888705  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.820957  8805 rpcz_store.cc:276] 0709 13:03:36.241716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.262899 (+ 21183us) service_pool.cc:224] Handling call
0709 13:03:36.340679 (+ 77780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.006679 (+666000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.805154 (+798475us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54005834d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:37.807388 (+  2234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393703808}
I20260709 13:03:37.847357  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:37.900135 10229 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:37.848239 10292 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:37.890108 10243 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.891757 10303 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.891875  9472 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.892244 10285 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:37.892985 10000 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:37.863009 10069 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:03:37.940807  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 115680us
I20260709 13:03:37.896347 10034 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.897330 10298 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:37.897800 10294 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:37.922326  9928 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:37.923508  8810 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 3 LEARNER]: Advancing to term 4
I20260709 13:03:37.923688 10292 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:37.924335 10295 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:37.885665 10240 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.863344 10231 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:03:37.885784  9826 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:03:37.861335 10052 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:03:37.945796  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:37.918179  8192 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:37.939006 10285 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:37.953961  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 117613us
W20260709 13:03:37.958211  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.958837  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.943s (SENT) [suppressed 36 similar messages]
I20260709 13:03:37.954872 10294 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.938210 10243 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:37.940955  9472 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.945688 10304 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:37.947441 10034 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.961265 10285 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.969241 10052 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:37.955479 10240 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.940148 10303 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:37.971884 10306 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:38.004761  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 114010us
W20260709 13:03:38.005861  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47043us
I20260709 13:03:37.962662 10230 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:03:38.005393  8810 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:38.009945  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:37.983400 10231 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:38.006109  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 114293us
W20260709 13:03:38.011081  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52478.3us
I20260709 13:03:38.006659 10052 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:38.024067  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.028163  8807 raft_consensus.cc:1217] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-5.5]   Dedup: 2.3->[2.4-5.5]
I20260709 13:03:38.028615  8807 pending_rounds.cc:85] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 3
I20260709 13:03:38.028821  8807 pending_rounds.cc:107] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:38.029029  8807 raft_consensus.cc:2889] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.035838 10313 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:38.037258 10204 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:38.029983  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:38.034189 10220 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.038753 10249 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:38.039500 10176 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.039915 10052 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.040735 10303 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.040902 10052 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.041425  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.045617  8191 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:38.048131 10303 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:38.048897 10130 consensus_meta.cc:287] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.004s
I20260709 13:03:38.049614  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:37.948418 10301 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:38.023790 10310 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:03:38.054067 10314 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:38.054488 10314 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.054832 10314 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.055696 10240 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:38.053537  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43691.4us
I20260709 13:03:38.056615  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.057241  8805 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:38.057175 10204 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:38.025637 10230 consensus_queue.cc:1243] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:38.057770 10204 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:38.058573 10204 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.059417  9786 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:38.059873  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:38.060163  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.060997 10286 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:38.061270  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.062647  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.059813  9786 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.063001  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:38.063198 10204 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.063540  9786 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.064123  8267 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:38.063819  8266 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:38.066069  8265 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:38.066844 10312 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:38.067215 10312 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:38.067973 10312 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.069010  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.059720 10243 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.071326 10243 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.071756 10243 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.072355  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.079739  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:38.080202  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 65842.2us
I20260709 13:03:38.081099  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.009410 10306 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:38.062574  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.082475  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:38.083096 10243 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:38.083261 10305 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:03:38.082475  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:38.087491 10046 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:38.091794  8267 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:38.024811 10294 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:38.063609  8273 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.110606  8193 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:38.111994  8119 raft_consensus.cc:1217] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-5.5]   Dedup: 2.3->[2.4-5.5]
I20260709 13:03:38.129025  8119 pending_rounds.cc:85] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 3
I20260709 13:03:38.129312  8119 pending_rounds.cc:107] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:38.129554  8119 raft_consensus.cc:2889] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.110996  8269 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:38.070529 10312 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:38.081682 10309 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:38.125725  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:38.134089  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.133977  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:38.137710  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.164320  8273 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:38.167275  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:38.167896  8123 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.169656  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.141189 10287 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.174590  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 101458us
I20260709 13:03:38.049305 10130 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.136009 10046 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:38.141462 10231 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:38.184566  8116 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:38.185938  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.196164  8125 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
W20260709 13:03:38.184772  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 158021us
I20260709 13:03:38.198374  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:38.200023  8810 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:38.201071  8193 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:38.171661 10303 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.174703 10294 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.203517  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.214497  8273 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:38.145740  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:38.136046 10176 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:03:38.159394 10186 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.211933  8270 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:38.223354  8274 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:38.217372  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:38.181421 10307 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.224256  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.235678  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.236027  8123 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
W20260709 13:03:38.236442  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 94967.5us
I20260709 13:03:38.204448 10128 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:38.237902  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:38.321973  8118 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:38.322355  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.241462  8122 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:38.323127 10326 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:38.323598 10079 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.325719  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.320968  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:38.187382 10287 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.218508  9472 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:38.220067  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:38.210505 10231 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.254403  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:38.333485  8123 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.238140 10186 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.256579 10130 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:38.243392 10307 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:38.235647  8805 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:38.258677 10270 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.949s	user 0.001s	sys 0.013s
I20260709 13:03:38.275568 10046 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.282946 10284 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.284418  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:38.286142 10220 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:38.254554 10034 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:38.288200 10243 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:38.290890 10314 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.214713 10303 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.243691  9838 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:38.423300  9838 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.423712  9838 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.424437 10303 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:38.419864  8804 raft_consensus.cc:2376] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5. Re-sending same reply.
I20260709 13:03:38.286434 10217 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.425593  8808 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:38.426059  8808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 314) took 1541 ms (client timeout 1534 ms). Trace:
W20260709 13:03:38.426419  8808 rpcz_store.cc:269] 0709 13:03:36.884529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.886408 (+  1879us) service_pool.cc:224] Handling call
0709 13:03:37.101041 (+214633us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:38.211734 (+1110693us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03e9c 00007fbd21c03a5b 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:38.425969 (+214235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37082752}
I20260709 13:03:38.311116  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.427610  8120 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:38.313817  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78930.8us
I20260709 13:03:38.259900  9786 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.245385  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.330241 10128 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.311964 10302 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.322707  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:38.325675 10319 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:03:38.358150  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 179539us
I20260709 13:03:38.323688 10326 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:38.365082  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:38.438426  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 73435.5us
I20260709 13:03:38.439297  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:38.440356  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.365697  9787 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:38.441924  9786 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.442452  9787 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:38.443279  9787 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:38.443691  9787 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:38.444068 10306 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.444607  9787 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.445605 10290 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:38.446991 10324 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.324s	user 0.007s	sys 0.000s
I20260709 13:03:38.447124  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:38.366287 10301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34578 (request call id 13) took 11406 ms. Trace:
I20260709 13:03:38.445521 10328 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.450276 10220 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:38.450678 10178 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:38.450883 10323 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:38.451105 10220 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.367997 10307 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:38.454607 10314 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.455147  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:38.455842  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.455955 10243 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:38.451290  8123 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:38.456959 10243 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:38.379223 10187 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.221392  8195 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:38.428434 10034 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.382509  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1593) took 1129 ms. Trace:
I20260709 13:03:38.395270  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1584) took 1224 ms. Trace:
I20260709 13:03:38.403261 10209 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.461670  8271 rpcz_store.cc:276] 0709 13:03:37.253314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.290404 (+ 37090us) service_pool.cc:224] Handling call
0709 13:03:37.299021 (+  8617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.333565 (+ 34544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.382258 (+1048693us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5400308ed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:38.382422 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26053504}
I20260709 13:03:38.461793  8270 rpcz_store.cc:276] 0709 13:03:37.170727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.173405 (+  2678us) service_pool.cc:224] Handling call
0709 13:03:37.252284 (+ 78879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.223466 (+971182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.395024 (+171558us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b5400211454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:38.395204 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206620928}
I20260709 13:03:38.474535  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.475178  8199 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
W20260709 13:03:38.408115  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 282433us
I20260709 13:03:38.409056  8273 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:38.411795  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.326556 10079 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.308645  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.477849  8193 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:38.362334  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:38.431674  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 186361us
I20260709 13:03:38.479386  8091 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.480151 10209 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.480598  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.321174 10285 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.482849 10285 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.448796 10302 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.485744  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.485939 10302 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.460669  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:38.486696  8807 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:38.463801  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.487649 10209 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.488286 10209 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:38.488741 10328 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:38.488005 10314 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.488176  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:38.490557  8191 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.490525  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.491286  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.494472  8124 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:03:38.445286 10306 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.457324 10243 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:38.458339 10317 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:38.502924  8118 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:38.499747  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.459703  8808 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:38.507849  8268 raft_consensus.cc:2410] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:03:38.509603 10326 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.459987 10128 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.497557 10178 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.459264 10303 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:38.505264  8118 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:38.491492 10230 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:38.538110  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.518409  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:38.511050 10287 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:38.511477 10231 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:38.510280 10079 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.532123  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.501590 10302 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:38.533735 10199 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:38.469494 10301 rpcz_store.cc:276] 0709 13:03:26.926381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.536704 (+610323us) service_pool.cc:224] Handling call
0709 13:03:27.745128 (+208424us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b580036add0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d2370a 00007fbd24d2476a 00007fbd24d2391b 00007fbd24d2f03c 00007fbd24d2e6b3 00007fbd29ceed29 00007fbd2326d1d4 00007fbd2326d162
0709 13:03:27.813571 (+ 68443us) log.cc:844] Serialized 556 byte log entry
0709 13:03:28.341189 (+527618us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4c004e6340. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd22ff4a20 00007fbd23005a29 00007fbd2300613f 00007fbd22fca2ab 00007fbd22ff7f3c 00007fbd22ff83fe 00007fbd2328550b 00007fbd24c84381 00007fbd24c8226b 00007fbd24c88d53 00007fbd24c88cd9
0709 13:03:38.332721 (+9991532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9744,"raft.queue_time_us":10852,"raft.run_cpu_time_us":12223,"raft.run_wall_time_us":641869,"spinlock_wait_cycles":380813440}
I20260709 13:03:38.534372  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:38.503156 10243 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.535265 10303 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.476014 10034 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.550642  8118 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:03:38.580461  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 62138.2us
W20260709 13:03:38.592459  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63703.5us
I20260709 13:03:38.594552  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.564098  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.502802 10317 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:38.512410 10186 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:38.616833  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 81250us
I20260709 13:03:38.623560  8271 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:38.624207  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.625623  8265 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:38.629858  8267 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:38.628229  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.594130 10302 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.636536  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:38.633589  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 179780us
I20260709 13:03:38.635326  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:38.638785  8270 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.597501 10204 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:38.643355  8191 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:38.646281  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.638376  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.647574  8200 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:38.651007  8124 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:38.602301 10335 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:38.616622 10052 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:38.653324  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.653996  8121 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:38.641479 10302 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.601266 10287 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:03:38.701382  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:38.681787  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.648566 10314 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:38.598109 10230 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.661194  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:38.630666 10130 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:03:38.704820  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.707387  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.708249  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.658747 10339 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.660501 10335 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:38.722033  8071 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 19747a1b37df480faebc96d93689cda5 already in progress
W20260709 13:03:38.722445  8071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 19747a1b37df480faebc96d93689cda5 already in progress
W20260709 13:03:38.725821 10336 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:38.707815 10314 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.727037 10314 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.706228 10220 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:38.743742  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 114719us
I20260709 13:03:38.717777 10217 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.660727 10052 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:38.747463  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 109088us
I20260709 13:03:38.751434  8119 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:03:38.751829  8119 pending_rounds.cc:85] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 3
I20260709 13:03:38.752067  8119 pending_rounds.cc:107] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:03:38.752305  8119 raft_consensus.cc:2917] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:03:38.752656  8119 raft_consensus.cc:2889] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.702005 10178 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:03:38.749116  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.734081  9838 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.706725 10284 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:38.763411 10339 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.743702 10240 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:38.770011  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.772635  8124 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:38.748198 10217 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.727435 10289 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:38.774611  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.717607 10332 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:38.724808 10334 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:38.776291  8122 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:38.724431 10342 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:38.774771  8270 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:38.783419 10303 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.784801 10230 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:38.785450 10069 raft_consensus.cc:2764] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:38.787693 10350 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.788331 10034 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.788166 10350 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.783412  9838 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.790287 10350 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.766472  9819 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:38.791903  9819 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:38.793298  9819 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.798903 10289 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:38.800315 10289 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.801508 10332 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:38.802083 10341 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:38.803306 10312 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:38.803691 10312 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:38.804520 10312 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.812676 10052 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:38.815135  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50386.7us
I20260709 13:03:38.816118  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:38.786722 10334 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.774703 10240 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:38.769539 10220 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:38.860458  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:38.796963 10342 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.772989 10046 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:03:38.779858 10217 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.739734 10317 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.879101  8119 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:38.824148 10312 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.818408 10229 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:38.891803  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 183619us
I20260709 13:03:38.846948 10350 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.883667  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:38.884769  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.860399 10240 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.890028  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.892992  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:38.895947  8120 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:38.896492  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:38.897696  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:38.774690 10339 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.900846  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:38.905702  8270 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:38.902812  8811 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:38.875154 10342 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.916505  8809 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:38.895794 10233 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:38.922537 10347 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:38.900617 10222 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.895684 10335 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.904693 10317 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.802459 10332 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:38.935256 10354 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:03:38.935904 10330 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.907020 10302 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.945825 10281 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.923491  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:38.929102 10233 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.921147 10069 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:38.900647 10350 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.952348 10330 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:38.906708 10321 consensus_queue.cc:1175] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:38.959170 10233 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:38.959888  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:38.960723 10302 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:38.931424  9936 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:03:38.929831 10222 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.979055 10222 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.930474 10361 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:38.958137  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:38.969578  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:38.928936 10294 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:03:38.551167  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:38.900120 10229 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.969432 10330 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:39.016638  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 58565.4us
I20260709 13:03:39.017711 10292 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:39.017833  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.969491 10314 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:38.999166 10361 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:39.018599 10339 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.030754  8273 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:39.033399  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.020838 10069 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:39.038401 10069 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.040478 10069 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.022689  9936 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:39.041426  9936 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.046852  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:39.047737  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:39.049926  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:39.051783 10314 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.052460 10314 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:39.053149  8120 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:39.056670  8191 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:39.056979  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.064303 10229 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:39.066188  8019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 254) took 8921 ms. Trace:
I20260709 13:03:39.044194  9936 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:39.066689  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.054672 10314 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:39.062716 10192 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:39.113200  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.118570  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:39.119634  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 226406us
I20260709 13:03:39.121227  8194 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 3: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:39.088455  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:39.133417  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.103348  9787 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.062937 10217 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.138075  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 508) took 1855 ms. Trace:
I20260709 13:03:39.125690 10046 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:03:39.139595 10314 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.062443 10353 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:03:39.090747 10310 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.142627  8117 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:39.122152 10243 consensus_meta.cc:287] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.003s
I20260709 13:03:39.148161  8118 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:39.066566  8019 rpcz_store.cc:276] 0709 13:03:30.108325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.150659 (+ 42334us) service_pool.cc:224] Handling call
0709 13:03:39.029957 (+8879298us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:35.452055 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:35.495960 (+ 43905us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:35.496129 (+   169us) write_op.cc:435] Acquired schema lock
0709 13:03:35.496151 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:35.497251 (+  1100us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:35.497401 (+   150us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:35.497431 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:03:35.498440 (+  1009us) tablet.cc:701] Row locks acquired
0709 13:03:35.498492 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:03:35.498705 (+   213us) write_op.cc:270] Start()
0709 13:03:35.498878 (+   173us) write_op.cc:276] Timestamp: P: 1783602215498628 usec, L: 0
0709 13:03:35.498917 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:03:35.499752 (+   835us) log.cc:844] Serialized 3969 byte log entry
0709 13:03:36.075837 (+576085us) op_driver.cc:464] REPLICATION: finished
0709 13:03:36.816206 (+740369us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd21c1e0ac 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd2875eef0
0709 13:03:36.976628 (+160422us) write_op.cc:301] APPLY: starting
0709 13:03:36.976739 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:36.976981 (+   242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:36.977017 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:36.994730 (+ 17713us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:36.995022 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:03:36.995077 (+    55us) write_op.cc:312] APPLY: finished
0709 13:03:36.995388 (+   311us) log.cc:844] Serialized 77 byte log entry
0709 13:03:36.995576 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:36.995696 (+   120us) write_op.cc:454] Released schema lock
0709 13:03:36.995764 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:36.996152 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:36.996182 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3582,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":878043,"apply.run_cpu_time_us":3758,"apply.run_wall_time_us":31623,"num_ops":10,"prepare.queue_time_us":264855,"prepare.run_cpu_time_us":27166,"prepare.run_wall_time_us":354007,"raft.queue_time_us":215346,"raft.run_cpu_time_us":73465,"raft.run_wall_time_us":888103,"replication_time_us":576757,"spinlock_wait_cycles":125954816,"thread_start_us":1553975,"threads_started":4,"wal-append.queue_time_us":357889,"wal-append.run_cpu_time_us":59478,"wal-append.run_wall_time_us":2146806}]]}
I20260709 13:03:39.153290  8811 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:39.115438  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1622) took 1003 ms. Trace:
I20260709 13:03:39.111825 10330 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.145500  8805 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.179610  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:39.168779 10197 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.189203  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:39.189985  8811 raft_consensus.cc:2368] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:39.191787  8088 leader_election.cc:400] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:39.192119  8088 leader_election.cc:403] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:39.169565  9787 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.180606 10334 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.169092  8803 rpcz_store.cc:276] 0709 13:03:37.282733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.301838 (+ 19105us) service_pool.cc:224] Handling call
0709 13:03:39.133662 (+1831824us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540058f2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:39.138009 (+  4347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655185152}
I20260709 13:03:39.193491 10339 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:39.180945 10243 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.180794 10310 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.209808  9787 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:39.190886 10197 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.201093 10294 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.202710 10350 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.122298 10361 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.219280 10243 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.220805  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.225492 10355 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:39.226678 10217 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:39.229869 10364 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:03:39.234772 10217 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:39.235147 10217 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:39.236138 10371 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:39.235880 10217 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.212658 10339 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.242470  8270 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:39.244560  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:39.236730 10371 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.258440 10197 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.225113 10222 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.242787 10339 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:39.317915  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.420080  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:39.260655 10240 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.425488  8809 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:39.261451 10217 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.240689 10342 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.418087 10317 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:39.438859 10369 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:03:39.431885 10368 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:39.421620 10233 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.437450  8238 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:39.427233 10243 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:39.451318  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.451879  8271 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.453305  8807 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:39.457530 10353 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:39.460721  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.461724  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.430647  8805 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:39.468598  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.470768  8269 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:39.475373 10222 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:39.477823 10240 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.455470 10233 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.483583 10233 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.469647 10243 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:39.486774 10243 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.452739 10317 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.493425 10317 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.494963  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.497988  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.498121  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.498581  8266 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:39.498698  8270 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:39.499382  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.499562  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.500237  8267 raft_consensus.cc:2393] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:39.500475  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.500655  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:39.501225  8265 raft_consensus.cc:2410] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:39.501513  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:39.502045  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.503116 10302 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:39.503448  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:39.504099 10229 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:39.504308 10174 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:39.504474 10229 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.505075 10229 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.506721  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:39.503509 10302 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.507587 10302 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.510262  9928 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:39.510748  9928 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.512606 10231 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.513492 10350 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:39.514060  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.514775  8267 raft_consensus.cc:2410] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:03:39.515637  8199 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:39.516594 10304 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.517046 10304 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.517741  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:39.517916  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.518908  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.518397  8122 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:39.519227  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:39.519465  8265 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:39.513454 10281 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.520293 10281 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.521509 10249 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:39.521984  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.522804  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.522804  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.523352  8266 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.524521  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.528784  8811 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:39.528120  8810 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Committing config change with OpId 2.4: config changed from index 2 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:39.529795  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:39.522302 10358 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:39.528095  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.563208  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.534194  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:39.572239  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:39.572304  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.572781  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.575495  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:39.577229  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:39.580516  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:39.581105  8811 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:39.513073 10231 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.584236  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.584807  8270 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.521464  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.588838  8811 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:39.512571  9928 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.505085 10174 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:39.522046 10249 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:39.518922 10304 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.574218  9787 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.572903 10358 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:39.609784  8270 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:39.610749  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.579661  9936 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:39.588873 10222 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:03:39.618793  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 188761us
I20260709 13:03:39.591921 10281 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.637674  8265 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:03:39.638091  8265 pending_rounds.cc:85] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 6
I20260709 13:03:39.638295  8265 pending_rounds.cc:107] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:03:39.638500  8265 raft_consensus.cc:2889] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:39.662861  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 83149.5us
I20260709 13:03:39.574605 10197 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:39.596076 10372 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.579731 10240 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:03:39.600903 10332 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.180837  8195 rpcz_store.cc:276] 0709 13:03:38.111586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.119330 (+  7744us) service_pool.cc:224] Handling call
0709 13:03:38.182923 (+ 63593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.212616 (+ 29693us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:38.890297 (+677681us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.025817 (+135520us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.053743 (+ 27926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.061588 (+  7845us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.073797 (+ 12209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.090252 (+ 16455us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.112827 (+ 22575us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":363,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":4694,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":3399,"spinlock_wait_cycles":14536960,"thread_start_us":93098,"threads_started":1,"wal-append.queue_time_us":208242}
I20260709 13:03:39.612376 10358 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.664793  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:39.692431  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 181447us
I20260709 13:03:39.662334 10368 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:39.599416 10355 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:03:39.693115  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:39.705953  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.633158  9787 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.694381  8805 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:39.698628 10304 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:39.695369 10294 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4.
I20260709 13:03:39.664526  9936 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.664785 10222 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.698527 10281 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:39.695940 10368 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.698259 10372 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:39.705225 10306 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:39.702751 10243 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:39.709236  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:39.702898 10174 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.738763 10372 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.740491 10197 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:39.692374 10332 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.729115 10368 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.734215 10306 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.735973 10342 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.765054  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.766307  8198 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:39.728735 10302 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.768344 10302 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.762912 10306 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:39.768793 10332 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.754498  8803 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:39.734582 10281 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.770840 10281 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.772212  9787 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:39.772886 10387 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:39.775494 10222 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.779212  8266 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:39.783211  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:39.784297  8266 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.772890  8271 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:39.796180  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:39.723939 10379 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:39.712271 10249 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.814249  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 199) took 1643 ms. Trace:
W20260709 13:03:39.818503  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 122816us
I20260709 13:03:39.817288  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.817571  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.820187  8271 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:39.821230  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:39.818831  8125 rpcz_store.cc:276] 0709 13:03:38.170604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.196765 (+ 26161us) service_pool.cc:224] Handling call
0709 13:03:38.213883 (+ 17118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.413763 (+199880us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:38.413792 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:38.422177 (+  8385us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.618661 (+196484us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.618698 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.801146 (+1182448us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540029b654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:39.801200 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.813979 (+ 12779us) raft_consensus.cc:1685] finished
0709 13:03:39.813997 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.814200 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2115,"raft.queue_time_us":3254,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5169,"spinlock_wait_cycles":453938432,"thread_start_us":147938,"threads_started":1,"wal-append.queue_time_us":284400,"wal-append.run_cpu_time_us":1614,"wal-append.run_wall_time_us":1007826}
W20260709 13:03:39.822520 10381 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:03:39.824874 10395 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:39.832867  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.802368  9787 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:39.757819 10243 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.838647  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.823379 10379 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:39.839561 10317 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:39.841602 10229 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.841920  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.842281 10395 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:39.842622  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.918310 10395 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.918660  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.920197  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:39.920326  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.843420  8196 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:39.844831  8200 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:39.920720  8193 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.921602  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.843667  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.921645 10379 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.845237  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:39.924077  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:39.924614  8196 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.924561  8808 raft_consensus.cc:2376] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6. Re-sending same reply.
I20260709 13:03:39.925170  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 324) took 1049 ms. Trace:
I20260709 13:03:39.925616 10379 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:39.849459 10376 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:03:39.853737  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.828864  8271 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:39.891798  9787 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.873617  8266 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:39.905980 10231 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:39.907408  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:39.919304 10229 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.846493  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:39.848953 10382 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:39.922205  8200 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:39.853113 10358 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:39.862057 10388 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:03:39.862637 10339 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:39.978011  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:39.980078  8193 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:39.965144  8196 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:39.973562  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.981974  8273 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:39.982342  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:39.983428  8271 pending_rounds.cc:85] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 2
I20260709 13:03:39.944648  8194 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:39.983757  8271 pending_rounds.cc:107] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:39.985486  8271 raft_consensus.cc:2889] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.987610  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:39.916919 10317 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:39.988703  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:39.990960  8775 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:39.989113  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:39.992028  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:39.985144  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:39.996227  8775 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:39.995456  8271 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:39.997705  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 167582us
W20260709 13:03:39.974905 10217 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
I20260709 13:03:40.003288  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.007804  8806 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:39.958318  9936 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:39.960984 10307 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.986792 10304 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.021755  8266 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:03:39.984406 10243 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:39.990367 10317 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.990168 10342 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:39.988658 10406 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.925551  8808 rpcz_store.cc:276] 0709 13:03:38.876187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.889429 (+ 13242us) service_pool.cc:224] Handling call
0709 13:03:39.845094 (+955665us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:39.925112 (+ 80018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14044544}
I20260709 13:03:40.006263 10392 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:39.994794 10350 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.006479 10229 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:40.024933  8195 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:40.006138 10137 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:03:40.014230 10302 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:40.006608 10379 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:39.926913 10368 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:40.027989 10307 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.019076 10398 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:40.039580 10392 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.027791 10304 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.058750 10307 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:40.067152 10362 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.925s	user 0.004s	sys 0.010s
I20260709 13:03:40.068915  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1612) took 1006 ms. Trace:
I20260709 13:03:40.069310  8274 rpcz_store.cc:276] 0709 13:03:39.062082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.062220 (+   138us) service_pool.cc:224] Handling call
0709 13:03:39.065019 (+  2799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:39.065455 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.065481 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:39.106643 (+ 41162us) log.cc:844] Serialized 52 byte log entry
0709 13:03:39.856871 (+750228us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800326e60. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:03:40.015706 (+158835us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.015741 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.015801 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.068648 (+ 52847us) raft_consensus.cc:1685] finished
0709 13:03:40.068666 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.068862 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21095,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4070,"spinlock_wait_cycles":13444480,"thread_start_us":158654,"threads_started":1,"wal-append.queue_time_us":950001}
I20260709 13:03:40.046511 10379 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:40.074573 10137 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.077636 10137 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:40.079012  8193 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:40.079963 10137 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.081581  9787 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:40.049773 10302 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:40.082773 10302 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.083693 10317 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.084712  8191 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:40.086196 10358 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.086788 10358 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:40.087445  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 328) took 1205 ms. Trace:
I20260709 13:03:40.087035 10339 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.087334 10358 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.047557 10229 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:40.090085 10229 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.087087  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.052981 10392 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.103966  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:40.103583 10371 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.087845  8802 rpcz_store.cc:276] 0709 13:03:38.882283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.888697 (+  6414us) service_pool.cc:224] Handling call
0709 13:03:40.086676 (+1197979us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:40.086847 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.087108 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.087139 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.087186 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:40.087216 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.087273 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.087391 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7275904}
I20260709 13:03:40.099196 10406 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:40.106698  8266 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:40.091081 10379 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:40.103091 10306 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.089257 10358 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.111328  8091 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.117426 10317 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.136361  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.139761  8270 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:40.138588  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:40.140074  8091 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.108376 10368 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.118790 10361 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.107678 10410 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.141232  8266 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:40.143676  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.144712  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.135763 10174 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.112239  9694 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:40.143905 10411 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:40.140762 10412 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:40.146148  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:40.156204  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.110215 10184 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:03:40.150949  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.158949 10335 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:40.161777 10335 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:40.162561 10335 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.163489 10335 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.158222  9694 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.167459 10307 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.167982 10307 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.169860 10307 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.149515 10410 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.173662 10174 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.175099  8266 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:40.176023  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:40.173576 10306 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.156883 10411 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.189797 10411 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.190739  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.154098 10314 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:40.191428  8266 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.188966 10304 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:40.198026 10174 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:40.199494  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.200531  8196 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:40.201189  8196 pending_rounds.cc:85] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 1
I20260709 13:03:40.201707  8196 pending_rounds.cc:107] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:40.201925  8196 raft_consensus.cc:2889] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.200800 10287 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:40.209947  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.221423 10409 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:40.204135 10287 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:40.243893 10385 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.496s	user 0.001s	sys 0.001s
I20260709 13:03:40.256518  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.257118  8120 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.258783  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.261234  8266 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:40.262493  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:40.263033  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.264861  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.261880  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.266331  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.261641  9857 raft_consensus.cc:1064] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:40.257597 10192 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:40.273084  8091 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.275465  8120 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:40.276441  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.279500  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.280156  8125 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:40.282533  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.278158 10187 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:03:40.290450 10314 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.291402  9857 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.292915  8118 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:40.294430  8118 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:03:40.295779 10425 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:03:40.300156 10404 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.540s	user 0.002s	sys 0.000s
I20260709 13:03:40.284601 10192 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:40.307029 10401 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.556s	user 0.001s	sys 0.001s
I20260709 13:03:40.307396 10192 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.313486 10287 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:40.316601 10422 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:03:40.319304  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.313969  8267 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:03:40.320501  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.326172 10420 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:03:40.326655 10379 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.328421 10330 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.328770 10379 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.329113  8200 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:40.329679  9787 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:40.318887 10411 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.333273 10411 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.335151  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:40.312898 10392 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.338526 10229 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:40.338485 10390 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:40.352157 10310 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:40.354476 10392 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.344561 10229 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:40.356791 10229 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:40.359196 10424 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:03:40.365860  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.366570  8274 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.371546  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:40.372172  8200 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.402779  8274 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:40.404155  8091 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:40.407977 10128 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.412555  8200 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:40.415681 10372 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.418659  9694 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.410135 10383 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:40.427577  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.428717  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.428805  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.430177  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.430732  8124 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:40.439570  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 502) took 1556 ms. Trace:
I20260709 13:03:40.436955  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:40.439857  8807 rpcz_store.cc:276] 0709 13:03:38.883628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.883717 (+    89us) service_pool.cc:224] Handling call
0709 13:03:38.884001 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.453729 (+569728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.439405 (+985676us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540061dad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:40.439518 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308760960}
I20260709 13:03:40.432590 10192 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.445912 10192 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:40.453372  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 66676us
I20260709 13:03:40.435971  9787 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.454578  8021 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.455564  9787 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.456368  8021 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 4, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.449692 10292 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:40.457705 10292 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:40.458326 10386 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.649s	user 0.002s	sys 0.000s
I20260709 13:03:40.458634  9787 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:40.453558 10383 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:40.449466 10184 raft_consensus.cc:1027] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: attempt to promote peer 17c126976afd40d9a398d13a5ddd222f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:03:40.461773  8021 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:40.465723  8021 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 3, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 3 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.468988 10281 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.469512 10281 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.470310 10383 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.471426 10281 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.467396  8021 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 3 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:40.473641  8021 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 3 to 4, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.474814  8021 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 3 to 4, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.475868  8021 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 3 to 4, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.476814  8021 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:40.479310  8021 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 2, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:40.482590 10229 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:40.599270  8809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 526) took 1355 ms (client timeout 1673 ms). Trace:
I20260709 13:03:40.485788  8021 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 4 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:40.630403  8809 rpcz_store.cc:269] 0709 13:03:39.243640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.244362 (+   722us) service_pool.cc:224] Handling call
0709 13:03:40.599050 (+1354688us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400601154. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:40.599208 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414452480}
I20260709 13:03:40.482714  8270 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:40.634924  8121 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:40.619328  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:40.636220  8810 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.636662  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.637219  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.638566  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.638908  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.639519  8200 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:40.639768  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:40.640065  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.641168  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:40.499089  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.641805  8200 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:40.641636  8775 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:40.530432  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 93526.5us
I20260709 13:03:40.644640  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:40.631702  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.649303  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.653040  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.656426  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:40.656406  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.551735 10436 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:03:40.663486  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.664095  8197 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:40.659729  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.663106  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.660717  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.662822  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.663026  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:40.484094 10402 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.732s	user 0.001s	sys 0.001s
W20260709 13:03:40.485543 10384 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.737s	user 0.003s	sys 0.000s
I20260709 13:03:40.665997  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:40.487284 10335 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.666676  8118 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:40.670058  8193 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:40.671993  8810 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:40.530730 10351 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:40.523506 10410 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.673872  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.665395  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:40.675442  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.483882  9928 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.197s
I20260709 13:03:40.687899 10307 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.681528  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.671839 10353 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.554339 10312 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.498299 10372 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:40.678503 10426 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:40.681008  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1223) took 1164 ms. Trace:
I20260709 13:03:40.693843 10351 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.682009  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:40.595670 10210 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.659586 10310 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.689865  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:40.693174  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.693517  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.676779  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.656924 10317 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:40.681947 10406 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:40.674358 10368 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:40.662822  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.702915  8274 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:40.774547  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.487339 10292 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:40.574388  9787 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:40.713948  8269 rpcz_store.cc:276] 0709 13:03:39.516769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.587550 (+ 70781us) service_pool.cc:224] Handling call
0709 13:03:39.590679 (+  3129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.728350 (+137671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.728378 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.728417 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.728446 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.680823 (+952377us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540026fa54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:40.680863 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.680959 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316209024}
I20260709 13:03:40.716933  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1228) took 1051 ms. Trace:
I20260709 13:03:40.688803 10335 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.723673  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:40.852885  8196 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.738258  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:40.775529  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.855355  8274 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:40.846707  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.719532 10351 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:40.857378  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1213) took 1347 ms. Trace:
I20260709 13:03:40.847985  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:40.858539  8270 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:40.849305  8265 rpcz_store.cc:276] 0709 13:03:39.665056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.665566 (+   510us) service_pool.cc:224] Handling call
0709 13:03:39.665886 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.674894 (+  9008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.674923 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.695049 (+ 20126us) log.cc:844] Serialized 26 byte log entry
0709 13:03:39.750822 (+ 55773us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:39.751107 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.752255 (+  1148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.752332 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.483540 (+731208us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:40.716657 (+233117us) raft_consensus.cc:1685] finished
0709 13:03:40.716740 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.716876 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9205,"prepare.queue_time_us":160,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":9150,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":13271,"spinlock_wait_cycles":19604352,"thread_start_us":33162,"threads_started":1,"wal-append.queue_time_us":43607}
I20260709 13:03:40.851230  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:40.874594  8269 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:40.857806  8272 rpcz_store.cc:276] 0709 13:03:39.510302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.512029 (+  1727us) service_pool.cc:224] Handling call
0709 13:03:39.512335 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:39.512664 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.512689 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:39.513224 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:03:39.603473 (+ 90249us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:39.603511 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.603570 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.484991 (+881421us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:40.843792 (+358801us) raft_consensus.cc:1685] finished
0709 13:03:40.843813 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.857290 (+ 13477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6593,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"spinlock_wait_cycles":16442112,"thread_start_us":89895,"threads_started":1,"wal-append.queue_time_us":234942}
I20260709 13:03:40.846592  8192 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:03:40.876750  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 216073us
W20260709 13:03:40.876194  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 231599us
I20260709 13:03:40.878044  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:40.880342  8811 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:40.878687  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:40.875435  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:40.881187  8806 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:40.882282  8197 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:40.737818 10368 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:40.716885 10312 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.887923  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.883364  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:40.879918  8774 connection.cc:256] RPC call timeout handler was delayed by -1.0638656840000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:03:40.890974  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:40.852151 10361 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:40.892951  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:40.898104  8270 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:40.718924 10372 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:40.903147  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:40.904790  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 241627us
I20260709 13:03:40.883996 10317 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.886799 10368 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.722685 10210 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.919286  8196 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:40.924770  8811 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:40.914412  8273 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:40.889416 10292 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:40.931653 10444 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:40.932667 10450 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.899124 10361 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:40.954305  8116 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
W20260709 13:03:40.936707  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 255562us
I20260709 13:03:40.858191  9787 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:40.949087 10335 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.945070 10444 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:40.914459 10379 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:03:40.967144  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:40.970587 10222 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:40.934572 10354 raft_consensus.cc:2764] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:03:40.959738 10330 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.961805 10307 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:03:40.957962 10197 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.966822 10353 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:03:40.973434 10197 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:40.955004 10292 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:40.973834 10197 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:40.974813 10197 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:40.966670  8268 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:40.971014 10210 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.976439 10444 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.977659 10392 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:40.954422  9694 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:40.978281 10392 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.978726 10410 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:40.979169 10410 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:40.980386 10392 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.933946 10317 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:40.981752 10439 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:03:40.982209 10317 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:40.983201 10405 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.231s	user 0.009s	sys 0.009s
I20260709 13:03:40.980058 10410 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:40.986222 10410 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.987375 10192 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.977764 10444 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.994760  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:40.947180 10229 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:40.963083 10374 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.013190  8196 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:40.974181 10292 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:41.018325  8117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:41.019027  8117 raft_consensus.cc:606] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:40.971101 10222 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.019330  8117 raft_consensus.cc:614] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:40.958967 10450 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.020313 10374 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:41.054286  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 163779us
I20260709 13:03:41.039086 10137 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:41.078280  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 187366us
I20260709 13:03:41.085407  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.089448  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:41.070127  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 140682us
I20260709 13:03:41.090534  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.090698  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.086935 10372 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.087178 10368 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.104487 10368 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.106020  8193 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:41.090389  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.106362  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.040586 10406 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:41.077135 10312 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.109607  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:41.109805  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.086731 10137 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.111732  8163 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.086572 10397 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.114202 10453 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.097559 10317 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.115278  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:41.108511  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.088996 10451 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.132035  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.150890  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.121832 10462 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.154241 10462 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.122354 10447 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:41.135493 10197 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.115043 10379 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:41.136404 10317 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.114863 10445 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:41.100737 10446 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.115455 10312 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:41.107920 10372 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.112290 10368 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.116014 10307 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:03:41.124629 10397 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.158468 10389 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.122164 10374 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.144524  9787 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.153710  9936 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.156263  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:41.156025  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65759.2us
I20260709 13:03:41.154639 10462 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:41.172838  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61178.9us
I20260709 13:03:41.173769  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:41.155083 10443 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.005s
I20260709 13:03:41.145879 10455 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.167282  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.156507 10447 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.158738 10222 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.174484  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.175387  8196 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:41.175915  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.180549  8198 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:41.176512  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.172281 10449 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:41.167443 10450 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.162335 10441 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:03:41.159077 10351 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.169941 10389 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.170104 10368 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:41.177693 10312 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.185187  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.185560  8806 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:41.184288  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.157805 10451 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.178757 10467 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.179893 10447 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.190989  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.163519 10406 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.193815  8811 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:41.187283 10389 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.186262  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.186672 10444 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.195896  8806 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:41.196426 10368 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.205133 10361 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.193910  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.212208  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.212769  8807 raft_consensus.cc:2376] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6. Re-sending same reply.
I20260709 13:03:41.213305  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.215852  8808 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:41.216331  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.222355 10410 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.211174  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.217211 10390 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.223712 10361 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.230186  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.224092  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.226101  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.224292 10410 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:03:41.226933 10451 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.228341  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.228921 10351 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:41.231112  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.231788  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.232538  8802 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:41.249027  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.235356  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:41.235811 10389 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.237929 10397 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.242501  9936 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:41.244055  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.254935  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.255470  8806 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:41.256935  8811 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [3.6-6.8]
I20260709 13:03:41.224210 10137 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:41.246369  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.249387  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.259261  8267 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:41.251607  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:41.258193  8806 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:41.261823  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.258257 10441 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.265765 10441 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.266100 10441 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.258338 10192 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:41.258452  9936 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:41.270779  9936 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.271946  9936 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.261900 10454 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:41.273460 10454 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:41.221588 10403 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:03:41.281533  8806 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:41.284111  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.274225 10454 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:41.287133  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.287971  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.290848  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:41.288627  8806 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:41.303331  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:41.305984  8806 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:41.300275 10197 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:41.304842 10310 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:41.304095 10354 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.308449 10354 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.311770  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.315376  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.325907  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.297631 10351 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:03:41.318472 10312 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:41.356247  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52986.2us
I20260709 13:03:41.373198  9694 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:41.373813  9694 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.374744 10192 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.375276 10192 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:41.375768  9694 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.377269  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.377967 10334 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:41.378337 10334 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:41.378561 10328 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.378966 10328 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:41.379088  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:41.379350 10328 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.379640  8125 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:41.381673  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 67494.4us
I20260709 13:03:41.381624  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:41.378221  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 94195.9us
I20260709 13:03:41.386508  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.387590  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.389242 10410 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.389909 10410 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.391104 10453 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:41.391511 10453 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:41.392354 10192 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.393821  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.395359 10334 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.396576 10334 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:41.373324  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.396983 10328 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.399384  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.399887  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.401494 10390 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.402030 10390 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.404089 10390 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.405393  8116 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:41.405648 10328 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.409653  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:41.414379  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.420629  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.421337  8121 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:41.422622  8117 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:41.425980  8125 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:41.443238  8119 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:03:41.324100 10468 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:03:41.444468  8193 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:41.445256  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:41.448364  8810 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:41.356570 10373 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.417428 10450 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.354480 10317 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.420042 10294 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.338037 10372 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:03:41.426410  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.337900 10462 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.461184  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.340555 10446 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
W20260709 13:03:41.466197  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 85535.2us
I20260709 13:03:41.338637 10292 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.464872  8195 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.473588  8116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:41.474123  8116 raft_consensus.cc:606] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.465566 10317 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.465888 10328 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:41.487562 10317 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.494544  8118 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:41.459728 10354 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.456990  9786 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:03:41.472148  8803 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:41.467469 10294 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.516816  8195 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:41.458942 10373 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.499042 10476 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:41.533437  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 67263.5us
I20260709 13:03:41.533547  8195 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:41.534260  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.536870  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.537315  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.537900  8195 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:41.539295  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.539992  8198 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:41.544080 10328 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:41.547107 10390 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:41.547515 10390 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:41.504557 10389 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:41.555685  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 88889.1us
I20260709 13:03:41.557866  8267 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:41.559796  8273 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:41.565816 10480 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.548269 10390 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.567474 10389 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:41.567740 10390 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.567924 10476 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:41.569283 10389 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.569661  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.572269  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.546392 10328 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:41.574265  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.574536  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.575932  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:41.576001  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.582864  8273 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:03:41.593286  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.566438 10480 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.596916  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.597715  8270 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:03:41.597832  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54457.8us
I20260709 13:03:41.599305  8273 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:41.599431  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:41.584631 10474 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:03:41.600047  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.601899  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.602154  8274 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
I20260709 13:03:41.575335 10483 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.601612  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:41.604771  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.605209  8269 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:41.605373  8117 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:41.603194  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:41.605684  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.606066  8274 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:41.607360  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:41.588797 10184 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:41.609793  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:41.603518  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:41.608842  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.608515  8267 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:41.613384  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:41.614737 10480 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.616137  9786 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:41.616508  9786 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.616904  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.617080  9786 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.620428 10441 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.621672  8268 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:41.621946 10292 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.612756 10450 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:41.624090 10450 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:41.624441 10450 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.625134  9786 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:41.627277  9786 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.612622 10452 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:03:41.630586  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.631284 10137 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.631991  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:41.635001 10406 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:41.635398 10406 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.635739 10406 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.636269  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.637724  8269 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:41.639832  9787 raft_consensus.cc:1064] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:41.568806 10476 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.640988  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.641546  8193 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.645587 10490 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.646082 10490 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.646550 10294 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.648044 10490 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.648315  8193 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:41.649582 10462 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:41.655838 10470 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:03:41.635782  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.611760 10287 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.659353  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.660029  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.660830 10373 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.661340  8193 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:41.662236 10137 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:41.662734 10137 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:41.663643 10137 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:41.667358  8199 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:03:41.667704  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:41.669171 10335 raft_consensus.cc:1064] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:41.668915 10447 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.670467 10441 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.670848 10447 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.671077 10335 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.667732  8199 pending_rounds.cc:85] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 4
I20260709 13:03:41.673871  8199 pending_rounds.cc:107] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:03:41.674078  8266 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:41.674499  8193 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:41.674088  8199 raft_consensus.cc:2889] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.688833  8122 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:41.698375  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.702813  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.704025  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.704811  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.705320  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:41.706545 10287 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.707142 10287 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.709874 10287 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.702764  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:41.713369  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.713481  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.714028  8118 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:41.714596  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:41.715433  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.715937  8124 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:41.717937  8124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:41.718091  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:41.718416  8124 raft_consensus.cc:606] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.722522  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.725181  8775 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.725947 10455 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.726418 10455 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:41.728466  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.730168  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:41.733024 10454 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:41.732321  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:41.744750  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.739442  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:41.762343  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 44341.8us
I20260709 13:03:41.727646 10467 raft_consensus.cc:2764] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:41.721913 10287 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:41.731884 10197 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.755669 10310 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:41.736289 10397 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.757930 10447 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.757361 10372 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:41.773111  8265 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:41.736331  9786 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:03:41.731328 10330 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:03:41.766841 10292 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.756062  9936 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:03:41.782765 10372 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.796512 10372 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:41.798348 10450 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.800565 10450 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.778779 10310 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.773536 10486 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.802917  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:41.810950  8271 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.785416 10447 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:41.774214 10287 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.788157 10397 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.794557 10292 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.818948 10292 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.819985 10312 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:41.820390 10312 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:41.823149 10197 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:41.823661 10197 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.823947 10335 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:41.825035 10335 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:41.825392 10335 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:41.826164 10335 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.827297 10335 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:41.809489 10310 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.842399  8271 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:41.813922  8804 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.843513  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:41.832592 10492 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:03:41.814064 10449 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:41.769716 10455 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.814554 10476 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:41.853374  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 113984us
I20260709 13:03:41.857805  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.821125 10312 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.812032 10486 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:41.855489 10444 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.856005 10197 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.890431  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:41.899839 10287 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:41.900705 10491 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:03:41.901539 10498 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.905130 10444 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:41.902513 10372 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.853506 10476 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:41.945494  8119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:41.946077  8119 raft_consensus.cc:606] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:41.947165  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.908964 10444 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.911581 10486 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:41.892640 10447 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:41.912843 10493 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:41.909137 10497 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:41.862314 10406 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.915551  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:41.918146  8192 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:41.927663 10389 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:41.928082 10292 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.929910 10328 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:41.934717  9787 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:41.936761 10501 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
W20260709 13:03:41.908528  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46834.8us
I20260709 13:03:41.949170  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:41.958845  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 231920us
I20260709 13:03:41.971717  8198 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:41.976884 10328 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:41.987164 10497 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:41.988884 10449 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:41.996995 10476 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:41.997507  8091 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.000069  8119 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:42.002167  8125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:03:42.079620  8125 raft_consensus.cc:606] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:42.079993  8125 raft_consensus.cc:614] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.003297 10306 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:42.008879  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:42.011332 10373 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:42.012521 10292 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:42.014210 10310 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.015112 10406 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:41.959797 10312 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.017673 10372 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:42.022564 10453 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:42.030133 10505 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:42.037150  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:42.046804  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:42.047863  8120 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:42.049733  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.059439  8267 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:42.062253  8810 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [3.6-6.8]
I20260709 13:03:42.063603  8806 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:42.069720  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:42.078094  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:42.077632  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 80213.4us
I20260709 13:03:42.083824  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:42.085597  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:42.088650  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:42.088346  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:42.033067 10197 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:42.255873  8199 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:42.224431  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.124374  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:42.258128  8125 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:42.258476  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:42.088356  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:42.259505  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:42.166319  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:42.141191  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:42.089272  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:42.257198  8270 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:42.261770  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:42.263139  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 254331us
I20260709 13:03:42.264907 10354 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.265506 10354 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.264866  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:42.268188  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 188369us
I20260709 13:03:42.278438  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:42.240417 10494 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:42.285815  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:42.286473  8269 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
W20260709 13:03:42.287112  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.287817  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 187006us
W20260709 13:03:42.288635  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.256809 10476 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.289618  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.290896 10441 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:42.290874  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.292923 10485 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:42.293408 10485 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:42.294153 10485 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.296643  8199 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:42.296845 10479 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:42.297159  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 201709us
I20260709 13:03:42.297801 10479 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:42.301743 10479 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:42.303215 10441 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.302496 10479 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.303684 10441 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.304209 10479 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.312047 10441 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:42.302158  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.316581 10479 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:42.317649  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:42.319017  8269 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:42.083424 10306 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:42.084846  9786 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.320241  8269 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.084594 10449 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.249145 10292 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:42.122570 10467 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:42.254215 10137 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:42.254007 10210 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:42.271054 10358 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:42.334951  8266 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:42.075129 10502 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.259s
W20260709 13:03:42.282685  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 159272us
I20260709 13:03:42.075318 10403 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.212s
I20260709 13:03:42.339515  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:42.281482 10453 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.344056  8268 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:42.375419  8268 pending_rounds.cc:85] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:03:42.375692  8268 pending_rounds.cc:107] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:42.375921  8268 raft_consensus.cc:2889] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.317067 10479 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.330268  8808 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:03:42.336779  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 71971.6us
I20260709 13:03:42.374059  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:42.088217 10455 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.248s
I20260709 13:03:42.388011  8199 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:42.453181  8806 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.253796 10497 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.351565 10210 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.364279  8804 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:42.363888  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:42.340916 10292 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.363552 10476 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:42.456902  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:42.348474 10137 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.465483  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:42.466087  8199 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.468393  8806 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:42.469717  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:42.470283  8806 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:42.418735  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.370262  8805 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:42.452387 10486 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.472532  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:42.383987 10351 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.473816  8199 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:42.487039  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:42.488189  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:42.490238  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.391520 10499 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:03:42.493858  8806 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:42.497650  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:42.498490  8119 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.499152  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:42.499379  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:42.497702 10410 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.517899  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.519172  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:42.527874  8116 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:42.493144  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:42.538035  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44977us
I20260709 13:03:42.473024 10222 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:42.493117 10467 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.539171  8166 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:42.550027  8199 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.376089 10306 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.596413  8119 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:42.600080  8199 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:42.605088  8199 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.606057  8199 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.478344 10476 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.613665  8191 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:42.613732  8199 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:42.517935  9936 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:42.619019  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:42.531946 10480 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:42.532357 10485 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:42.489884 10351 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.490060 10486 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.599128 10335 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.598630 10358 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:42.616518 10487 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:42.549440 10310 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:42.649061  8265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.031s
W20260709 13:03:42.696815  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.706060  8265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.005s	sys 0.031s
I20260709 13:03:42.598448 10373 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:03:42.543906 10410 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.642442 10490 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.752233  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 238414us
I20260709 13:03:42.605252 10372 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:42.649782 10462 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:42.657953 10467 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:42.700418 10306 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.700017 10480 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:42.703320 10358 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:42.651255 10287 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:03:42.707163 10485 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:42.762712  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:42.755290 10511 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:03:42.707407 10335 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.776364  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:42.769472 10510 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:03:42.754897 10184 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:42.773840 10373 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:42.772298 10358 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.796131 10479 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:42.833213  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 56937.6us
I20260709 13:03:42.839388  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.819710 10467 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.768381 10490 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.655614  9936 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:42.835824 10522 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:03:42.830996 10210 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:42.851006  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.837445  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 319607us
I20260709 13:03:42.811691 10485 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:42.845928  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 350205us
I20260709 13:03:42.836722 10373 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:42.840178 10137 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:42.844550 10287 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:42.771530 10372 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.862404  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.868017 10490 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:42.870189 10521 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:03:42.882095  9787 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.885802 10373 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.886902 10373 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.846899 10467 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:42.891141 10467 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:42.892194 10476 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:42.894309 10335 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:42.897032 10312 consensus_meta.cc:287] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.000s
I20260709 13:03:42.897696 10351 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:42.861992 10480 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:42.901075 10354 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:42.901234 10453 consensus_meta.cc:287] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.003s
W20260709 13:03:42.901820  9786 consensus_meta.cc:287] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.569s	user 0.002s	sys 0.006s
I20260709 13:03:42.902511  8196 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:03:42.903060  8196 pending_rounds.cc:85] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:03:42.903261  8196 pending_rounds.cc:107] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:03:42.903465  8196 raft_consensus.cc:2889] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.902222  9786 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:42.871794  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.853242 10532 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:03:42.877133 10518 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:42.855006 10192 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.877293 10485 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:42.877911 10410 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:42.878216 10527 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:42.930701  8809 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:03:42.908977  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.915561 10486 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:42.884899 10358 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.920238  8237 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:42.941434 10485 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:43.465867 10197 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.007s	user 0.011s	sys 0.000s
I20260709 13:03:42.945600  8124 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:43.342350  9786 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.915230 10184 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:43.200207 10358 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.397511 10544 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.474565 10184 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.475206 10544 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:42.939872 10527 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:43.476249 10527 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:43.239157  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.478178  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.162379 10480 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:43.479239 10480 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.481362 10480 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:42.996892 10292 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.414937 10534 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:42.928869 10192 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:43.367098 10306 consensus_meta.cc:287] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.001s
W20260709 13:03:42.943428  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 104127us
I20260709 13:03:43.058663  9787 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.473225  9786 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:43.468894  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 929710us
I20260709 13:03:43.469213  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 520) took 1196 ms. Trace:
I20260709 13:03:43.489882  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:43.490442  8809 rpcz_store.cc:276] 0709 13:03:42.272718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.272868 (+   150us) service_pool.cc:224] Handling call
0709 13:03:42.919169 (+646301us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:42.919366 (+   197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.931130 (+ 11764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.469150 (+538020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11820416}
I20260709 13:03:43.075690  8270 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:42.919646 10523 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 13:03:42.944651  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 64929us
I20260709 13:03:43.512490  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:43.513451  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:43.513993  9787 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:43.514575  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:43.493703  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.515817  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.536233  9787 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:43.372385 10390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.022s	sys 0.089s
I20260709 13:03:43.539624 10192 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:42.963969 10312 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:43.542477  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.055457 10426 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.488s
I20260709 13:03:43.491052 10534 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.547550 10534 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:43.047417 10373 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.535504 10306 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.000669 10485 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.477214 10544 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.550904  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.551961  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.553375  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.565405 10312 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:43.556768  9787 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.592722  9787 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.515326 10358 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:03:43.557518  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.599910  8125 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:43.515026 10292 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:43.516934 10532 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 13:03:43.552238 10390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.024s	sys 0.089s
I20260709 13:03:43.535568 10480 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.562879  8120 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:43.000353 10449 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.000s
I20260709 13:03:43.451027 10540 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:43.342128 10210 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.361126 10535 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:43.520102  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.057495 10531 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.522s
I20260709 13:03:43.591010  8118 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:03:43.589722  8122 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:43.587772  8116 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:43.603647  8265 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:43.608875  9787 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.612114  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:43.676411  8273 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:43.586906 10546 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.587602 10541 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.592298 10307 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.588204 10534 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.655699  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.688706  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:43.626279  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 110390us
I20260709 13:03:43.689061  8274 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:43.673152  8119 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:43.609943 10426 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.687909  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:43.685134  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.691931  8265 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:43.686782  9787 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.692663  9787 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.587353 10373 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.690078  8118 raft_consensus.cc:2368] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7.
I20260709 13:03:43.612597 10306 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.690812  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:43.612432 10549 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.693852  8237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.619s (SENT) [suppressed 4 similar messages]
I20260709 13:03:43.645984  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.617688 10292 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:43.696403  8116 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:43.699771  9787 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.705083  8273 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:43.602769 10312 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.695302 10426 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.693879 10307 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.678992 10210 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.663133 10449 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.700837 10292 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:43.716629  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.717386  8198 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:43.717629  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.718251  8193 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:43.721709  8197 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:43.723027  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.724305  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.725818  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.726382  8200 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:43.727694  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.729206  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.730659  8198 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:03:43.731088  8198 pending_rounds.cc:85] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 2
I20260709 13:03:43.731356  8198 pending_rounds.cc:107] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:03:43.731622  8198 raft_consensus.cc:2889] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:43.679404 10540 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.735090  8200 raft_consensus.cc:2368] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7.
I20260709 13:03:43.707871 10358 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.739650 10550 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.740025 10358 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.740643 10307 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:43.741026 10426 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.688968 10546 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.694161 10534 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.739575  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:43.743628  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:43.743891  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51741.8us
I20260709 13:03:43.687176 10535 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.700742 10306 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.748622  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:43.749771  8267 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:43.750219  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.752863  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.753618  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.755631  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.755733  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.756152  8273 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:43.756490  8274 raft_consensus.cc:2410] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:03:43.756578 10540 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.756997  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.741228 10210 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.757313  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:43.757575  8273 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:43.762658  8193 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:43.691066 10541 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.746729  9786 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.747900 10307 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:43.705600 10549 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.749037 10554 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:43.752620 10544 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:43.757819 10532 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:43.737720 10527 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.763484 10560 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.772224 10485 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:43.771919 10540 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.748009 10550 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.774797 10558 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.763355 10557 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:43.776320 10307 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.775516 10554 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.781723 10480 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.809007 10328 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.813712 10307 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:43.780972 10532 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.814088 10554 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:43.780162 10358 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.816787 10358 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:43.797366 10560 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.819458 10560 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.785429 10197 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:43.819900 10560 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:43.859812 10560 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.780004 10544 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.800566 10549 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.805457 10449 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:43.817235 10358 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.822696 10480 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.798981 10535 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.801883 10373 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.809860 10527 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:43.821983 10557 raft_consensus.cc:3055] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:43.802953 10541 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.820832 10558 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.804512 10534 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:43.807545 10508 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.348s	user 0.003s	sys 0.009s
I20260709 13:03:43.801538 10546 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.850764  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:43.828202 10532 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.821723 10197 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:43.853561 10540 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:43.821374 10550 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:43.863399  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.797106 10306 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:43.856168 10512 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.378s	user 0.002s	sys 0.012s
I20260709 13:03:43.832633  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1683) took 1527 ms. Trace:
I20260709 13:03:43.848243 10372 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:44.194418  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 343728us
I20260709 13:03:43.899471  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:43.898095  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.253690  8196 rpcz_store.cc:276] 0709 13:03:42.309392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.309526 (+   134us) service_pool.cc:224] Handling call
0709 13:03:42.309826 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.903812 (+593986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.832410 (+928598us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400028d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:43.832574 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362187520}
I20260709 13:03:44.232070  8199 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:44.233333  8273 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:44.237123  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.258088  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:44.256515  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.214015  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.260860  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.261718  8199 raft_consensus.cc:2410] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 8 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:44.258572  8166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.028s
W20260709 13:03:44.262527  8166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.028s
I20260709 13:03:43.785787 10312 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.051312  9786 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.231818  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1704) took 2185 ms. Trace:
I20260709 13:03:44.212285 10294 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:44.268153  8272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.016s	sys 0.014s
I20260709 13:03:44.194968 10557 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:44.313651  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:44.315687  8125 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:44.316183  8191 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:44.209836 10197 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:43.979019 10307 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:43.979156 10328 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.051008 10564 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:44.319687  8272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.017s	sys 0.023s
I20260709 13:03:44.005846 10552 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:44.320148  8123 rpcz_store.cc:276] 0709 13:03:42.046194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.258002 (+211808us) service_pool.cc:224] Handling call
0709 13:03:42.281540 (+ 23538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.487054 (+205514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.487085 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:42.487123 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:42.487151 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.211890 (+1724739us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400393354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:44.231647 (+ 19757us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.231762 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456846208}
I20260709 13:03:44.268647  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.340075  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.345057  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.313678  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:44.345801  8122 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.323740  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 306) took 2485 ms. Trace:
I20260709 13:03:44.318377 10426 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:44.239212 10534 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:44.329631  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:44.350210  8120 raft_consensus.cc:2410] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:44.346273  8268 rpcz_store.cc:276] 0709 13:03:41.825874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.825989 (+   115us) service_pool.cc:224] Handling call
0709 13:03:41.826289 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.376406 (+550117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.311045 (+1934639us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54002ec2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:44.311192 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189923712}
I20260709 13:03:44.257589 10546 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.311638 10450 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.256093 10549 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:44.310968 10527 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:44.067396 10292 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:44.338907  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.018s	sys 0.031s
I20260709 13:03:44.130066 10554 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.311344 10537 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:44.311942 10499 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:44.330724 10372 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:03:44.324043 10294 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.345978  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:44.352228  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.353081  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.362924  8122 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
W20260709 13:03:44.367172  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 350367us
W20260709 13:03:44.367364  8237 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.029s	sys 0.019s
W20260709 13:03:44.376618  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.019s	sys 0.031s
W20260709 13:03:44.380501  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.319826  9786 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:44.384313  8237 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.030s	sys 0.019s
W20260709 13:03:44.384424  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 613139us
W20260709 13:03:44.384781  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.383252  8196 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:44.390841  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:44.350075 10498 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:44.393594  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.404807  8268 raft_consensus.cc:2410] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:44.395982  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:44.394914  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 701484us
I20260709 13:03:44.339802 10184 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:03:44.402112  8198 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:44.355036 10527 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.340308 10379 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:44.386047 10294 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.416332  8273 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:44.418229  8198 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:44.418910  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:44.419766  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:44.420332  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1277) took 2462 ms. Trace:
I20260709 13:03:44.450357  8268 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:44.406315  8269 raft_consensus.cc:2368] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:03:44.449833  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.376690 10572 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.452232  8238 leader_election.cc:400] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7.
I20260709 13:03:44.453442  8196 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:44.349249 10328 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.422699 10527 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.377476 10450 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.376983 10549 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:44.495118  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 76267.5us
I20260709 13:03:44.450361 10306 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:03:44.552471 10306 consensus_queue.cc:1243] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:44.553180 10397 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:44.553800 10328 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.355537 10534 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.547927 10358 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.554898 10358 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.354117 10426 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.555317 10358 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.453514 10498 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.406450 10502 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:44.386348 10568 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:44.385949 10557 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.381826 10537 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.452916  8194 rpcz_store.cc:276] 0709 13:03:41.943493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.943937 (+   444us) service_pool.cc:224] Handling call
0709 13:03:41.944213 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.944557 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.944583 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.944981 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.256864 (+311883us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:42.256903 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.256963 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.807039 (+1550076us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:44.387751 (+580712us) raft_consensus.cc:1685] finished
0709 13:03:44.387776 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.405565 (+ 17789us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10996,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2746,"spinlock_wait_cycles":77384448,"thread_start_us":141816,"threads_started":1,"wal-append.queue_time_us":407273}
I20260709 13:03:44.349469 10552 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:03:44.627918  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 79253.5us
I20260709 13:03:44.628789  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 518) took 2352 ms. Trace:
I20260709 13:03:44.629242  8810 rpcz_store.cc:276] 0709 13:03:42.272173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.273075 (+   902us) service_pool.cc:224] Handling call
0709 13:03:43.839169 (+1566094us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:43.839342 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.839709 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:43.839735 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.840181 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.321403 (+481222us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:44.321458 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.321525 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.567139 (+245614us) raft_consensus.cc:1685] finished
0709 13:03:44.567157 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.624966 (+ 57809us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9454,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":72,"spinlock_wait_cycles":12437760,"thread_start_us":478854,"threads_started":1,"wal-append.queue_time_us":561595}
I20260709 13:03:44.378037 10546 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:44.529759  8238 leader_election.cc:403] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:44.533845  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 207688us
I20260709 13:03:44.347565 10564 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.551038 10579 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.551724 10222 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:44.556547 10426 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.385835 10499 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.629730  8195 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:44.632231  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:44.519073 10575 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:44.479343 10576 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:44.518157 10334 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:44.660578 10579 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.548789  9936 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:44.500514  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 80811.5us
I20260709 13:03:44.652578  8274 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:03:44.653816  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 235506us
I20260709 13:03:44.660684 10499 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.664004  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:44.668169  8199 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:44.654168  9787 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7.
I20260709 13:03:44.540872 10452 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.552050 10307 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.627677 10580 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:44.673419 10334 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:44.673605 10580 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.673862 10452 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.655356 10450 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.675802 10452 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.656787 10222 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:44.675645 10580 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.659137 10498 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.659435 10564 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.633023 10372 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:44.624320  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 168657us
I20260709 13:03:44.554112 10292 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.618227 10540 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.649394 10560 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.666575  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.683544  8198 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:44.684376  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.685417  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:44.686147  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.671931  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:44.632980 10568 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:44.677023  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.655828 10449 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.525038 10572 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.678316 10334 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:44.681509  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 87401.5us
I20260709 13:03:44.677202 10557 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.688259  8196 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:44.669806 10426 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:44.691108  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 368194us
I20260709 13:03:44.663339 10582 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.632050 10502 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.693830  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:44.682380 10372 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:44.703581 10426 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.712848 10372 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.710027 10588 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:44.713863 10588 consensus_queue.cc:1243] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:44.714105 10372 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.714306 10588 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:44.681263 10389 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:03:44.697034  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.714672 10588 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:03:44.714983  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.704754  9786 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.670104 10379 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:44.696147 10334 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.717116 10534 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.718366 10537 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.697754 10449 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.720822 10449 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.721783 10588 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.722496  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:44.723067 10588 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.723387 10572 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.723950 10572 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.724372 10572 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.693385 10307 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:44.726063  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65768.9us
I20260709 13:03:44.707705  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.694796  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:44.696424 10281 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:44.708542 10452 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:44.708250 10582 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.709012  8805 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:44.709466 10358 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:44.710004 10504 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 2.248s	user 0.005s	sys 0.024s
I20260709 13:03:44.710573 10549 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:44.710832 10583 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:44.711390 10294 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.711865 10579 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.699160 10554 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.716109 10552 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.726027  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.784513  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.785065  8807 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:44.785970  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.786484  8807 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:44.787204  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.788177  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:44.711476 10567 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:44.727968  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.789621  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.790145  8273 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:44.790922  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.791496  8273 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:44.729266 10584 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:44.730329  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1661) took 1044 ms. Trace:
I20260709 13:03:44.769448 10499 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:44.731573  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.776026 10328 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.738674  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:44.794021  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 55430.9us
I20260709 13:03:44.794471 10426 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.746040 10502 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:44.794672  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:44.838181  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.753782 10544 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.676705 10222 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:44.754842 10517 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 2.244s	user 0.006s	sys 0.015s
W20260709 13:03:44.721684 10519 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 2.261s	user 0.006s	sys 0.040s
W20260709 13:03:44.681833  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 52793.7us
I20260709 13:03:44.707168  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:44.765564  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:44.753984 10513 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 2.046s	user 0.009s	sys 0.016s
I20260709 13:03:44.757491 10307 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.780695  8806 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:44.764523  8808 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:44.795047  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.863148  8274 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:44.863937  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.864499  8274 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:44.865265  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.865496  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1283) took 1114 ms. Trace:
I20260709 13:03:44.793596  8268 raft_consensus.cc:2410] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:44.801410  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:44.778483 10488 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:44.858659  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:44.838603 10294 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.769554 10373 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:03:44.861987  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.860997  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.866434  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.866789  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:44.872740  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:44.873149  8273 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:44.873241  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.848101  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.872838  8806 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:44.793844 10328 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.850986  8802 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:44.875625  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.846556 10555 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:44.876158  8809 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:44.876447 10555 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:44.876603 10328 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.876919 10555 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.876159  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.878633  8809 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEARNER]: Advancing to term 6
I20260709 13:03:44.774339 10379 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.882931 10379 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.862824 10222 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.885687  8809 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:44.889014 10555 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.891757 10334 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.890043 10397 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:44.892812 10397 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:44.893988 10397 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.863986 10307 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.896423  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 541) took 3218 ms. Trace:
I20260709 13:03:44.896852  8803 rpcz_store.cc:276] 0709 13:03:41.677798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.690236 (+ 12438us) service_pool.cc:224] Handling call
0709 13:03:42.014950 (+324714us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:42.015168 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.015546 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.015577 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.016085 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.336374 (+320289us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:42.339711 (+  3337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.352410 (+ 12699us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.753473 (+2401063us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:44.896174 (+142701us) raft_consensus.cc:1685] finished
0709 13:03:44.896207 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.896358 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1112,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":9566464,"thread_start_us":270049,"threads_started":1,"wal-append.queue_time_us":585552}
I20260709 13:03:44.840090 10550 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:03:44.781812 10586 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:03:44.889544  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:44.902654  8805 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:44.906195 10555 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.916324 10527 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:44.917546 10590 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:44.890183 10546 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.922739 10553 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:44.923192 10553 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:44.924036 10553 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.925211 10553 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.932227 10572 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:44.894824 10582 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:44.940905 10197 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.001s
I20260709 13:03:44.840410 10568 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.954798 10545 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:44.955209 10545 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:44.952004 10527 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:44.956005 10545 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:44.957239 10545 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:44.774436  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79701.5us
I20260709 13:03:44.726999  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1715) took 1174 ms. Trace:
I20260709 13:03:44.771234  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:44.990216  8121 rpcz_store.cc:276] 0709 13:03:43.552614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.552715 (+   101us) service_pool.cc:224] Handling call
0709 13:03:43.553001 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.764802 (+211801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.764830 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.764866 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:43.764898 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.726800 (+961902us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540028afd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:44.726840 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.726948 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486694656}
W20260709 13:03:44.992419  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 221095us
W20260709 13:03:44.996265  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 201537us
I20260709 13:03:44.997905  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 221) took 3363 ms. Trace:
I20260709 13:03:44.703955  8198 pending_rounds.cc:85] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 1
I20260709 13:03:44.759188  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:44.865943  8265 rpcz_store.cc:276] 0709 13:03:43.751045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.753894 (+  2849us) service_pool.cc:224] Handling call
0709 13:03:43.754103 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.231325 (+477222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.231360 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.231847 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.454359 (+222512us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:44.454410 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.454471 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.865279 (+410808us) raft_consensus.cc:1685] finished
0709 13:03:44.865300 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.865438 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16212,"raft.queue_time_us":17690,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":3093,"thread_start_us":573224,"threads_started":2,"wal-append.queue_time_us":280664}
I20260709 13:03:44.792459  8266 rpcz_store.cc:276] 0709 13:03:43.686769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.686964 (+   195us) service_pool.cc:224] Handling call
0709 13:03:43.687234 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.738885 (+ 51651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.738915 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.738954 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:43.738994 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.730126 (+991132us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b5400189554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:44.730169 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.730277 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118394240}
I20260709 13:03:44.942549 10334 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.028070  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:44.998361  8117 rpcz_store.cc:276] 0709 13:03:41.633819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.674367 (+ 40548us) service_pool.cc:224] Handling call
0709 13:03:41.674633 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.674929 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.674954 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.917701 (+242747us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2c00000f48. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:03:41.918065 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.091722 (+173657us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:42.122182 (+ 30460us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.190579 (+ 68397us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b1800208ea0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:03:42.190757 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.190825 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.709502 (+2518677us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:44.997150 (+287648us) raft_consensus.cc:1685] finished
0709 13:03:44.997197 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.997588 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125960,"prepare.queue_time_us":47467,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":28,"raft.queue_time_us":68779,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":30360,"spinlock_wait_cycles":114401920,"thread_start_us":173316,"threads_started":1,"wal-append.queue_time_us":448790}
I20260709 13:03:45.010061  8808 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:03:45.012437  8274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44548
I20260709 13:03:45.029656 10553 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:45.030444  8198 pending_rounds.cc:107] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:03:45.030637 10527 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:45.031724  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1288) took 1166 ms. Trace:
I20260709 13:03:45.032255  8197 rpcz_store.cc:276] 0709 13:03:43.864610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.864748 (+   138us) service_pool.cc:224] Handling call
0709 13:03:45.030426 (+1165678us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:45.030801 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.031211 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.031235 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:45.031291 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:45.031332 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.031396 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.031485 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19558784}
I20260709 13:03:45.030120  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1263) took 2955 ms. Trace:
I20260709 13:03:45.033855  8271 rpcz_store.cc:276] 0709 13:03:42.075060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.075164 (+   104us) service_pool.cc:224] Handling call
0709 13:03:42.075634 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.254921 (+179287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.254958 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.255405 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.414276 (+158871us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:42.414314 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.414383 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.661907 (+2247524us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:45.029508 (+367601us) raft_consensus.cc:1685] finished
0709 13:03:45.029545 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.029910 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11966,"raft.queue_time_us":192225,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":10819,"spinlock_wait_cycles":68125440,"thread_start_us":132712,"threads_started":1,"wal-append.queue_time_us":200229}
W20260709 13:03:45.035513  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 182851us
I20260709 13:03:45.025439  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:45.030004  8274 raft_consensus.cc:606] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:45.037523  8274 raft_consensus.cc:614] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:45.040575  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1658) took 1389 ms. Trace:
I20260709 13:03:45.041589 10197 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.043896  8269 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:45.029002  8199 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:45.020191 10307 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.046300  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:45.047102  8198 raft_consensus.cc:2889] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.052368  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:45.058604 10397 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:44.839355  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1690) took 1120 ms. Trace:
I20260709 13:03:45.059108 10397 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:45.059692 10397 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.060249 10441 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:45.060707 10441 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.061070 10441 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.061573 10553 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:45.061761 10334 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:45.063230 10553 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.029659  8808 pending_rounds.cc:85] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 5
I20260709 13:03:45.064507  8808 pending_rounds.cc:107] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:03:45.064810  8808 raft_consensus.cc:2889] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.065544 10481 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:45.066298 10527 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:45.066849 10527 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:45.068302 10527 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:45.070200  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.070609 10527 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.071301  8274 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:45.072754  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.063768 10334 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:45.069073 10585 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.059595  8193 rpcz_store.cc:276] 0709 13:03:43.719301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.719397 (+    96us) service_pool.cc:224] Handling call
0709 13:03:43.719644 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.762996 (+ 43352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.839160 (+1076164us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54001eb9d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:44.839306 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98286464}
I20260709 13:03:45.048925  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:45.041117  8272 rpcz_store.cc:276] 0709 13:03:43.651293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.651443 (+   150us) service_pool.cc:224] Handling call
0709 13:03:43.651777 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.652123 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.652149 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.652582 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.342103 (+689521us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:44.342144 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.342211 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.040007 (+697796us) raft_consensus.cc:1685] finished
0709 13:03:45.040062 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.040356 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34208,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":9335,"thread_start_us":646296,"threads_started":1,"wal-append.queue_time_us":853816}
I20260709 13:03:45.087679 10585 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.090680 10585 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.091679  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:45.094650  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 92399.7us
I20260709 13:03:45.095582 10542 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:45.096493 10543 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:45.096691 10542 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.108381  8810 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:45.097509 10542 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.109948  8237 leader_election.cc:400] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7.
I20260709 13:03:45.111613 10542 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.109460 10307 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.112920  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:45.113106  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.114179  8193 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:45.115716  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:45.116276  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.117491  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46633us
I20260709 13:03:45.117038  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.082641 10334 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:45.122869 10390 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.123739 10390 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.111573  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:45.117609 10502 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.129705  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.129462 10545 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:45.131268  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.131388 10545 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.132107 10558 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.132830  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.133841  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.133919 10334 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.135603 10334 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.136880  8116 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:45.138316  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.139561  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.140317  8116 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:45.135757  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:45.141691  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.142700  8117 raft_consensus.cc:2410] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:45.142556  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.143651  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.143884  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.144424  8117 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:45.144639  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.145959  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.146744  8120 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:45.146971  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.145113  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.147531  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.147735  8124 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:45.069682 10605 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:45.097492 10543 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.142489  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.132737  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.148147  8120 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:03:45.391849  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.260170  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 187789us
I20260709 13:03:45.203238  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:45.260468  8193 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
W20260709 13:03:45.161629  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.290138  8118 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:45.391566  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:45.287528  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.141211  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.201716  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:45.405156  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.405985  8807 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:45.190745  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:03:45.188239  8071 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:45.195748  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.199576  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:45.196461  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 85116.4us
W20260709 13:03:45.414379  8071 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:03:45.194943  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:45.418186 10287 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:45.418642 10287 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:45.418962  8810 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:45.419011 10287 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.420163  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:45.420361  8272 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:03:45.420676  8272 pending_rounds.cc:85] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:03:45.420780  8274 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.421654 10550 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:45.196856 10598 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:03:45.395112 10600 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:03:45.131425  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.415800  8122 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:45.129981 10502 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.422982 10390 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.426856  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:45.428493  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.126627 10197 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.196851 10307 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:45.415241  8071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:45.333528 10480 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.288941  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:43.361717  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.430466  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.430806  8125 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:45.188750 10553 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.244s
I20260709 13:03:45.480943  8118 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 2.
I20260709 13:03:45.481966 10553 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:45.482494 10553 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:45.188539 10590 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.308s
I20260709 13:03:45.434268 10543 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.435703 10515 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:45.487757 10553 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.440796  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 309) took 2565 ms. Trace:
W20260709 13:03:45.430994  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 235531us
I20260709 13:03:45.488745 10588 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:45.489250 10588 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:45.489450  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.490376 10588 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.491671 10588 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.491905  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:45.441538 10570 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:03:45.442704  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 95385.3us
I20260709 13:03:45.444991 10558 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:45.445655 10585 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:45.446498 10581 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:45.446890 10550 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.447320 10582 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.447180 10605 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.450181  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.451023 10568 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.504645 10568 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.507241 10568 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.432387  8268 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:45.451877  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:45.452980  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.509851 10222 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.509557 10582 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.510242 10222 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.510593 10222 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.511919 10605 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:45.453187  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.453339  8266 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.513473 10515 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:45.513967 10515 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:45.286568 10481 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.514349 10515 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.514555 10585 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:45.453783  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 263185us
I20260709 13:03:45.516620 10585 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.501825 10581 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.454421  8116 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:45.454494 10307 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:45.521005 10307 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.454905  8194 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.502069 10550 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.527380 10481 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.424430  8272 pending_rounds.cc:107] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 13:03:45.529196  8272 raft_consensus.cc:2917] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 13:03:45.453953 10545 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.429106 10502 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.520494 10581 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.535394 10582 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.536334  8193 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:45.460995 10441 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.434369 10514 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.537206 10514 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.537685 10514 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.538573 10441 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.462046  9936 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:45.467236 10397 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.446434  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:45.470790  8274 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:45.432565  8197 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:45.472970  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.432610  8267 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:45.482731  8118 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:45.487360 10590 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:45.488772  8270 rpcz_store.cc:276] 0709 13:03:42.875575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.875690 (+   115us) service_pool.cc:224] Handling call
0709 13:03:42.875977 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.491771 (+615794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.440427 (+1948656us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400211454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:45.440641 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458791680}
I20260709 13:03:45.499464  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.501281  8123 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:45.489168 10553 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:45.503819  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 347851us
I20260709 13:03:45.513602 10558 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.455225  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:45.529436 10481 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.535635  8272 raft_consensus.cc:2889] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.542649  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:45.550470  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.550536  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 95474.5us
W20260709 13:03:45.551012  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.551278  8194 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:45.548485  8020 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.552943  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.557087  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.555181  8117 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:45.557736  8807 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:45.544158 10590 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:45.562196  8266 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:45.549734 10527 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.552856  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.561316  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:45.564862  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:45.568169  8122 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:45.550613 10390 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:45.572211 10565 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:03:45.581907  8196 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:45.582423 10564 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:03:45.582962  9936 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.584342 10590 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.591106  8195 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:45.579406 10334 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:45.617481  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:45.618963  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.620029 10334 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.620471 10334 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:45.622260  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.623891  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.624589  8806 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:45.626219  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.632164 10588 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.634192  8117 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:45.639508 10222 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.588413 10287 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.648026  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.670914  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.585006 10515 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.651775 10564 consensus_queue.cc:1243] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:45.584897 10550 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.644052 10588 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:03:45.672850 10590 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.673476 10570 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:45.714396 10555 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:45.714833 10555 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.715186 10555 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.715639  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.717674 10379 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.717752  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.718169 10379 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.718570 10379 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.721478  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:45.722182  8805 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:45.722400 10287 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.724370 10550 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.715134 10334 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.726444 10514 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.727607 10334 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.728483 10514 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.729157 10570 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:45.730155 10570 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.732268  8193 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:45.737856 10372 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:45.750753 10379 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.759136  8020 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 5, now has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:45.757237  8021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 165) took 10623 ms. Trace:
I20260709 13:03:45.766568 10515 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.768028  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:45.769100  8089 connection.cc:256] RPC call timeout handler was delayed by -1.5902968829999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:03:45.687165 10222 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.706836 10481 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:45.772486  9936 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.731724 10564 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.767944 10558 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.776630  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.776139  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.781213  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.814963  8120 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:45.802045  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 84379.1us
W20260709 13:03:45.810671  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.776117  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.775709 10555 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.814756  8020 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 4 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:45.821322  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.821973  8124 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:45.827111  8118 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:45.827836  8117 raft_consensus.cc:2368] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6.
I20260709 13:03:45.828588 10334 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:45.829198 10334 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.830906 10543 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:45.831857  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:45.832401  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:45.833491  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:45.834133  8270 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:45.831254 10334 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.832487  8273 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:45.778713  8021 rpcz_store.cc:276] 0709 13:03:35.133882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.134054 (+   172us) service_pool.cc:224] Handling call
0709 13:03:45.757007 (+10622953us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:41.101667 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:41.129835 (+ 28168us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:41.129870 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:03:41.129888 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:41.154139 (+ 24251us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:41.154211 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:41.154247 (+    36us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:41.204539 (+ 50292us) tablet.cc:701] Row locks acquired
0709 13:03:41.204555 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:03:41.204686 (+   131us) write_op.cc:270] Start()
0709 13:03:41.204794 (+   108us) write_op.cc:276] Timestamp: P: 1783602221204646 usec, L: 0
0709 13:03:41.204811 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:03:41.206492 (+  1681us) log.cc:844] Serialized 4705 byte log entry
0709 13:03:41.894808 (+688316us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800321820. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:03:41.956922 (+ 62114us) op_driver.cc:464] REPLICATION: finished
0709 13:03:42.591396 (+634474us) write_op.cc:301] APPLY: starting
0709 13:03:42.624523 (+ 33127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:42.741793 (+117270us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:42.741830 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:42.883056 (+141226us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:42.883299 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:03:42.883346 (+    47us) write_op.cc:312] APPLY: finished
0709 13:03:42.883629 (+   283us) log.cc:844] Serialized 83 byte log entry
0709 13:03:42.883778 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:42.883918 (+   140us) write_op.cc:454] Released schema lock
0709 13:03:42.883959 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:42.884317 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:42.884344 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35865,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":564526,"apply.run_cpu_time_us":4212,"apply.run_wall_time_us":350884,"num_ops":11,"prepare.queue_time_us":404528,"prepare.run_cpu_time_us":16124,"prepare.run_wall_time_us":137171,"raft.queue_time_us":60059,"raft.run_cpu_time_us":57511,"raft.run_wall_time_us":311164,"replication_time_us":751964,"spinlock_wait_cycles":32070784,"thread_start_us":783526,"threads_started":4,"wal-append.queue_time_us":25733,"wal-append.run_cpu_time_us":12515,"wal-append.run_wall_time_us":2084530}]]}
I20260709 13:03:45.838917 10555 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.811340 10481 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.839659 10481 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.840927  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.843269  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 300) took 1086 ms. Trace:
I20260709 13:03:45.843634  8191 rpcz_store.cc:276] 0709 13:03:44.757212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.764806 (+  7594us) service_pool.cc:224] Handling call
0709 13:03:44.765086 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.769550 (+  4464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.769580 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.770010 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.202141 (+432131us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b18004636c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:03:45.564130 (+361989us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:45.564197 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.566915 (+  2718us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.842906 (+275991us) raft_consensus.cc:1685] finished
0709 13:03:45.842926 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.843117 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209317,"raft.queue_time_us":9996,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10482,"spinlock_wait_cycles":102525184,"thread_start_us":341750,"threads_started":1,"wal-append.queue_time_us":1055999}
I20260709 13:03:45.825682 10441 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.846050 10441 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.848193 10441 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.825613 10542 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:45.849285 10542 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.851397 10542 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.825435 10372 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.852167 10372 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.852509 10372 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.858417  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:45.851563  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 305) took 1086 ms. Trace:
I20260709 13:03:45.832442  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:45.823262  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.860255  8196 rpcz_store.cc:276] 0709 13:03:44.765450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.449148 (+683698us) service_pool.cc:224] Handling call
0709 13:03:45.552213 (+103065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.587420 (+ 35207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.851360 (+263940us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540002a8d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:45.851485 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236049792}
I20260709 13:03:45.867246  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:45.829222  8020 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 3 to 4, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.868710  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.836860  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:45.869899  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58366.8us
I20260709 13:03:45.869971  8192 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:45.870687  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:45.870785 10527 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:45.895192  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 77319.6us
I20260709 13:03:45.896934  8020 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 5, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.912384  8200 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.917436  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.918356  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.894500 10527 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.870973  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.897428 10581 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.932919  8020 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:45.934978 10497 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.026s	sys 0.018s
W20260709 13:03:45.935325 10497 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.027s	sys 0.018s
I20260709 13:03:45.936199  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.937433  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.939519 10372 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.940673  8193 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:45.942279  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:45.929178 10581 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.950024 10605 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:45.906589 10564 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.930563 10550 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:45.958835 10568 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.962311  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:45.965310 10558 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:45.966274  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:45.967790 10372 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.969898 10379 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.972291 10502 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.925562 10307 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:45.985546 10307 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:45.986346  8268 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:45.981794  8192 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:45.987489 10558 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.987861 10558 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.990829  8811 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:45.991827 10481 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.992558 10502 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.978655 10605 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.993861 10481 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:45.994601 10605 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:45.952306  8020 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.994979  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:45.995970  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 3, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:45.997752  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:45.997967  8020 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.998935  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:45.999487  8123 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:46.001046  8119 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:46.002771  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.003504 10605 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:46.003899 10605 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:46.004280 10605 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:45.997996  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:46.008008  8118 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:45.974035 10550 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:46.009845 10550 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:46.014878 10564 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.015667 10558 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:45.975732  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:46.017928  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.019093  8195 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:45.999480  8020 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:46.024610  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 82417.5us
I20260709 13:03:45.956236 10581 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.003645  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.027755  8123 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:46.028291  8200 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:46.024609  8020 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 3 to 4, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:46.058590  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 566748us
W20260709 13:03:46.062376  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58796.4us
W20260709 13:03:46.058019 10553 consensus_meta.cc:287] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:03:46.067274  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:46.064038  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.068455  8122 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
W20260709 13:03:46.071825  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.083386  8775 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:46.066812 10564 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:46.088837  8020 catalog_manager.cc:5697] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 5, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:46.086135  8121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.019s	sys 0.040s
I20260709 13:03:46.092288  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:46.060880 10527 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:46.091164  8121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.020s	sys 0.040s
I20260709 13:03:46.073909 10379 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:46.088222 10197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.018s	sys 0.041s
W20260709 13:03:46.103320  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 483553us
I20260709 13:03:46.091120 10502 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:46.104213  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 269574us
I20260709 13:03:46.090690 10564 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:46.096475 10379 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:46.115018  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.115531  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.118088  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.134828  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.141779  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:46.111002 10197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.019s	sys 0.041s
I20260709 13:03:46.144806  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.147876  8020 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 3, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.150170  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.153095  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.131949 10564 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.156421  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.158579  8193 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:46.143500 10379 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.157624  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.143918 10542 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:46.159659  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 572011us
I20260709 13:03:46.168452  8195 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:46.170226 10582 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:46.171924  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58458.8us
I20260709 13:03:46.177963  8020 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 3 to 4, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.168022  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:46.186437  8193 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:46.157109 10307 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:46.192493  8271 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.157043 10441 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:46.200675  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:46.208490  8195 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:46.203043  8020 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.198370 10582 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:46.224802  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 136347us
I20260709 13:03:46.232366  8020 catalog_manager.cc:5697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.235993 10550 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.220427 10553 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:46.191860 10605 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.237613 10497 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:46.238503 10629 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:46.238926 10553 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:46.239056 10629 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.239907 10553 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.244325 10605 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:46.246174 10619 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:03:46.246802 10605 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:46.251121  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50521.4us
I20260709 13:03:46.252516  8271 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:46.253427  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1666) took 1114 ms. Trace:
I20260709 13:03:46.253787  8121 rpcz_store.cc:276] 0709 13:03:45.138588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.455983 (+317395us) service_pool.cc:224] Handling call
0709 13:03:45.456487 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.456962 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.456996 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.458066 (+  1070us) log.cc:844] Serialized 556 byte log entry
0709 13:03:46.094521 (+636455us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:46.094558 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.094619 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.253155 (+158536us) raft_consensus.cc:1685] finished
0709 13:03:46.253173 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.253319 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":636041,"threads_started":1,"wal-append.queue_time_us":718319}
I20260709 13:03:46.255340  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:46.264611  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:46.209239 10542 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.247349 10627 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:46.225044 10307 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.264186 10222 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:46.273355  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45878.5us
I20260709 13:03:46.275332 10222 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:46.276355 10222 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.277173 10515 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:46.281430  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.282485 10627 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.282883 10542 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:46.284466 10627 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:46.284695  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.271553 10527 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:46.286796 10555 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:46.287442 10555 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.288003  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.288829  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.285041 10609 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:46.289959  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.290874  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.292189  8271 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:46.292507  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.289624  8270 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:46.290274  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.303376  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.303833  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.308020  8267 raft_consensus.cc:2368] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7.
I20260709 13:03:46.287142 10441 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.313550  8272 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:46.291404 10307 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:46.314644  8269 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:46.289325 10555 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:46.292165 10609 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:46.319797  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.326624  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.338207  8200 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.327633  8091 leader_election.cc:400] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:03:46.339452  8091 leader_election.cc:403] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:46.328426 10633 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:03:46.328740 10441 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.307741 10497 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:46.329867  8805 raft_consensus.cc:1217] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-6.8]   Dedup: 6.8->[]
I20260709 13:03:46.343626  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.338277  8270 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:46.354988  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:46.314317 10527 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:46.360989 10497 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.364593  8273 raft_consensus.cc:2393] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:46.367749 10197 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:46.368110 10648 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.368650 10648 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:46.368445 10197 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.369040 10648 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.419893 10515 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:46.512315 10581 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:46.369683 10502 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.514763  8197 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:46.514552 10502 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:46.412312  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 84812us
I20260709 13:03:46.511204  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:46.487428  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 132515us
W20260709 13:03:46.487264  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63056.3us
I20260709 13:03:46.422254 10441 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:46.369788  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.380165  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.380473  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.463352  8200 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:46.370755  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.487068  8272 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:46.506729  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.370162 10642 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.518453  8271 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:46.353120 10555 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.525491  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.522702  8270 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:46.522766  8269 raft_consensus.cc:2393] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:46.526386  8266 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:46.363797  8805 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:03:46.524137 10555 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.513787 10515 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.360209 10553 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:03:46.531554  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.532665  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.531880  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.535878 10502 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.536330 10581 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.537873  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.512215 10497 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.508307 10197 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:46.540028  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.418881 10397 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.419309 10645 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:46.419719  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:46.469310 10609 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.522547 10642 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.544672  8091 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:46.358256 10379 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.534067  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:46.546973 10617 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.390s	user 0.004s	sys 0.000s
I20260709 13:03:46.550493  8091 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:46.551527 10543 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.551903 10543 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.552049  8804 raft_consensus.cc:2393] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:46.422052 10564 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:46.552222 10558 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.552345 10542 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.552800 10542 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:46.553197 10542 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.554379 10564 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.556465 10550 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.558348 10515 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.559207 10625 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:46.559640 10625 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:46.560238 10648 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.560549 10625 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.548614  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.549000  8269 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:46.562837  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.634094  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.548034  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.563663  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:46.689854  8272 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:46.561978  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 555) took 1444 ms. Trace:
I20260709 13:03:46.688647  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:46.578612  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.691639  8807 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:46.589694  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.576820  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.575165  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.690905  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.574282  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.573787  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 326) took 1116 ms. Trace:
I20260709 13:03:46.693313  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.690829  8811 rpcz_store.cc:276] 0709 13:03:45.121558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.125498 (+  3940us) service_pool.cc:224] Handling call
0709 13:03:45.141730 (+ 16232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.991226 (+849496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.561688 (+570462us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54004d7bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:46.561899 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936662784}
I20260709 13:03:46.703832  8267 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:46.695050  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 68625.6us
I20260709 13:03:46.704504  8197 raft_consensus.cc:2393] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:46.590287  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.706574  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.577788  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:46.695458  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:46.694149  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 117407us
I20260709 13:03:46.708596  8271 raft_consensus.cc:2376] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7. Re-sending same reply.
I20260709 13:03:46.711692  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.712296  8272 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.711949  8194 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:46.708223  8810 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:46.581187  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.590950  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:46.693133  8273 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:46.705681  8268 rpcz_store.cc:276] 0709 13:03:45.457292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.508269 (+ 50977us) service_pool.cc:224] Handling call
0709 13:03:45.508604 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.986741 (+478137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.573554 (+586813us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001c2fd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:46.573725 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098230144}
I20260709 13:03:46.719084  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:46.719852  8193 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:46.708482  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:46.729743  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:46.730522  8196 raft_consensus.cc:2368] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6.
I20260709 13:03:46.731976  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:46.733866  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 170284us
W20260709 13:03:46.737912  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.600520 10642 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.740262  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.619436 10543 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.731098  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.739564  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.580075 10648 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:46.780547  8198 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:46.591138 10565 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.741487  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.735316  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.567025 10590 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.694845 10609 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:46.742671  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:46.807344  8199 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:46.743402  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:46.748353 10628 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.750168 10379 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:46.752943  8265 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:46.772701 10625 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.564194 10555 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:46.719300 10334 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.753587 10636 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:46.757798 10645 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.874547  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:46.875974  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:46.782084  8196 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:46.782985  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:46.765969  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.842662  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:46.795704  8267 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:46.884444  8268 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:46.886734 10646 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:03:46.887297  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:46.887627  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:46.830879 10553 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:03:46.714190 10197 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:46.773221  8197 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:46.799294  8271 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 2.
W20260709 13:03:46.803243  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 441472us
I20260709 13:03:46.796355  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:46.579725 10629 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:46.765832 10307 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:46.780445 10624 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:46.796070  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:46.836265  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 129607us
I20260709 13:03:46.890165  8811 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:46.780606 10545 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:03:46.803409  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:46.917692  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:46.842147 10334 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:46.807565 10497 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:03:46.890134 10502 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:46.831693 10542 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.883399 10590 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:46.878767 10565 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:46.912415 10653 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:03:47.086668  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 495742us
W20260709 13:03:46.958515  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 227885us
I20260709 13:03:46.837225 10628 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.219970  8806 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:47.228904  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.229717  8808 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:47.070183 10629 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.099084  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:47.097572  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 301276us
I20260709 13:03:47.249823  8807 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:47.253285  8120 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:03:46.899014 10197 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:46.954227  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.207590  8269 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:03:47.287747  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.185045  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:47.335543 10652 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:03:47.346482 10645 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:46.922468 10650 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.425s
I20260709 13:03:47.172051 10636 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:47.348322 10636 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:47.355468  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.372400  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.381850  8803 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:47.382611  8197 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:46.936295 10334 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.935532 10307 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:47.384706  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.058410  8805 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 2.
I20260709 13:03:47.399688  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:47.406709  8120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1733) took 1411 ms (client timeout 1724 ms). Trace:
W20260709 13:03:47.407104  8120 rpcz_store.cc:269] 0709 13:03:45.994965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.997431 (+  2466us) service_pool.cc:224] Handling call
0709 13:03:46.577680 (+580249us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:47.406563 (+828883us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400298e54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:47.406660 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514182784}
I20260709 13:03:47.290544 10197 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.422746  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.364156 10628 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:47.426152  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.431982  8775 leader_election.cc:400] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6.
I20260709 13:03:47.432370  8775 leader_election.cc:403] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:47.433058  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.433631  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
W20260709 13:03:47.433787  8272 consensus_meta.cc:287] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.000s
I20260709 13:03:47.434111  8272 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:47.435860  8195 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:47.401607 10287 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:47.404238 10588 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:47.439378  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:47.446431  8811 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:47.444350 10588 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.453509 10588 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:47.457624 10588 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:47.458060 10588 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.447515 10628 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:47.459096 10628 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.458436 10588 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.437302  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.439663 10222 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:47.441150 10397 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:47.472749  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:47.469079 10555 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:47.449474 10287 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.442948 10514 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.483857  8195 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:47.492686  8199 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:47.444725 10502 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:47.450053 10582 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.495703  8195 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:47.458500 10542 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:47.519063  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 132044us
W20260709 13:03:47.520108  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 107264us
I20260709 13:03:47.521951  8091 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.546706  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.547392  8200 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:47.548862  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:47.549690  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 95600us
I20260709 13:03:47.505843 10565 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:47.551290  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.550078  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.553970  8803 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:47.551193  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 650993us
I20260709 13:03:47.557905  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:47.558459  8272 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:47.561030  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:47.561775  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:47.457554 10307 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.567843  8272 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:47.563834  8195 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:47.565074  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 175783us
I20260709 13:03:47.572669  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.574158  8196 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:03:47.578626  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.579032  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.514647 10582 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.575181  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.558353 10553 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:47.565665 10609 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.003s
I20260709 13:03:47.559268 10590 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:47.589829  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.566617 10565 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:47.568823 10555 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:47.606691  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.606881  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.614097  8777 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:47.615888  8195 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.620595 10628 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:47.610263 10555 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:47.623868  8192 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:03:47.624454 10555 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:47.625114  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 130372us
I20260709 13:03:47.628969  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:47.629868  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:47.631421 10671 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:47.631830 10671 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:47.632172  8272 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:47.633713 10397 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:47.632169 10671 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.633832 10497 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:47.637079  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.604399 10590 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:47.634574 10397 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.616215 10670 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:47.653995  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 67478.6us
I20260709 13:03:47.656028 10287 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:47.656714  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49905.1us
I20260709 13:03:47.657516  8091 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.660288  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:47.661140  8809 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:03:47.662083 10654 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:47.663326  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 331) took 1197 ms. Trace:
I20260709 13:03:47.612253 10669 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:47.663743  8266 rpcz_store.cc:276] 0709 13:03:46.465683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.543236 (+ 77553us) service_pool.cc:224] Handling call
0709 13:03:46.549858 (+  6622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:46.550217 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.550249 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:46.550720 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.841999 (+291279us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:46.842039 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.842097 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:47.663151 (+821054us) raft_consensus.cc:1685] finished
0709 13:03:47.663168 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.663275 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7276,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":290918,"threads_started":1,"wal-append.queue_time_us":999505}
I20260709 13:03:47.644042 10397 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:47.671219  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 151395us
W20260709 13:03:47.673316 10659 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:47.669736 10648 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:47.647538 10590 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.674300  8088 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:47.675347 10565 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:47.665369 10655 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:03:47.607559 10502 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:47.693444 10625 consensus_meta.cc:287] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.810s	user 0.004s	sys 0.005s
I20260709 13:03:47.693990 10625 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.694929 10625 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:47.695250 10625 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:47.696347 10625 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.697497 10625 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.698081 10590 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:47.683501 10621 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:47.657298 10555 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.654687  8805 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:47.674459  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1678) took 1309 ms. Trace:
W20260709 13:03:47.691536 10642 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.860s	user 0.007s	sys 0.003s
I20260709 13:03:47.700212  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.610646 10662 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:03:47.676818 10334 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.714581  8274 rpcz_store.cc:276] 0709 13:03:46.365420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.370871 (+  5451us) service_pool.cc:224] Handling call
0709 13:03:46.516328 (+145457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:46.548836 (+ 32508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.548867 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:46.586379 (+ 37512us) log.cc:844] Serialized 556 byte log entry
0709 13:03:46.958738 (+372359us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:46.958777 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.958845 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:47.674277 (+715432us) raft_consensus.cc:1685] finished
0709 13:03:47.674296 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.674407 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":371995,"threads_started":1,"wal-append.queue_time_us":926291}
W20260709 13:03:47.717671  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 293070us
I20260709 13:03:47.718973  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:47.719973  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:47.662321 10588 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.684466 10676 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:47.706784 10621 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:47.716310 10514 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6.
I20260709 13:03:47.737658  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:47.737918  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 82619.8us
I20260709 13:03:47.737140  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:47.740403  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:47.743257  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 69032.7us
I20260709 13:03:47.745817  8121 raft_consensus.cc:2368] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
I20260709 13:03:47.684736 10670 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.743955  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.735774 10307 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:03:47.752732  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:47.750663  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:47.720016 10642 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.758618  8117 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:47.762882 10674 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:47.763991  8122 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:03:47.755833 10543 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.948s	user 0.009s	sys 0.001s
I20260709 13:03:47.755633 10676 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:47.772315  8120 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:47.773028  8194 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:03:47.753279 10680 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:47.774091  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.776568  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.736053 10669 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:03:47.780236  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46104.6us
I20260709 13:03:47.782968 10621 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.784292 10621 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.776432 10675 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:47.785745 10675 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.786118 10675 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.767091 10542 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:47.786634  8166 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.568s (SENT)
I20260709 13:03:47.789726  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:47.758383 10658 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:03:47.796996  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.803316  8166 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.594s (SENT)
I20260709 13:03:47.775990 10680 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:47.805286 10680 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.790794 10542 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.811347 10542 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.775769 10662 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:47.769858 10629 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:47.814688 10670 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:47.815213 10629 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:47.815565 10629 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:47.816282 10629 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.826565  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:47.827200  8120 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.814524 10334 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:47.834272  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 90399.8us
I20260709 13:03:47.834959 10588 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:47.835218  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:47.836984 10669 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:47.838718  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:47.839728  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:47.840248  8195 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.801755 10650 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.817337 10629 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.772120 10543 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.848318  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:47.849252  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 83169.4us
I20260709 13:03:47.855975  8195 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:47.856819  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:47.858688 10670 raft_consensus.cc:1064] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:47.856738  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.863742 10397 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.865674 10545 raft_consensus.cc:1064] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:03:47.869880  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:47.870946  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.871301  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.871611  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.871924  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.004652  8121 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:47.872129  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.872722  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.873320  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.873965  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.875070  8120 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:48.007197  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.007980  8119 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:03:47.875267  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.830209 10658 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:47.849619  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:47.895833 10681 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:48.037443  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:47.898226 10543 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:47.876179 10642 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:47.903952 10334 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:47.910555  8166 leader_election.cc:336] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.573s (SENT)
I20260709 13:03:47.927054  8266 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:47.927737  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.047839  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:47.929220 10671 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.928390  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:47.935410 10675 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:47.949460  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1692) took 1411 ms. Trace:
W20260709 13:03:47.952242 10581 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:03:47.954485  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.057758  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.955350 10582 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:47.952260  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.059170  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 106971us
I20260709 13:03:48.059763  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.060330  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:47.963804 10648 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:47.971220 10379 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:47.970891 10680 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:47.973384 10197 consensus_meta.cc:287] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 13:03:47.974056  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1335) took 1382 ms. Trace:
I20260709 13:03:48.005761  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:48.021020  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 118594us
W20260709 13:03:48.021808  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.035758  8120 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:48.003082  8124 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:48.008996  8122 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:48.037195 10658 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:47.899343  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:48.037328  8810 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
W20260709 13:03:48.038560  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.039343  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:47.928383  8811 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:48.053922  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.068236  8123 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:48.048213  8274 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:48.056016  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 282311us
I20260709 13:03:48.071633  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:48.057271  8271 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:48.057196  8270 rpcz_store.cc:276] 0709 13:03:46.538138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.777828 (+239690us) service_pool.cc:224] Handling call
0709 13:03:47.949238 (+1171410us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400405bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:47.949395 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842278272}
I20260709 13:03:48.054322  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.072294  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.073415  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.068890  8194 rpcz_store.cc:276] 0709 13:03:46.591122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.741608 (+150486us) service_pool.cc:224] Handling call
0709 13:03:46.798015 (+ 56407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.773378 (+975363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.973806 (+200428us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b540035c5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:47.974000 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241898880}
I20260709 13:03:48.075482  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.066090  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.067694  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 157164us
I20260709 13:03:48.074882  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:48.076759  8166 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.755s (SENT)
I20260709 13:03:48.077174  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:48.077318  8125 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.067217  8267 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:47.976915 10542 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.058633 10527 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.079664  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.084192  8123 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:48.080339  8121 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:48.056710 10629 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.090961  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.091130  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:48.091522  8118 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:48.092810  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.079082  8803 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEARNER]: Advancing to term 6
I20260709 13:03:48.079876  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.085035  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.084918  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.094537  8123 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.094617  8195 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:48.094604  8124 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.066092 10502 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.065546 10648 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.065330 10379 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:48.102936  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.062594 10692 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:48.091158  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.078187 10515 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:48.074867 10543 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:48.124665  8123 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:48.126152  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.113548 10671 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.126945  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.074456 10197 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.099642 10629 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.141662  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.080574 10307 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:03:48.144572  8274 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:48.143115  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.117215 10497 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.101583 10636 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.148013  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.148908  8123 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:48.097455 10527 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.103813 10334 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:03:48.127825 10515 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:48.141258 10609 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.152710  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:48.144109 10397 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.142246 10642 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:48.160439  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:48.157586  8272 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.164722 10658 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.166467 10515 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.167799  8122 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:48.174696  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.146936 10287 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.179721  8116 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:03:48.186874  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 84029.4us
I20260709 13:03:48.188879  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.143162 10543 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.163381 10650 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.200837  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.178004 10686 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:48.203152  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 137144us
I20260709 13:03:48.204218  8163 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.149024 10582 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:48.205681  8123 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:03:48.202384  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.205200  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.207083  8803 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:48.208041  8123 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:03:48.208379  8774 leader_election.cc:400] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
I20260709 13:03:48.209528  8123 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.210574  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:48.196820 10658 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.203284 10686 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.220669  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.223522  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.228025 10675 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.229427 10542 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.230777 10197 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:48.231997 10527 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.232595  8200 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:48.232941 10582 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:48.233296 10582 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:48.233650  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:48.234511 10658 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.244158  8274 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:48.235174  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 315) took 1667 ms. Trace:
I20260709 13:03:48.237177 10543 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.239032 10699 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:48.239923 10629 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.215988 10588 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:48.215270 10222 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:03:48.240425 10379 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.241372 10679 raft_consensus.cc:2764] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:03:48.242089  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.206089 10609 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:48.242693 10686 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.242908  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.243438 10197 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.194074 10642 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.248852  8117 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:48.254803  8125 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:48.213449 10307 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.216626 10650 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.267161  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.268087  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.253521  8192 rpcz_store.cc:276] 0709 13:03:46.567790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.567919 (+   129us) service_pool.cc:224] Handling call
0709 13:03:46.568249 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.624321 (+1056072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.233832 (+609511us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b54000139a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9fdc0 00007fbd24d2ba02 00007fbd24d27dd6 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:03:48.234910 (+  1078us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001ecdd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:48.235106 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388661760}
I20260709 13:03:48.271764  8120 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:48.272567  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:48.284925  8124 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:03:48.316329  8803 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:48.243997 10645 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.288707  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.303599  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.271946 10684 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:48.308130  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65286.7us
I20260709 13:03:48.272573 10658 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:48.314688 10666 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.370417  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:48.307921 10197 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:48.367481  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.403244 10658 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.382184  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:48.403673 10645 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.370079  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:48.400724  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:48.404733  8266 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.302523 10680 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.404064  8267 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.312973 10670 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.376278 10555 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.400657  8119 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.408834 10555 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.412098  8267 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:48.413008  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:48.414060  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:48.414620  8267 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:48.412222  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:48.415342  8198 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:48.416328 10555 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.403517  8805 raft_consensus.cc:2393] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:03:48.384338  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.418171  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.419020 10699 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:48.405397  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.419499 10699 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:48.420819 10699 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.311949 10701 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.422971 10701 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.423329 10701 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.425078  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.291405 10671 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:48.425963  8270 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.314468 10650 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:48.426098 10671 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:48.404465  8804 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:48.426530 10650 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.427207 10671 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.316213 10379 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.374715  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.404389 10197 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.434145  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:48.243952 10582 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.415486  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.435796  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.440600  8267 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:48.443619  8119 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:48.426383  8266 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:48.447844  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:48.450654  8266 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:48.451633  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48137.3us
I20260709 13:03:48.448861  8271 raft_consensus.cc:2368] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:03:48.446689  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.455806 10650 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.460183  8192 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:48.377029  8197 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:48.468887 10684 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:48.468075 10650 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.469951 10684 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.471619 10684 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.453058  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:48.476187  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.477277  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.484709  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.490278  8270 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:48.315632 10565 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.494867  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.499480  8091 leader_election.cc:400] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:03:48.499894  8091 leader_election.cc:403] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:48.506177  8267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22c63c7039644c089bf014466158ac6b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:48.506709  8267 raft_consensus.cc:606] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:48.507014  8267 raft_consensus.cc:614] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:48.475816 10555 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:48.475976 10674 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:48.517539  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 81801.4us
I20260709 13:03:48.491840 10691 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:48.494160 10334 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.524122  8266 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:48.495846 10636 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.525792  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.420699 10686 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.505527 10680 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:48.492343 10675 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:03:48.520037 10687 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.519280 10674 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:48.531208  8267 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:48.533229  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 328054us
I20260709 13:03:48.514732 10582 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.536746  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:48.538093 10648 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.541428 10668 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:03:48.555002  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.555580  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.545821  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.548441  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:48.556790  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.557371  8118 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:48.558480 10527 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:48.558990 10527 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:48.559779 10527 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.562002 10334 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:48.563129 10334 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:48.563462 10334 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:48.564239  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.564579  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.564924  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:48.565080  8193 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.565483  8194 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:48.565601  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:48.566188  8804 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.567714  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.568068 10697 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:48.568464 10697 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:48.568795 10697 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.569664  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:48.570326  8198 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:48.530669 10680 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.507788 10565 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.541949 10704 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:48.578327  8193 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:48.573478  8197 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:48.574245  8119 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:48.575773  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:48.578115  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.530095 10555 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:48.587191  8810 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:48.589108  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.590675  8803 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.589058  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.571664 10658 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.576720 10680 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.576366 10379 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:48.607348  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.610793  8193 pending_rounds.cc:85] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 6
I20260709 13:03:48.608281 10704 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:48.613045 10718 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.575430 10674 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.616986 10555 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.619799  8193 pending_rounds.cc:107] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:03:48.625067  8237 connection.cc:256] RPC call timeout handler was delayed by -1.4507205500000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:03:48.625548  8193 raft_consensus.cc:2889] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.623795  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:48.625587  8237 connection.cc:256] RPC call timeout handler was delayed by -1.4291205499999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:03:48.626502  8237 connection.cc:256] RPC call timeout handler was delayed by -1.3004205500000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:03:48.626905  8237 connection.cc:256] RPC call timeout handler was delayed by -1.2671205500000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:03:48.627226  8237 connection.cc:256] RPC call timeout handler was delayed by -1.258120550000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:03:48.619500  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:48.628746  8273 raft_consensus.cc:606] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.627558  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1906205500000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 13:03:48.600827 10710 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:48.629532  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1132205499999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:03:48.586310 10650 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:03:48.633366  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0943205500000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:03:48.633001  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 52003us
W20260709 13:03:48.635694  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0547205500000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:03:48.636052  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0034205499999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:03:48.636476  8166 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.513s (SENT)
I20260709 13:03:48.636922  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:48.638366  8123 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:48.620635  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:48.620874 10642 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.564260 10334 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:48.643788  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.646310  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52133.9us
I20260709 13:03:48.648079  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.656975  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.587406 10692 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:03:48.613221 10588 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:48.631732 10379 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:48.633158 10710 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:48.648368 10674 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.688906 10718 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:48.692092  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.691927  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55370.5us
I20260709 13:03:48.627856 10581 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:03:48.692898  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:03:48.694500  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 70819.7us
I20260709 13:03:48.696156  8163 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.681208 10642 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:48.706228  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43923.4us
W20260709 13:03:48.706140  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69684.5us
W20260709 13:03:48.707191  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.579s (SENT) [suppressed 39 similar messages]
W20260709 13:03:48.707787  8166 leader_election.cc:336] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.626s (SENT)
I20260709 13:03:48.701733 10679 raft_consensus.cc:2764] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:48.719269  8237 leader_election.cc:400] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6.
I20260709 13:03:48.690251 10197 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.722113  8237 leader_election.cc:403] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:48.719925 10712 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.717963  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:48.712499 10334 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.712080 10686 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:48.716979 10581 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:48.737538 10581 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:48.727173 10642 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:03:48.738440 10581 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.739567 10581 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.719942 10707 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:48.734714  8166 leader_election.cc:336] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.656s (SENT)
I20260709 13:03:48.736063  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:48.742178  8267 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.737025  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:48.743183  8273 raft_consensus.cc:606] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.743553  8273 raft_consensus.cc:614] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:48.743935  8166 leader_election.cc:336] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.699s (SENT)
I20260709 13:03:48.726905 10710 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.748600 10697 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:48.750571 10716 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:48.741242 10701 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.726717 10708 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:48.727905 10648 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:48.762010  8122 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:03:48.763723  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.738082 10728 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.766155  8274 raft_consensus.cc:2368] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:03:48.761808  8805 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
W20260709 13:03:48.774398 10720 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:48.775009  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:48.775420 10702 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6.
I20260709 13:03:48.776655 10197 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.709878 10704 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:48.777634  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 66545.6us
I20260709 13:03:48.778554  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:48.779078  8273 raft_consensus.cc:606] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.779387  8273 raft_consensus.cc:614] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:48.780889  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.786408  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.790587  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.790971  8089 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.792502  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 103690us
I20260709 13:03:48.770963 10728 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.769582 10708 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:48.794577  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:48.802307 10701 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.775619  8805 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:48.735296 10712 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.756584 10379 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.789937 10624 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:48.810057  8166 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.538s (SENT)
I20260709 13:03:48.811980  8166 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:48.815109  8166 leader_election.cc:336] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.575s (SENT)
I20260709 13:03:48.798182 10197 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:48.815552  8166 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:48.798552 10728 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.816367 10527 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.817564  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.818491  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:48.819305  8166 leader_election.cc:336] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.686s (SENT)
I20260709 13:03:48.819711  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:48.761829 10718 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:48.824430 10727 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:48.832196  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:48.831857  8198 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:03:48.815295 10692 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:48.808272 10642 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:03:48.808240 10707 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:03:48.849648 10732 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.846729  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.825448 10625 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.875013  8195 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:48.840471 10727 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:48.852841 10648 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:48.911441  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:48.857686 10701 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:03:48.847396 10687 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:03:48.908720 10702 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.881052 10197 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.905908 10670 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:03:48.938228  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 118907us
I20260709 13:03:48.934965 10697 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:48.833587 10708 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:48.954644  8166 leader_election.cc:336] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.749s (SENT)
I20260709 13:03:48.955964  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:48.920343 10648 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.958048 10695 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:48.962745 10686 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.968758 10686 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.969097 10686 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:48.969888 10738 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:03:48.958505 10625 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:03:48.979291 10648 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:49.029814 10712 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:49.030681  8116 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:03:49.031940  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1687) took 1111 ms. Trace:
I20260709 13:03:49.032523  8117 rpcz_store.cc:276] 0709 13:03:47.920206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.114397 (+194191us) service_pool.cc:224] Handling call
0709 13:03:49.031779 (+917382us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54000744d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:49.031879 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31268096}
I20260709 13:03:49.033527 10677 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:49.033942 10677 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:49.034749 10677 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:48.983450 10686 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.035769 10677 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.036787  8200 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.036928 10686 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:49.037608 10645 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:49.038635  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.039160 10609 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:49.039515 10609 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:49.040324 10609 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:48.984874  8166 leader_election.cc:336] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.828s (SENT)
I20260709 13:03:49.041554  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:48.988758  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1320) took 1064 ms. Trace:
I20260709 13:03:49.042500  8272 rpcz_store.cc:276] 0709 13:03:47.924666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.925986 (+  1320us) service_pool.cc:224] Handling call
0709 13:03:47.926310 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.170044 (+243734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.988549 (+818505us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400154354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:48.988705 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531492736}
W20260709 13:03:48.989373  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 78101.2us
I20260709 13:03:48.990948 10662 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:49.065624  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 102107us
I20260709 13:03:48.995869  8118 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:49.002219  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:49.013649 10733 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:48.936728 10222 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:03:49.019259 10545 raft_consensus.cc:1068] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Unable to promote non-voter 17c126976afd40d9a398d13a5ddd222f: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }.
  Pending config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.020265 10680 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.020880  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:49.022360  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:49.024032  8197 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:49.025647  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.026329  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:49.090003  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 391) took 1628 ms. Trace:
I20260709 13:03:49.047050  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:49.090440  8811 rpcz_store.cc:276] 0709 13:03:47.454049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.454493 (+   444us) service_pool.cc:224] Handling call
0709 13:03:49.082572 (+1628079us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54006117d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:49.082681 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631601024}
I20260709 13:03:49.090584  8810 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:48.980454  8120 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:49.043394 10609 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.065929 10645 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.960382 10661 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:49.080819  8166 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.911s (SENT)
I20260709 13:03:49.087430  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:48.985064 10728 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:49.035246 10713 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.493s	user 0.001s	sys 0.000s
I20260709 13:03:49.106014  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:49.093688  8273 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:48.932489 10702 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:49.110548  8166 leader_election.cc:336] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.199s (SENT)
I20260709 13:03:49.111040  8166 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:49.113147  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 66176.7us
I20260709 13:03:49.113987  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:49.113461  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 154711us
W20260709 13:03:49.116919  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.065490 10671 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:49.121300  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:49.112468  8810 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:49.100531 10661 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:49.110018 10697 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:49.127903  8163 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.753s (SENT)
I20260709 13:03:49.129887  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:49.126380  8804 consensus_meta.cc:287] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.002s
I20260709 13:03:49.119131 10581 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.152169  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.152837  8271 raft_consensus.cc:2368] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:49.153668  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.154147  8271 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.155534  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.152715  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.156407  8267 raft_consensus.cc:2410] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:03:49.157366  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.158417  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.159442  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.159981  8267 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:49.160763  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.156374  8266 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:49.161659  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.161964  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.161134  8271 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:49.150821  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.131034 10701 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:49.136224 10691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.024s
I20260709 13:03:49.151346  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.125012 10695 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:49.165931  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.198880  8272 raft_consensus.cc:2368] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7.
I20260709 13:03:49.199654  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.200634  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.166402  8273 raft_consensus.cc:2368] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:49.201820  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.167718  8265 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:49.168483  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.202306  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:49.203167  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.204216  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.131268 10747 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:49.171159 10730 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:49.171463 10734 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:03:49.209050 10725 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:49.209458 10725 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:49.210249 10725 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.211419 10725 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.213433 10747 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:49.214354 10747 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:49.172132 10742 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:03:49.177556 10661 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.180393 10680 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:49.184864  8266 raft_consensus.cc:2393] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:49.187747 10590 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:49.188727 10527 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.190038 10728 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:49.146690  8804 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:49.148715 10625 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:49.190857  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:49.191623 10702 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:49.169379 10691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.025s
I20260709 13:03:49.205297  8269 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:49.202327  8273 raft_consensus.cc:2376] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6. Re-sending same reply.
I20260709 13:03:49.218719  8121 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:49.218796  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.229969  8265 raft_consensus.cc:2368] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7.
I20260709 13:03:49.229183  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.230587  8273 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:49.205590 10582 consensus_meta.cc:287] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.644s	user 0.004s	sys 0.006s
I20260709 13:03:49.165010  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.236634  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.206413 10730 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:49.240356  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 49574us
I20260709 13:03:49.240934  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.241024  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.220940  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:49.231508  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.222249 10590 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:49.273860  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1330) took 1044 ms. Trace:
I20260709 13:03:49.274072 10590 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.275233 10590 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.276101 10671 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:49.276643 10671 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.277743  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.279232 10671 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:49.283450  8805 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:49.284548 10628 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.284997 10628 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.234896 10661 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.226800  8267 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:03:49.296427  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.230693  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.242255  8119 raft_consensus.cc:2368] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7.
I20260709 13:03:49.243230  8807 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.241554  8273 raft_consensus.cc:2376] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6. Re-sending same reply.
I20260709 13:03:49.247264 10729 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.247556 10565 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:49.248129  8088 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:49.249866 10680 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:49.227944 10691 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:49.252214  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.302517  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:49.313946  8809 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.256448  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 405) took 1306 ms. Trace:
I20260709 13:03:49.258085 10730 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.321859  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:49.259110  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:49.265645  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.323658  8166 leader_election.cc:336] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.687s (SENT)
I20260709 13:03:49.324060  8166 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.266029 10555 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:49.268326  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:49.269973  8118 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:49.271605 10625 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:49.271452 10695 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.273216  8270 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:49.273022 10702 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:49.274224  8274 rpcz_store.cc:276] 0709 13:03:48.245074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.245812 (+   738us) service_pool.cc:224] Handling call
0709 13:03:49.273696 (+1027884us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400076554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:49.273810 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040550144}
I20260709 13:03:49.234226 10685 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:03:49.289117  8123 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:49.297646  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.296777  8267 raft_consensus.cc:2376] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7. Re-sending same reply.
I20260709 13:03:49.299834  8807 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.295415  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:49.253526 10751 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.318465  8200 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.286928 10628 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:49.321008  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 72958.4us
I20260709 13:03:49.317010  8806 rpcz_store.cc:276] 0709 13:03:47.950036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.950171 (+   135us) service_pool.cc:224] Handling call
0709 13:03:49.083295 (+1133124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.089817 (+  6522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.089847 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.099355 (+  9508us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:49.099397 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.099452 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.256295 (+156843us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54006117d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:49.256394 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":210,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11151,"spinlock_wait_cycles":2605206784}
I20260709 13:03:49.326424  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.327073  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:49.350457  8192 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:49.328130  8270 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:49.329281  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:49.338135  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.338526  8271 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
W20260709 13:03:49.302227  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.341543  8265 raft_consensus.cc:2368] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:49.253398 10397 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:03:49.345944  8197 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:49.353097  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.320011 10680 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:49.422461  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:49.598228  8166 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.753s (SENT)
W20260709 13:03:49.428848  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 74378.9us
I20260709 13:03:49.605515  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.484512  8269 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:03:49.606469  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:49.606642  8166 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.991s (SENT)
I20260709 13:03:49.424271  8118 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.607846  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.475348  8192 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:49.608527  8271 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:49.609412  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.408833  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.491027  8121 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:49.614596  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1336) took 1308 ms. Trace:
I20260709 13:03:49.523900  8809 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
W20260709 13:03:49.363469  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.458961  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.618381  8166 leader_election.cc:336] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.862s (SENT)
I20260709 13:03:49.618788  8166 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.409643  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:49.605856  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.444082  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:49.408833  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:49.620078  8195 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.443702  8199 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:49.580267  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 232441us
I20260709 13:03:49.619232  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.622383  8808 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:49.534689 10710 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:49.623642 10725 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:49.630528  8271 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:49.617982 10727 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.630851 10725 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:49.631865 10725 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:49.425261  8270 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.625684  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.629511 10648 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.635058  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.635196  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.621665  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.636325  8118 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:49.616429  8267 raft_consensus.cc:2376] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3. Re-sending same reply.
I20260709 13:03:49.328533 10555 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:49.606881  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.331378 10642 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.633054  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:49.343389 10718 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:49.498311 10758 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:03:49.606952 10680 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.631881  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.616991  8268 rpcz_store.cc:276] 0709 13:03:48.306233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.306693 (+   460us) service_pool.cc:224] Handling call
0709 13:03:48.313286 (+  6593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.317973 (+  4687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.318000 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.178644 (+860644us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b2c0012ef08. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:03:49.178986 (+   342us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.301358 (+122372us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:49.339424 (+ 38066us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.604377 (+264953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.604465 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.604506 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:49.614376 (+  9870us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.614534 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17592,"prepare.queue_time_us":30177,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2658,"raft.queue_time_us":131097,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":18857,"spinlock_wait_cycles":17726208,"thread_start_us":122034,"threads_started":1,"wal-append.queue_time_us":231780}
I20260709 13:03:49.641456  8270 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.641628  8269 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.640276  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:49.647670  8273 raft_consensus.cc:2376] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4. Re-sending same reply.
I20260709 13:03:49.425812 10726 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:49.648042  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.636556  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:49.658515  8118 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:49.645298  8271 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:49.660080  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:49.663589  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.581727 10650 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 13:03:49.676329  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.666118  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.710661  8195 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
W20260709 13:03:49.722040  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.723016  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.723062  8118 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:49.728390  8270 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:03:49.728796  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 66541.3us
I20260709 13:03:49.733338  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:49.661329  8194 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:49.730594  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:49.719702  8274 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:49.734840  8270 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:49.737540  8267 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:49.742148  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.742966  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.746361  8124 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:49.649313 10677 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:49.752730  8117 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:49.411588 10751 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.662524 10609 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.662681 10582 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:49.644726 10706 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:03:49.493628 10625 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.639909 10648 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:49.749603 10703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:03:49.772387  8273 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:49.743770 10708 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.655953 10222 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:03:49.463945 10691 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.655817 10588 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:03:49.778488 10545 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.773684 10590 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.786405 10736 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:49.724066 10728 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:03:49.806315  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:49.808943  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:49.809552  8118 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.653882 10718 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.723837 10628 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:03:49.805001  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:49.812978  8121 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.642845 10725 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:49.777087 10756 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:03:49.810417  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:49.775074 10642 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:49.813824  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:49.814742  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.815008  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:49.816751  8120 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:49.772994 10609 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.774892 10582 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.826821  8124 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:49.828512  8120 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:49.812537 10679 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:49.761371 10555 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.822492 10736 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:49.810482 10671 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:03:49.808251 10545 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.846997 10582 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:49.810873 10590 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.850698  8121 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:49.825153 10727 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:49.852835 10680 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.820000 10527 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:03:49.862666  8199 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:49.822335 10642 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.867558  8118 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:49.863224 10679 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:49.873332 10555 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.929689 10679 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:49.931439 10736 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:49.920325 10565 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:49.933809 10751 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:49.986042  8091 leader_election.cc:400] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:03:49.986382  8091 leader_election.cc:403] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:03:49.988884  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.939997 10565 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:49.989277  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:49.991628  8806 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.988054  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:49.984557 10760 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:03:49.989300 10754 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:03:49.996517  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:49.998662  8810 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.995573  8774 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.988986 10731 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:03:50.004443  8807 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:50.005055  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:50.006675  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 273388us
I20260709 13:03:49.990990 10648 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.007314  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:49.992918 10588 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:49.996492 10287 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:50.007939  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.010596  8125 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:50.008355  8122 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:50.012612  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.013720  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:49.998240 10590 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:50.017877  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.001760 10751 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.004158 10689 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.002956  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:50.019987 10514 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:50.024155  8199 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:50.019263  8810 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:50.026185  8806 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:50.005728 10700 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:50.006153  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:50.044212 10685 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.044696 10685 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.046644 10685 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.008035 10718 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.027428 10731 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:50.047689 10731 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.048005 10731 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:50.026914 10565 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.050814 10565 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.053990 10750 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:50.054708 10750 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:50.055459 10730 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.057060 10765 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:50.062692  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 59809.5us
I20260709 13:03:50.011705 10609 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.017943 10287 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.039122 10514 consensus_queue.cc:1243] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:50.076617 10736 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:50.027915 10702 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:50.016283  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:50.084012  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 66179us
I20260709 13:03:50.088541  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.039703 10581 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:50.103936  8273 pending_rounds.cc:85] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 6
I20260709 13:03:50.105647  8273 pending_rounds.cc:107] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:03:50.105906  8273 raft_consensus.cc:2889] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:50.106438  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.107856  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 71575.8us
I20260709 13:03:50.069288 10765 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:50.078478 10287 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:50.113189  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 54233.1us
I20260709 13:03:50.023749 10588 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:50.114995  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.040903 10751 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.041401 10689 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.134861  8191 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:50.101722 10642 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.103121 10545 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.114009 10765 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:50.120858 10726 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:50.114439 10581 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.144840 10771 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.149205 10765 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.165452 10689 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.156600 10666 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:50.177107 10726 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.180886  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.181519  8200 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:50.184396  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:50.156060 10545 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:03:50.170145 10779 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:50.226536 10581 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.227303 10397 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:50.227716 10397 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.228048 10397 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.171664 10666 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:50.230089 10666 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.162225 10771 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.213860  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.236836  8198 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
W20260709 13:03:50.215584 10785 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:50.206904 10736 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.221588 10776 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:03:50.243417  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 154953us
W20260709 13:03:50.239949  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 130385us
I20260709 13:03:50.213189 10774 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.245170  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 128943us
I20260709 13:03:50.246460  8775 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:50.237879 10666 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.255666  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.261957  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.239768 10702 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:03:50.268230  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.269814  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.272045  8269 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:50.253166 10781 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.273180  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:50.275588  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.260119 10729 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.271893  8271 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:50.260589 10648 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:50.246050 10779 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:50.274585  8117 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:50.273530  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.290369  8266 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:50.265455 10780 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:50.292320  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.246048 10736 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.295251 10736 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.272188 10555 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:50.301456 10795 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.305974 10514 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:50.306808 10588 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.306589 10514 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.277626 10781 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.259281 10774 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.310675 10287 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.311069 10774 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.312377  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.312655 10287 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.314849  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:50.315623  8802 raft_consensus.cc:2393] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 3: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:50.316723 10795 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:50.317781 10680 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.318185 10779 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.321619 10702 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.310987  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.298741 10751 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.276515 10787 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:03:50.290096 10648 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.328112 10648 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:50.330469  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 353) took 1014 ms. Trace:
I20260709 13:03:50.309559 10514 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.330838  8194 rpcz_store.cc:276] 0709 13:03:49.315546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.408592 (+ 93046us) service_pool.cc:224] Handling call
0709 13:03:50.330315 (+921723us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b5400366854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:50.330418 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93697280}
I20260709 13:03:50.330618  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:50.289279 10729 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:50.333748 10763 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.493s	user 0.003s	sys 0.000s
I20260709 13:03:50.290231 10625 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:03:50.337747 10703 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:50.300513 10736 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:50.297931 10780 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.368399 10397 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.376578  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.377117 10780 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.338390 10793 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:50.337081 10731 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.334893 10729 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.342247  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:50.362772  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61831.7us
I20260709 13:03:50.403393  8269 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
W20260709 13:03:50.341938  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.405736  8163 leader_election.cc:400] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7.
I20260709 13:03:50.406116  8163 leader_election.cc:403] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:03:50.363169  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:50.373628 10736 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:50.378371  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 117960us
I20260709 13:03:50.405645  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.327165 10771 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.325058 10765 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.353089  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.309580 10781 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:50.402825 10706 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.413779  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.408560  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:50.413151 10710 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:50.409760 10736 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:50.413015 10582 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7.
I20260709 13:03:50.417068  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:50.433751  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.418530 10397 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:50.429713  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:50.505091  8194 raft_consensus.cc:2410] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:50.419001 10680 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.505817  8200 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.434109  8196 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:50.434468  8804 raft_consensus.cc:2410] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:50.415060 10703 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:50.436049 10798 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:50.436349  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.416509 10787 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:03:50.429782 10710 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.433961  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 552) took 1822 ms. Trace:
W20260709 13:03:50.514366  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 78098.3us
I20260709 13:03:50.514878 10781 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:50.516011 10765 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.510432 10648 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.555084 10731 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:50.555612 10791 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:03:50.556126 10648 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.419206 10779 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:03:50.417193 10706 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:50.519563  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.520426  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:50.566043  8267 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:50.566831  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.567358  8267 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:50.567318 10706 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:50.568181  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:50.568711  8267 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.524443  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.570174 10581 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:50.570755 10581 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.571286  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.571412  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:50.571878  8193 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:50.561821  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.572750  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.510672  8802 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:50.537030 10703 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.601864  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.603402  8116 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:50.610273  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:50.610554  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:50.546005  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.552726  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.558008  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:50.611670  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58996.1us
I20260709 13:03:50.611871  8116 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:50.559067  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:50.583513  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.560998  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.561640  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.562341  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.562387  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:50.556273 10806 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 13:03:50.573257  8274 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:50.125837  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.613389  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:50.617435  8266 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:50.570175  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.618042  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.618273  8125 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:50.618851  8274 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:50.552178 10710 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.574842  8200 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:50.578246  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.623567  8199 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:50.579156  8194 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:50.609535  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.616969  8269 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:50.617173  8265 raft_consensus.cc:2410] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:50.612039  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:50.613005  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54012.4us
I20260709 13:03:50.625551  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.607919  8089 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:50.627555  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.628252  8200 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:50.538479 10736 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.577790  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:50.826541  8191 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:50.573318  8197 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:50.827641  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:50.828186  8197 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:50.631289  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.828943  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1753) took 1164 ms. Trace:
I20260709 13:03:50.621805  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.630352  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:50.509775 10680 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.622728 10795 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:50.550282  8808 rpcz_store.cc:276] 0709 13:03:48.611445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.613388 (+  1943us) service_pool.cc:224] Handling call
0709 13:03:49.422280 (+808892us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:03:49.622174 (+199894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.630126 (+  7952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.433760 (+803634us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54004493d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:50.433907 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475859712}
I20260709 13:03:50.644508  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:50.641211  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:50.595170 10725 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.589274  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:50.857637  8805 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:50.652180  8267 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:03:50.858785 10808 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:50.564920 10730 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:03:50.859560 10730 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:50.859876 10730 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:50.612959  8193 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:50.656531  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.862687  8198 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:50.628407 10555 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:50.632186 10582 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:50.627367 10590 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:50.861268 10710 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.629655 10747 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:50.868355 10710 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.729792  8122 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.733088  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.870958  8195 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:50.645278 10780 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:50.871680 10780 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.871817  8124 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:50.872052 10780 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:50.752861  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.627202 10679 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:03:50.650341 10700 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:50.877244 10700 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.879930 10700 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.732537 10702 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:50.880528 10702 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.854928 10814 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:50.881755  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:50.882347  8267 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.882490 10702 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:50.758955  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.755779 10581 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:50.761322  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:50.884711  8802 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:50.765389 10222 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.885603 10222 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.886475 10680 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.887400  8197 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:03:50.862377 10731 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:50.888006 10781 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:50.861454 10625 raft_consensus.cc:2764] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:03:50.830530  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 200236us
I20260709 13:03:50.889516  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.891300  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:50.891870  8192 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:50.829259  8119 rpcz_store.cc:276] 0709 13:03:49.664344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.664847 (+   503us) service_pool.cc:224] Handling call
0709 13:03:50.631162 (+966315us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:50.828887 (+197725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5631360}
W20260709 13:03:50.843551  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 221793us
I20260709 13:03:50.855552  8125 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.894517  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:50.855986  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 214850us
I20260709 13:03:50.896338  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:50.858083 10628 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:50.897464  8808 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:50.897699 10679 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:50.888338 10731 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:50.898722 10628 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:50.899068 10793 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:50.899322 10685 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:50.899745 10685 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.899607 10747 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:50.900121 10685 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.898830 10814 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:50.900291 10747 consensus_queue.cc:1243] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:50.901892 10814 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.905555  8195 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:50.572284 10666 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:50.906612 10666 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:50.898682 10731 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.907436 10666 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:50.908569 10666 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.887537 10222 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.912375  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:50.894588  8091 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.860931 10730 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.913681  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.914064 10730 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.898252 10679 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:50.914772  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:50.914922 10784 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:50.915367 10784 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.915205 10679 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.915750 10784 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.916261  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:50.917188 10545 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:50.914103  8805 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:50.917678 10662 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:50.918910 10662 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:50.919490 10662 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:50.869218  8117 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:50.920017 10662 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:50.920644 10662 consensus_queue.cc:1243] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:50.921056 10662 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:50.923143  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.923569  8122 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:50.924201 10545 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.924598 10545 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.924598  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.871304 10736 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:50.926342  8191 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:03:50.938970  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:50.931356  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:50.911841  8125 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:50.940742  8197 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:50.942615  8122 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:50.945057  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:50.945797  8806 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:50.927157  8117 raft_consensus.cc:2410] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:50.932497  8124 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:50.936192  8267 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:03:50.948333  8123 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:03:50.949060  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:50.949870  8191 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:50.965286  8197 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:50.911768  8808 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:50.972219  8119 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:50.931963 10222 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:50.921334 10662 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:50.977829  8166 connection.cc:256] RPC call timeout handler was delayed by -1.128994328000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:03:50.930671 10781 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:51.007382  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:50.966703 10700 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:50.946772 10628 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:50.984601 10661 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.017019 10725 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:51.033701  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:51.020046  8805 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:51.031178 10680 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:51.059001 10680 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.060325 10780 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.025332 10661 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:51.044037  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.016569 10700 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:51.024298 10582 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.007207 10222 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.058332 10658 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:51.061259 10680 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.062794 10545 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.033177 10662 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.076510 10700 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.071559 10780 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.078081 10662 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:51.076444 10545 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.075762 10222 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:51.080585 10731 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.082096 10685 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.075285 10661 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.084793 10582 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.085438 10781 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.087373 10628 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.036283  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 275) took 1030 ms. Trace:
I20260709 13:03:51.100742  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:51.107848 10679 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:51.109479  8197 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:51.138851  8197 pending_rounds.cc:85] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 3
I20260709 13:03:51.110335  8191 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:51.139094  8197 pending_rounds.cc:107] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:51.139113  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:51.139725  8200 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:51.139506  8197 raft_consensus.cc:2889] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.110572  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1762) took 1298 ms. Trace:
I20260709 13:03:51.111780  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:51.112496  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.113322 10793 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:51.116333  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:51.117069  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:51.145254  8809 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:51.119192  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:51.057154 10725 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:51.130044  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.136072  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:51.137121  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69071.1us
I20260709 13:03:51.141177  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:51.143169  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:51.142052  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:51.136478  8121 rpcz_store.cc:276] 0709 13:03:50.006224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.006330 (+   106us) service_pool.cc:224] Handling call
0709 13:03:50.006642 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:50.010301 (+  3659us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:50.567353 (+557052us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b1800458080. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf 00007fbd24d42038
0709 13:03:50.645216 (+ 77863us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.843612 (+198396us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:50.909186 (+ 65574us) log.cc:844] Serialized 52 byte log entry
0709 13:03:50.909324 (+   138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:50.909375 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.909435 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.035999 (+126564us) raft_consensus.cc:1685] finished
0709 13:03:51.036089 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.036227 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24259,"prepare.queue_time_us":560060,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":29689,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":11333,"spinlock_wait_cycles":15636864,"thread_start_us":143808,"threads_started":2,"wal-append.queue_time_us":228452}
I20260709 13:03:51.141569  8123 rpcz_store.cc:276] 0709 13:03:49.813506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.813627 (+   121us) service_pool.cc:224] Handling call
0709 13:03:51.110422 (+1296795us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540026b1d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:51.110519 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552526592}
I20260709 13:03:51.146350  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:51.146708  8088 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:51.153175  8195 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:51.154208  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:51.154793  8200 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.156354  8804 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:51.158581  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:51.175721  8196 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:51.176244  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 168927us
I20260709 13:03:51.177541  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:51.178470  8118 raft_consensus.cc:2368] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:51.179301 10679 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.143667 10677 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:51.180088  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:51.182008  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:51.180909  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:51.184757  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:51.143723 10793 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:51.183221  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:51.183673  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 246025us
I20260709 13:03:51.185302  8267 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:51.194479  8272 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:03:51.196452  8267 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:51.196967  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:51.197599  8272 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.202504  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.203179  8268 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:51.188673  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:51.147019 10661 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.212327  8196 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:51.214774 10702 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:51.216460  8191 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:51.217300  8197 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:51.156591 10658 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:51.156725 10662 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:51.229373 10658 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:51.229803 10658 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.173722 10780 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:03:51.174134 10590 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.230130 10793 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.230924 10590 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.231333 10793 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:51.232788 10662 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.233204 10662 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:51.238260 10731 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.181283 10666 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:03:51.239313  8266 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:51.239672  8266 pending_rounds.cc:85] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 4
I20260709 13:03:51.239873  8266 pending_rounds.cc:107] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:51.240082  8266 raft_consensus.cc:2889] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.230484  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.248526  8272 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:51.259064  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:51.251981  8200 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:51.260397  8273 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:51.259701  8265 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:51.187479 10730 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:51.174809 10798 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:03:51.181751 10679 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.222134 10727 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:51.281297  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 98139.9us
I20260709 13:03:51.256605 10625 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:51.261096 10677 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:51.261677 10827 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:51.280192 10725 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.285454  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:51.734884  8273 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:51.736353  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.736922  8267 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:51.738555 10650 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.492420 10774 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:51.366837  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 181913us
I20260709 13:03:51.299710 10825 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:51.249193 10661 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.299371 10582 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.698022 10736 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:51.274189 10666 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:03:51.425849  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 206484us
I20260709 13:03:51.282016 10727 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:51.699159 10827 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:51.692351 10679 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:51.605911  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.764840  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:51.740967  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.766695  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:51.700292 10680 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:51.743837  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.767997  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:51.767657  8191 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:03:51.768891  8191 pending_rounds.cc:85] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 3
I20260709 13:03:51.769109  8191 pending_rounds.cc:107] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:51.769306  8191 raft_consensus.cc:2889] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.685652 10685 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.705247 10821 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:51.743533  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.771986  8268 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:51.713111 10731 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:51.716331  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.341219 10795 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:03:51.774427  8197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.029s
I20260709 13:03:51.372924  8019 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.325827 10832 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:51.719995 10787 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:51.272163 10662 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:51.723735 10784 consensus_meta.cc:287] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.006s
I20260709 13:03:51.242162 10695 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:51.724427 10590 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.727489 10767 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.729691 10781 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:51.519912  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 331151us
I20260709 13:03:51.307935 10625 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:51.673637  8775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.005s
I20260709 13:03:51.732357  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.739066 10650 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.759294  8270 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:51.747217  8273 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:03:51.764644  8090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.026s
W20260709 13:03:51.821313  8090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.026s
I20260709 13:03:51.765908  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:03:51.822055  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 56220.4us
I20260709 13:03:51.772518  8163 leader_election.cc:400] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
W20260709 13:03:51.823300  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58086.1us
W20260709 13:03:51.824779  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.688879  8265 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:03:51.776538  8197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.029s
I20260709 13:03:51.786980  8121 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.788437  8019 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:51.785493  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:51.826993  8266 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:51.797171  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 511756us
I20260709 13:03:51.828109  8166 leader_election.cc:400] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:51.786823  8195 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:51.798411  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:51.754940 10581 raft_consensus.cc:2764] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:03:51.771118 10727 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:51.816644  8775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.005s
W20260709 13:03:51.834205  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 682740us
I20260709 13:03:51.774843 10680 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.773531 10814 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:51.774173 10825 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:51.820271  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.774135 10736 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.787531 10833 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:51.695456 10658 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.782966 10787 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:51.837627 10648 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:51.802021 10784 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.819384 10679 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:51.862739  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:51.865134  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:51.864300  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:51.865909  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:51.842374  8019 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:51.879132  8125 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:51.879727  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:51.879483  8019 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 3, term changed from 3 to 4, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:51.869493  8270 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:51.801549 10555 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:51.878649  8123 raft_consensus.cc:2368] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7.
I20260709 13:03:51.854621  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:51.858708  8020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 280) took 13578 ms (client timeout 15000 ms). Trace:
I20260709 13:03:51.771354 10774 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.882601  8019 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 5 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:51.884733  8019 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:51.886407 10774 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:51.878589  8117 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:03:51.889245  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:51.783823 10731 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.894021  8119 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:51.803112 10832 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:51.783475 10788 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:03:51.893174  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:51.802913 10796 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:03:51.793733 10798 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:03:51.900416  8809 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:51.906955 10736 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.909104 10680 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.848892 10650 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.910594 10650 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:51.911039 10650 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.912473 10731 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.912853 10650 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:51.887042  8019 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 4, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.816013 10767 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.914043  8019 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.914921 10767 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.917518 10706 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.917992 10706 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.918435 10625 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.918380  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:51.920049  8775 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:51.799407 10582 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:03:51.921526 10829 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:51.921911 10829 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.888341 10581 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:51.922288 10829 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.923167 10662 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.871150 10833 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.835445 10730 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:03:51.924449  8266 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
W20260709 13:03:51.882625  8020 rpcz_store.cc:269] 0709 13:03:38.255758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.255995 (+   237us) service_pool.cc:224] Handling call
0709 13:03:51.834442 (+13578447us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:46.424166 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:46.439758 (+ 15592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:46.439818 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:03:46.439839 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:46.457880 (+ 18041us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:46.457954 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:46.457982 (+    28us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:03:46.459255 (+  1273us) tablet.cc:701] Row locks acquired
0709 13:03:46.459310 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:03:46.459485 (+   175us) write_op.cc:270] Start()
0709 13:03:46.459647 (+   162us) write_op.cc:276] Timestamp: P: 1783602226459426 usec, L: 0
0709 13:03:46.459674 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:03:46.460401 (+   727us) log.cc:844] Serialized 6604 byte log entry
0709 13:03:47.630900 (+1170499us) op_driver.cc:464] REPLICATION: finished
0709 13:03:47.651257 (+ 20357us) write_op.cc:301] APPLY: starting
0709 13:03:47.651371 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:47.651718 (+   347us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:47.651851 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:47.653631 (+  1780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:47.656441 (+  2810us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:03:47.656483 (+    42us) write_op.cc:312] APPLY: finished
0709 13:03:47.679482 (+ 22999us) log.cc:844] Serialized 113 byte log entry
0709 13:03:47.679698 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:47.679834 (+   136us) write_op.cc:454] Released schema lock
0709 13:03:47.679900 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:47.680288 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:47.680316 (+    28us) write_op.cc:454] Released schema lock
0709 13:03:47.692489 (+ 12173us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b540006bb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2532a 00007fbd24caaf14 00007fbd24caaec3 00007fbd24caae38 00007fbd24caadf3 00007fbd24caa0dc 00007fbd24cd3e16 00007fbd24cbbcbb 00007fbd24ca639d 00007fbd24ca9d75
Metrics: {"mutex_wait_us":292541,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":20051,"apply.run_cpu_time_us":4100,"apply.run_wall_time_us":29026,"num_ops":16,"prepare.queue_time_us":95160,"prepare.run_cpu_time_us":23339,"prepare.run_wall_time_us":454521,"raft.queue_time_us":156383,"raft.run_cpu_time_us":11559,"raft.run_wall_time_us":64482,"replication_time_us":1171075,"spinlock_wait_cycles":5860736,"thread_start_us":501275,"threads_started":4,"wal-append.queue_time_us":1008544,"wal-append.run_cpu_time_us":15963,"wal-append.run_wall_time_us":1213356}]]}
I20260709 13:03:51.925709  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:51.932591  8120 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:51.926342 10849 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:51.872291 10825 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:51.928371  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:51.941491  8121 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:51.854094 10838 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:03:51.855358 10836 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:03:51.893136  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:51.957041  8200 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:51.959751  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:51.917076 10727 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.966085  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:51.966786  8809 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:51.941258 10582 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.978078  8810 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:51.925778 10650 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:51.924240 10648 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:51.976579  8805 raft_consensus.cc:2410] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:51.974802  8019 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 5, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:51.927177 10833 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.951927 10671 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:51.942179 10849 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:51.985219  8019 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 5 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.954795 10628 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.995012 10842 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:51.988395  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:51.995608 10842 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.963661 10736 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:51.956830 10840 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:51.992617 10661 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:51.993083 10671 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:51.979070 10703 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:03:51.963454  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:51.993966  8810 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:51.922444 10581 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.857601 10827 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.941609 10787 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:51.962225 10837 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.026868  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 172300us
I20260709 13:03:51.995357 10628 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.269364  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:52.275364  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:52.275553 10781 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:52.064165 10736 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:52.271004  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.276280 10781 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.273623  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.064306 10287 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:52.059419 10854 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:52.278002 10854 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.278450 10781 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:52.231236  8273 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:52.279104 10628 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.252982  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.274709 10671 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.280514 10854 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:52.273818  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.282167  8122 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
W20260709 13:03:52.266240  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 269870us
I20260709 13:03:52.252794  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.283336  8119 raft_consensus.cc:2368] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:52.277289 10287 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.275864  8270 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
I20260709 13:03:52.230520 10851 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:52.276664  8120 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:52.284674 10851 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:51.997452 10849 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:52.287322 10851 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.123627  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:52.288486  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 306599us
I20260709 13:03:52.078292 10832 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.283236 10837 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.290199 10842 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:52.290446  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:52.292011  8119 raft_consensus.cc:2368] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:52.070746 10727 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.070230 10784 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.064498 10840 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:52.288188  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 164663us
I20260709 13:03:52.065580 10706 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.303503  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:52.291105  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 411405us
I20260709 13:03:52.307673  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.298527  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:52.308741  8122 raft_consensus.cc:2376] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3. Re-sending same reply.
I20260709 13:03:52.292779  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:52.310554  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:52.282969  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:52.326128  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:52.292474  8019 catalog_manager.cc:5697] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.296379  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:52.330807  8810 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:52.296907  8123 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:52.296346  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.077869 10658 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:52.336828  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.338388  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.327638  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:52.347122  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.351413  8019 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.280758 10781 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:52.266412 10853 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:52.293619 10582 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:52.357915  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.319834 10854 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:52.297611 10287 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.291213 10837 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.362023  8810 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:52.362468  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:52.339295 10836 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:52.359742  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.337570 10838 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:52.368697  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.325006 10765 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.339426 10787 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.354331  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.367710  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:52.372609  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45036.9us
W20260709 13:03:52.373397  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 81405us
W20260709 13:03:52.485456  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.017s	sys 0.042s
W20260709 13:03:52.485803  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.017s	sys 0.042s
I20260709 13:03:52.485189  8019 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:03:52.486033  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 628324us
I20260709 13:03:52.487685  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:52.488090  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.372787  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 89880.5us
I20260709 13:03:52.339504 10839 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:51.996495 10650 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.377522  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:52.514443  8809 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:52.490284  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.339422 10662 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:52.496748  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:52.515941  8193 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:52.370766 10779 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.510633  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 141910us
I20260709 13:03:52.373211 10851 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.366560 10658 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:52.353648 10729 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:03:52.524732 10851 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:52.519404  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:52.369187 10848 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:52.520438  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 152783us
I20260709 13:03:52.525211 10851 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.528546 10851 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:52.373783 10854 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:52.531864 10854 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:52.533921  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 90160.3us
I20260709 13:03:52.537325  8774 leader_election.cc:400] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7.
I20260709 13:03:52.537879  8774 leader_election.cc:403] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:52.276837 10736 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.539655  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:52.539932  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:52.478443 10730 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.539678  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:52.544956  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.545459  8200 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:52.381254 10858 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.482766 10838 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:52.506911 10795 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.551780  8193 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:52.553862  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:52.560966 10861 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:03:52.561136  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.558254 10666 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.507211 10856 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.561823 10666 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.562276  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.563226  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:52.563442 10829 consensus_meta.cc:287] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.001s
I20260709 13:03:52.554448  8121 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:52.546943  8119 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:52.366088 10781 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.563745 10666 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:52.484757 10765 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.564373 10666 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:52.564805 10666 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:52.361001 10788 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:03:52.554035 10779 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:03:52.563849 10829 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.566898 10781 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:52.567384 10779 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:52.567898 10829 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:52.568549  8196 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:52.568626  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1779) took 1324 ms. Trace:
I20260709 13:03:52.491442 10852 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:52.354857 10648 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.371381 10582 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.569613  8197 rpcz_store.cc:276] 0709 13:03:51.243842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.244018 (+   176us) service_pool.cc:224] Handling call
0709 13:03:51.244300 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.826353 (+582053us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:03:51.826381 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:51.826825 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:03:51.999620 (+172795us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:51.999659 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.999727 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:52.568440 (+568713us) raft_consensus.cc:1685] finished
0709 13:03:52.568458 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.568574 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":493484,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":306,"thread_start_us":740331,"threads_started":2,"wal-append.queue_time_us":524971}
I20260709 13:03:52.557163  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.369544 10625 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
I20260709 13:03:52.569059  8804 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:52.588124  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.539247 10796 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:52.366324 10853 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.610356  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.608125  8019 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:52.771479  8198 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:52.560240 10838 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.626540 10695 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:03:52.620154  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:52.785975  8197 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:52.561939 10836 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:52.611269 10844 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.629s	user 0.001s	sys 0.000s
I20260709 13:03:52.582655 10835 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:52.582510 10840 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:52.610684 10726 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:52.640300  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:52.559377 10730 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.621894 10729 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:52.610172 10839 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:52.641244  8196 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:52.810532  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.574698 10795 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.637060 10858 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.778506  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 238910us
W20260709 13:03:52.645418 10821 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.004s
W20260709 13:03:52.617081  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60006us
I20260709 13:03:52.817926  8774 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.640799 10852 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:52.643317 10527 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.787850  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.821952  8125 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
W20260709 13:03:52.790606  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 273247us
I20260709 13:03:52.823784  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:52.793056  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:52.796212  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.825729  8197 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:52.799693  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:52.801898  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 161645us
I20260709 13:03:52.811565  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.826619  8196 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:52.781560 10855 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:52.803122  8019 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66), now has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 5 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:52.816313  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:52.809768 10661 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:52.826864  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:52.799636 10873 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.799525 10869 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:52.840143 10864 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:03:52.840257 10869 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.796809  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:52.842366  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.849718 10796 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.849768 10852 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.855222  8122 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:52.857810  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:52.859030 10839 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.810038 10829 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:52.831193  8019 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.834357  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:52.869942  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:52.837231 10867 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:03:52.837095 10725 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:52.654233 10666 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.812114 10726 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.838871 10781 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:52.839329 10661 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:52.882120 10661 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.883229 10866 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.887518 10671 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:52.888064 10581 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:52.889035 10779 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:52.888778 10836 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.870885  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:52.872471  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:52.896311  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:52.878280 10781 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:52.879014 10725 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:52.880398 10830 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:52.881266  8805 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:03:52.841401 10862 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:03:52.829571 10865 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:52.892755  8019 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 4, term changed from 5 to 6, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to <none>, no longer has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:52.907747  8125 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:03:52.910321  8197 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:52.865856 10545 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:52.938424  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1776) took 1721 ms. Trace:
I20260709 13:03:52.936219 10545 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.942198 10545 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:52.815956 10729 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.949177  8019 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.952903  8019 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.938825  8118 rpcz_store.cc:276] 0709 13:03:51.217188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.217321 (+   133us) service_pool.cc:224] Handling call
0709 13:03:51.217667 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:51.695214 (+477547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.695242 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:51.695802 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 13:03:51.711442 (+ 15640us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:51.711480 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.711548 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:52.938205 (+1226657us) raft_consensus.cc:1685] finished
0709 13:03:52.938227 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.938363 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45889,"raft.queue_time_us":73837,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":25195,"thread_start_us":257268,"threads_started":2,"wal-append.queue_time_us":202107}
I20260709 13:03:52.831193 10527 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.924762  8197 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:52.906576 10677 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:52.912882 10830 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:52.962638  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 138933us
I20260709 13:03:52.964062  8019 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 4 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.932734 10628 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.905275 10876 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:52.979279  8019 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 6, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.992982  8019 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 5, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:03:52.994427  8019 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 5 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.828068 10858 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.909062 10706 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:03:52.908456 10779 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:03:52.959533 10582 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.011097  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:52.967000 10677 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.972695 10840 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:53.000319 10287 consensus_meta.cc:287] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.000s
I20260709 13:03:52.835842 10855 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.037890 10287 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.039033  8124 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:53.039499 10855 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:53.040675  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 147374us
W20260709 13:03:53.040745  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69982.8us
I20260709 13:03:52.837162 10873 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:52.999047  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.044010  8163 leader_election.cc:400] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:53.046109  8163 leader_election.cc:403] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:53.021801 10706 consensus_queue.cc:1243] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:53.052855  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.062268  8118 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:03:53.066632  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.045480 10825 consensus_meta.cc:287] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.080s	user 0.004s	sys 0.005s
I20260709 13:03:52.909389 10866 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.032279 10876 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:53.076704  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:53.042584 10677 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.058811 10700 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:53.076354  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.080065  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:53.081801  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:53.044520 10784 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:03:53.087137  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:53.040095 10287 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.000283 10628 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.058488 10582 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:53.084084 10848 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:53.053932 10855 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:53.036630 10650 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.115229  8166 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:53.129253  8166 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:53.090792 10882 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:53.087221 10779 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.083388  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.119272  8163 leader_election.cc:400] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:53.136821  8163 leader_election.cc:403] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:53.084455 10853 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.092053 10730 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:53.095407 10840 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.104072  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 430) took 1158 ms. Trace:
I20260709 13:03:53.113476 10750 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:53.127313  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.083874 10856 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:03:53.090736 10729 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.105000 10795 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:53.047560 10725 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.088323 10881 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:53.135782 10866 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:53.136976  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 146322us
I20260709 13:03:53.080185 10825 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.143205  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:53.146770 10765 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:53.163040  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.251144  8120 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:53.251864  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:53.252362  8120 raft_consensus.cc:1217] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-9.9]   Dedup: 6.7->[7.8-9.9]
I20260709 13:03:53.252882  8120 pending_rounds.cc:85] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 7
I20260709 13:03:53.253118  8120 pending_rounds.cc:107] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:03:53.253403  8120 raft_consensus.cc:2889] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:53.166929 10829 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:53.252453  8809 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:53.171931  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.120142 10842 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.129519 10872 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:53.127836 10726 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.106938 10700 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.094233 10876 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.132587 10582 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:53.244040  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 124887us
I20260709 13:03:53.140793 10650 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:53.250185  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.178078 10871 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:53.259308  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:53.275799 10527 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.178762 10873 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:53.276641  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 143507us
I20260709 13:03:53.277846  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:53.278716  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:53.140609 10779 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.054658 10830 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.324249  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:53.381925  8200 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:53.325449  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:53.326020  8809 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:53.137467 10855 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.260819 10829 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.194993 10750 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:53.209656 10853 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:53.382992  8268 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:53.386018  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.329427  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:53.186398  8808 rpcz_store.cc:276] 0709 13:03:51.946102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.951060 (+  4958us) service_pool.cc:224] Handling call
0709 13:03:52.989186 (+1038126us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:53.095632 (+106446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8778496}
I20260709 13:03:53.331089  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.370277  8269 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:53.179237 10781 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:53.390758  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.391342  8121 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:53.392258  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:53.394523  8091 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:53.395484 10729 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:53.395838 10287 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.265627 10545 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.397568  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.331169 10842 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.397166  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.397234  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:53.412955  8270 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.401046  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:53.413200  8266 raft_consensus.cc:2955] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:53.414723  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:53.401976  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.416241 10726 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:53.416715 10726 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:53.417773 10726 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.418922  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:53.419538  8121 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:53.422863  8270 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:53.421526  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:53.423949  8806 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:53.407176  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:53.402513 10666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.001s
I20260709 13:03:53.393607 10840 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:53.425145  8197 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:53.397220 10873 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:53.404116 10858 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:53.397990 10730 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:03:53.392967  8805 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
W20260709 13:03:53.426807 10666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.001s
I20260709 13:03:53.424567  8125 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:53.436406  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:53.442708  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:53.425062 10700 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:53.444442 10875 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:03:53.458861  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 129523us
I20260709 13:03:53.363291 10881 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:53.452818 10849 consensus_meta.cc:287] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.166s	user 0.011s	sys 0.000s
I20260709 13:03:53.421907 10842 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.457242 10821 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:53.429388 10781 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:03:53.460845 10796 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:53.461580 10628 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:53.523752  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 59951us
I20260709 13:03:53.441711 10840 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.443459 10873 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:53.428864 10582 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.504771 10825 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:53.512368 10821 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:53.511904 10842 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:53.540125 10814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.002s	sys 0.002s
I20260709 13:03:53.518374 10849 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.597196  8198 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:53.434693 10750 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:53.601454 10886 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 13:03:53.577199 10814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.002s	sys 0.003s
I20260709 13:03:53.602418 10891 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.605958  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:03:53.619455  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 87793.1us
W20260709 13:03:53.397231 10832 consensus_queue.cc:1175] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" responder_term: 9 status { last_received { term: 7 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:53.541154 10903 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.769582 10890 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:03:53.770473 10907 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.711020  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.004s	sys 0.005s
W20260709 13:03:53.621119 10875 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:53.602862 10901 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:53.619019 10666 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.818804 10903 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:53.770829 10787 consensus_meta.cc:287] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.282s	user 0.008s	sys 0.001s
I20260709 13:03:53.739681 10750 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:53.779481  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.004s	sys 0.005s
W20260709 13:03:53.887598 10898 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
W20260709 13:03:53.888029 10895 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
I20260709 13:03:53.888394 10878 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:53.945960  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 883156us
I20260709 13:03:53.826686 10287 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:53.817976 10796 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:53.783200 10907 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:54.055562  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1792) took 1013 ms. Trace:
I20260709 13:03:54.056160  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1784) took 1761 ms. Trace:
W20260709 13:03:54.094786  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.123101  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 384) took 1514 ms. Trace:
I20260709 13:03:53.951990  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:54.055166  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.973178  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.151360  8192 rpcz_store.cc:276] 0709 13:03:52.608455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.083574 (+1475119us) service_pool.cc:224] Handling call
0709 13:03:54.122570 (+ 38996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.122763 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.122789 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.122830 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:54.122860 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.122914 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.123043 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.959805  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.004195  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1412) took 1511 ms. Trace:
W20260709 13:03:54.150717  8197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.022s	sys 0.014s
I20260709 13:03:53.952134  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.150588  8124 rpcz_store.cc:276] 0709 13:03:52.295019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.295109 (+    90us) service_pool.cc:224] Handling call
0709 13:03:52.297190 (+  2081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.039369 (+742179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.055964 (+1016595us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54000de654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.056111 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705635072}
I20260709 13:03:53.884585 10700 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:54.154222  8197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.023s	sys 0.014s
I20260709 13:03:54.155714  8265 raft_consensus.cc:2410] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:54.150187  8118 rpcz_store.cc:276] 0709 13:03:53.042420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.042584 (+   164us) service_pool.cc:224] Handling call
0709 13:03:53.042912 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:53.062653 (+ 19741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.055314 (+992661us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5400298e54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.055513 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43989376}
I20260709 13:03:54.163661  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 383) took 1557 ms. Trace:
W20260709 13:03:54.156606  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 204670us
I20260709 13:03:54.107362  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1729) took 1863 ms. Trace:
I20260709 13:03:54.164047  8197 rpcz_store.cc:276] 0709 13:03:52.606385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.460570 (+854185us) service_pool.cc:224] Handling call
0709 13:03:53.460775 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.460899 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:53.539845 (+ 78946us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.163329 (+623484us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.163379 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:54.163416 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.163476 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.163607 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":701852,"threads_started":2}
I20260709 13:03:54.164383  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.166062  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1435) took 1259 ms. Trace:
W20260709 13:03:53.890437 10893 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.522s	user 0.000s	sys 0.002s
I20260709 13:03:53.847617 10904 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.946830 10913 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:54.164925  8117 rpcz_store.cc:276] 0709 13:03:52.243604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.243715 (+   111us) service_pool.cc:224] Handling call
0709 13:03:52.244058 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.290671 (+ 46613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.290704 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.291156 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:03:52.522415 (+231259us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:52.522453 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.055663 (+1533210us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b540011dfd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.055712 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.055753 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:54.055765 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.107287 (+ 51522us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"spinlock_wait_cycles":106432896,"thread_start_us":227831,"threads_started":1,"wal-append.queue_time_us":282691,"wal-append.run_cpu_time_us":2793,"wal-append.run_wall_time_us":1422828}
I20260709 13:03:54.153983  8191 rpcz_store.cc:276] 0709 13:03:52.492511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.495755 (+  3244us) service_pool.cc:224] Handling call
0709 13:03:52.496063 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.530227 (+ 34164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.530270 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.530843 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:03:52.636733 (+105890us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:52.652594 (+ 15861us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.940745 (+288151us) spinlock_profiling.cc:243] Waited 967 us on lock 0x7b1800132b20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:03:52.940916 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.940983 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.942151 (+1001168us) raft_consensus.cc:1685] finished
0709 13:03:54.003956 (+ 61805us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.004131 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189524,"prepare.queue_time_us":15721,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5130,"raft.queue_time_us":317678,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":13042,"spinlock_wait_cycles":2224384,"thread_start_us":139201,"threads_started":2,"wal-append.queue_time_us":294349}
I20260709 13:03:54.166730  8265 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:54.185408  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.167781  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.166646  8197 rpcz_store.cc:276] 0709 13:03:52.906723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.165334 (+1258611us) service_pool.cc:224] Handling call
0709 13:03:54.165635 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.165790 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.165813 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.165852 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:54.165881 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.165927 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.166015 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.180385  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.181737 10900 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:54.182248 10902 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.657s	user 0.000s	sys 0.002s
W20260709 13:03:54.182281 10896 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:03:54.192503  8269 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:54.186353  8273 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:54.195253  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 387) took 1037 ms. Trace:
I20260709 13:03:53.941784 10876 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:54.105849 10872 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:53.949836 10903 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:53.870944 10666 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:54.112934 10849 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:54.206305  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 378) took 2224 ms. Trace:
I20260709 13:03:54.210698  8197 rpcz_store.cc:276] 0709 13:03:53.158213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.186461 (+1028248us) service_pool.cc:224] Handling call
0709 13:03:54.194648 (+  8187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.194939 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.194966 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.195006 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:54.195035 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.195093 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.195200 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.211119  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.212461  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.003649 10842 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:54.115181 10894 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 13:03:53.848734 10901 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:54.115341 10899 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 13:03:54.195565 10736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.009s	sys 0.008s
I20260709 13:03:53.887208 10821 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:54.115485 10915 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.174870 10881 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:54.219141 10913 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:54.162844 10796 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:54.223181  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:54.155404 10287 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:53.973780  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:55.058271  8274 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:55.058470  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1762) took 1083 ms. Trace:
I20260709 13:03:53.973642  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:54.772013  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.471411 10916 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:03:55.059787  8268 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:54.320091 10545 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.060926 10545 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:54.372555  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:54.371937  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 294) took 1767 ms. Trace:
W20260709 13:03:54.964617  8165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.772s	user 0.020s	sys 0.027s
W20260709 13:03:55.068022  8165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.875s	user 0.020s	sys 0.030s
W20260709 13:03:54.529314  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 1.64195e+06us
I20260709 13:03:55.069518  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:55.067250  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1755) took 1094 ms. Trace:
I20260709 13:03:54.369639  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1410) took 1006 ms. Trace:
I20260709 13:03:54.315212  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1425) took 1809 ms. Trace:
W20260709 13:03:54.379515  8774 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.513s (SENT) [suppressed 11 similar messages]
I20260709 13:03:55.067343  8123 rpcz_store.cc:276] 0709 13:03:52.604165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.853858 (+249693us) service_pool.cc:224] Handling call
0709 13:03:52.854113 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.919308 (+ 65195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:52.919681 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.197251 (+277570us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.273057 (+ 75806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.273108 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:53.273159 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.371726 (+1098567us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b540029a754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.371768 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.371877 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108322,"prepare.queue_time_us":13503,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":109925,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":61761,"spinlock_wait_cycles":149079808,"thread_start_us":259030,"threads_started":2,"wal-append.queue_time_us":153145,"wal-append.run_cpu_time_us":2845,"wal-append.run_wall_time_us":1521601}
W20260709 13:03:54.326020 10677 consensus_meta.cc:287] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.236s	user 0.009s	sys 0.001s
I20260709 13:03:55.064795  8199 rpcz_store.cc:276] 0709 13:03:51.982104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.982253 (+   149us) service_pool.cc:224] Handling call
0709 13:03:51.992132 (+  9879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.285266 (+293134us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:52.285574 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.556129 (+270555us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.571167 (+ 15038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.571217 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:52.571262 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.206067 (+1634805us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001eb4d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.206116 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.206246 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14808,"prepare.queue_time_us":1359,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2254,"raft.queue_time_us":40190,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13564,"spinlock_wait_cycles":673648384,"thread_start_us":258612,"threads_started":2,"wal-append.queue_time_us":340741,"wal-append.run_cpu_time_us":1938,"wal-append.run_wall_time_us":1212591}
I20260709 13:03:55.072341  8274 rpcz_store.cc:276] 0709 13:03:53.973016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.973365 (+   349us) service_pool.cc:224] Handling call
0709 13:03:55.067114 (+1093749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346880}
W20260709 13:03:55.023128 10919 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.709s	user 0.002s	sys 0.000s
I20260709 13:03:55.060688 10915 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.067387  8272 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:55.087349  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:54.258989 10914 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
W20260709 13:03:54.581158 10865 consensus_meta.cc:287] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.640s	user 0.008s	sys 0.002s
I20260709 13:03:55.073772  8194 rpcz_store.cc:276] 0709 13:03:52.506010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.845306 (+339296us) service_pool.cc:224] Handling call
0709 13:03:52.862857 (+ 17551us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:52.968666 (+105809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.968694 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:53.011378 (+ 42684us) log.cc:844] Serialized 582 byte log entry
0709 13:03:53.079984 (+ 68606us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:53.080045 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.080150 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.314673 (+1234523us) raft_consensus.cc:1685] finished
0709 13:03:54.314835 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.315069 (+   234us) inbound_call.cc:177] Queueing success response
0709 13:03:54.321651 (+  6582us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b4800002dd8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
Metrics: {"mutex_wait_us":105325,"raft.queue_time_us":127056,"raft.run_cpu_time_us":18921,"raft.run_wall_time_us":1328925,"spinlock_wait_cycles":15611136,"thread_start_us":47840,"threads_started":1,"wal-append.queue_time_us":92647}
I20260709 13:03:55.058907  8273 rpcz_store.cc:276] 0709 13:03:53.974621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.210891 (+236270us) service_pool.cc:224] Handling call
0709 13:03:55.058405 (+847514us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:54.371232 10838 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.577s	user 0.007s	sys 0.002s
I20260709 13:03:55.062079  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 575) took 2016 ms. Trace:
I20260709 13:03:54.403501 10840 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:54.606370 10788 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:54.528132 10854 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.990s	user 0.012s	sys 0.000s
W20260709 13:03:55.039938 10750 consensus_meta.cc:287] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.083s	user 0.008s	sys 0.001s
W20260709 13:03:54.971693 10814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.142s	sys 0.246s
W20260709 13:03:54.363600 10833 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 2.258s	user 0.009s	sys 0.003s
W20260709 13:03:55.056929 10736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.010s	sys 0.018s
I20260709 13:03:54.326356 10779 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:55.161715  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1759) took 1187 ms. Trace:
I20260709 13:03:54.073380 10889 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.187194  8272 rpcz_store.cc:276] 0709 13:03:53.973982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.372311 (+398329us) service_pool.cc:224] Handling call
0709 13:03:55.161653 (+789342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.440946 10581 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:54.970777 10859 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:54.440846 10922 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:54.225481 10891 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:55.126780 10677 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:54.319919 10911 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.765s	user 0.001s	sys 0.000s
I20260709 13:03:54.193641 10700 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.172468 10934 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:55.177747 10287 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:55.165623  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.007s	sys 0.008s
I20260709 13:03:54.553417 10907 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:54.290275 10855 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.088973  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1756) took 1115 ms. Trace:
W20260709 13:03:55.166111  8267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.005s	sys 0.007s
I20260709 13:03:54.222340 10904 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.170677 10930 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:54.291622 10876 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:54.705528 10912 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.369496 10920 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.127033 10849 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.743559 10781 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:55.094156 10881 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:54.312302 10909 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.527441 10903 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:55.172610  8810 rpcz_store.cc:276] 0709 13:03:53.045850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.046987 (+  1137us) service_pool.cc:224] Handling call
0709 13:03:53.047397 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:53.058891 (+ 11494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.058923 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:53.077182 (+ 18259us) log.cc:844] Serialized 52 byte log entry
0709 13:03:53.183253 (+106071us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:53.603715 (+420462us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.603956 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.604031 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.472561 (+868530us) raft_consensus.cc:1685] finished
0709 13:03:54.472581 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.061960 (+589379us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1087819,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2795,"raft.queue_time_us":439,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":58751,"thread_start_us":408094,"threads_started":2,"wal-append.queue_time_us":184348}
I20260709 13:03:55.184386 10854 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:54.291783  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 570) took 1933 ms. Trace:
W20260709 13:03:54.606979 10829 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.207s	user 0.009s	sys 0.001s
I20260709 13:03:55.093503 10545 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:54.536144 10878 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.229554 10829 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.230453 10854 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.231292 10545 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.173455 10865 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:55.184281 10814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.144s	sys 0.253s
I20260709 13:03:55.231819 10829 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:54.584561 10835 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.782s	user 0.006s	sys 0.006s
I20260709 13:03:55.093185 10842 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.232476 10835 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7.
I20260709 13:03:54.260660 10872 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.233788 10842 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:55.197163 10666 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.169847  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:55.183758 10788 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.234776 10872 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.235160  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:55.180415 10929 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.201582 10581 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.205228 10891 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.213182 10779 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.213876  8811 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.202589 10840 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:55.218338 10901 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:55.177425 10838 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.204443 10736 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:03:55.168886 10852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.007s	sys 0.006s
I20260709 13:03:55.205423 10922 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.217330 10930 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.222796 10903 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.223474 10881 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.223913 10920 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.224313 10781 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.223632 10849 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.215137 10912 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.231278 10878 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.203275 10937 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:55.232782 10913 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.193226 10750 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.193048 10833 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.208843 10927 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.225144 10909 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:55.215090 10876 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.210930 10934 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:55.238780 10788 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:55.239255 10904 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:55.208699 10889 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:55.200924 10859 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:55.165915  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.000s	sys 0.014s
I20260709 13:03:55.181878  8199 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:55.188311  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 390) took 2029 ms. Trace:
I20260709 13:03:55.192519  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1430) took 2634 ms. Trace:
W20260709 13:03:55.209592  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.007s	sys 0.008s
W20260709 13:03:55.200253  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 977105us
W20260709 13:03:55.210602  8267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.285s	user 0.005s	sys 0.007s
I20260709 13:03:55.210384  8268 rpcz_store.cc:276] 0709 13:03:53.973268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.973379 (+   111us) service_pool.cc:224] Handling call
0709 13:03:55.088910 (+1115531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19840}
I20260709 13:03:55.071157  8271 rpcz_store.cc:276] 0709 13:03:53.363180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.363797 (+   617us) service_pool.cc:224] Handling call
0709 13:03:53.364024 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:53.441309 (+ 77285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.443099 (+  1790us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:53.452379 (+  9280us) log.cc:844] Serialized 26 byte log entry
0709 13:03:53.784203 (+331824us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:53.784245 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.784311 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.369412 (+585101us) raft_consensus.cc:1685] finished
0709 13:03:54.369434 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.369573 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68107,"spinlock_wait_cycles":9959168,"thread_start_us":407255,"threads_started":2,"wal-append.queue_time_us":834755}
W20260709 13:03:55.195259  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 815686us
I20260709 13:03:55.227864  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:55.878885  8810 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:55.547289  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 363911us
I20260709 13:03:55.239432 10915 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:55.855865  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 391) took 2673 ms. Trace:
I20260709 13:03:55.882929 10881 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:55.868353  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.001s	sys 0.000s
W20260709 13:03:55.868942 10582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.004s	sys 0.007s
I20260709 13:03:55.869411 10871 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:55.869362  8274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.005s	sys 0.000s
W20260709 13:03:55.942270 10582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.004s	sys 0.008s
I20260709 13:03:55.942273 10871 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:55.944098  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.001s	sys 0.001s
I20260709 13:03:55.889070  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:55.551831  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 298) took 2679 ms. Trace:
I20260709 13:03:55.888679  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:55.911866  8088 connection.cc:256] RPC call timeout handler was delayed by -1.3055508890000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32230000000000003s for a response
I20260709 13:03:55.904359  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:55.904265  8125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1736) took 2530 ms (client timeout 1646 ms). Trace:
W20260709 13:03:55.242195  8805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 574) took 2197 ms (client timeout 2067 ms). Trace:
W20260709 13:03:55.898346  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.246786  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:55.953956  8274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.006s	sys 0.000s
I20260709 13:03:55.899703 10866 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:55.901980  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:55.259388 10932 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:03:55.400643 10885 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 2.280s	user 0.007s	sys 0.028s
I20260709 13:03:55.870093  8265 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
W20260709 13:03:55.383277 10888 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 2.112s	user 0.003s	sys 0.018s
W20260709 13:03:55.455699 10935 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:03:55.989316  8803 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:55.990008 10582 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:55.977540 10866 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:55.963843  8125 rpcz_store.cc:269] 0709 13:03:53.373333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.373493 (+   160us) service_pool.cc:224] Handling call
0709 13:03:55.903675 (+2530182us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54000b09d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:55.903990 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26140928}
I20260709 13:03:55.991791 10821 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.948086  8116 rpcz_store.cc:276] 0709 13:03:52.871884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.905464 (+ 33580us) service_pool.cc:224] Handling call
0709 13:03:52.905736 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.991759 (+ 86023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.991785 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.991823 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:52.991856 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.551154 (+2559298us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b54000e42d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:55.551239 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.551581 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197350272}
I20260709 13:03:55.994642 10779 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:55.978235  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 92646.9us
I20260709 13:03:55.998101 10920 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:55.998883 10871 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:55.231863  8808 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:55.242734  8804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 428) took 3317 ms (client timeout 3223 ms). Trace:
I20260709 13:03:55.251539  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:55.931648 10581 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.898741 10915 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:55.893489 10788 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:55.933835  8193 rpcz_store.cc:276] 0709 13:03:53.159142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.560100 (+2400958us) service_pool.cc:224] Handling call
0709 13:03:55.560797 (+   697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.561183 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.561206 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:55.561257 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:55.561283 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.561330 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.832866 (+271536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:56.007390 10582 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:56.007877  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.542s (SENT)
W20260709 13:03:56.008143  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48631.9us
I20260709 13:03:55.991308  8273 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:56.008862 10795 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.887694 10927 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:55.244663 10830 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:56.015146  8804 rpcz_store.cc:269] 0709 13:03:51.925361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.927515 (+  2154us) service_pool.cc:224] Handling call
0709 13:03:55.242484 (+3314969us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54005834d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:55.242660 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679823232}
I20260709 13:03:56.015730  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:55.284338 10873 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:55.246865 10796 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:55.240607 10677 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.035458 10788 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:56.036545  8774 connection.cc:256] RPC call timeout handler was delayed by -1.0728255650000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
I20260709 13:03:56.035984 10915 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:56.041126  8265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1758) took 2067 ms (client timeout 2011 ms). Trace:
I20260709 13:03:56.043098  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 579) took 1989 ms. Trace:
I20260709 13:03:55.227737  8802 rpcz_store.cc:276] 0709 13:03:52.355752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.360826 (+  5074us) service_pool.cc:224] Handling call
0709 13:03:52.505449 (+144623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:52.639645 (+134196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.643640 (+  3995us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:52.834284 (+190644us) log.cc:844] Serialized 52 byte log entry
0709 13:03:52.916121 (+ 81837us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:52.916168 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.157002 (+1240834us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54005401d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.177297 (+ 20295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.186530 (+  9233us) raft_consensus.cc:1685] finished
0709 13:03:54.186549 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.289105 (+102556us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11164,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":5292,"spinlock_wait_cycles":149913472,"thread_start_us":78473,"threads_started":1,"wal-append.queue_time_us":95230,"wal-append.run_cpu_time_us":3735,"wal-append.run_wall_time_us":1471844}
I20260709 13:03:56.051208  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1416) took 3554 ms. Trace:
W20260709 13:03:56.053045  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.003s	sys 0.027s
I20260709 13:03:56.052908 10821 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.053629 10909 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.049955  8808 rpcz_store.cc:276] 0709 13:03:54.053820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.082557 (+ 28737us) service_pool.cc:224] Handling call
0709 13:03:54.154555 (+ 71998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.019376 (+1864821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.042378 (+ 23002us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004e0f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.042842 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2477128064}
I20260709 13:03:56.056094 10700 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.057405  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.058104  8808 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
W20260709 13:03:56.058823  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1405) took 2782 ms (client timeout 1665 ms). Trace:
W20260709 13:03:56.059384  8270 rpcz_store.cc:269] 0709 13:03:53.258672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.258820 (+   148us) service_pool.cc:224] Handling call
0709 13:03:56.040824 (+2782004us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400406ad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:56.041248 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57086848}
I20260709 13:03:56.060194 10912 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.060506  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.061700  8269 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
W20260709 13:03:56.063265  8269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1760) took 2089 ms (client timeout 2087 ms). Trace:
W20260709 13:03:56.063752  8269 rpcz_store.cc:269] 0709 13:03:53.974192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.212107 (+237915us) service_pool.cc:224] Handling call
0709 13:03:56.062993 (+1850886us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54001bdad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:56.063181 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266325376}
I20260709 13:03:56.065117 10934 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:56.065805  8238 connection.cc:256] RPC call timeout handler was delayed by -1.3525378969999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:03:56.066234  8238 connection.cc:256] RPC call timeout handler was delayed by -1.112237897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23340000000000002s for a response
I20260709 13:03:56.067031 10582 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.070359 10821 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:56.048832  8265 rpcz_store.cc:269] 0709 13:03:53.973771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.185097 (+211326us) service_pool.cc:224] Handling call
0709 13:03:56.040777 (+1855680us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400346a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:56.040975 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3796200704}
I20260709 13:03:56.025640  8194 rpcz_store.cc:276] 0709 13:03:53.158917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.169527 (+2010610us) service_pool.cc:224] Handling call
0709 13:03:55.187772 (+ 18245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.188003 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.188027 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:55.188065 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:55.188104 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.188155 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.188252 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:56.076521  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 61116.9us
I20260709 13:03:56.052143  8198 rpcz_store.cc:276] 0709 13:03:52.493621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.838943 (+345322us) service_pool.cc:224] Handling call
0709 13:03:52.839236 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.597651 (+758415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.047881 (+2450230us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540035c0d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.048323 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742752000}
I20260709 13:03:56.061589 10929 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.080737  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.081661  8198 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:56.083047  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.083370 10929 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.083859  8198 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:03:56.085603  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:56.048216 10795 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.086251  8807 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.087069 10922 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.087569 10903 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.089025 10788 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.086243 10840 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.070268  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.066982 10913 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.046159 10927 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.071725 10866 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.089993 10527 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:56.090610  8200 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 3.
I20260709 13:03:56.085251  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.104689  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 388) took 2939 ms. Trace:
I20260709 13:03:56.091533  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.092273 10840 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.078035 10915 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.106561  8197 rpcz_store.cc:276] 0709 13:03:53.158453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.057049 (+1898596us) service_pool.cc:224] Handling call
0709 13:03:55.069969 (+ 12920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.558352 (+488383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.558438 (+    86us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:55.558508 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:55.558558 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.097123 (+538565us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540021be54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.097169 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.097376 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121692032}
I20260709 13:03:56.089316 10795 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.089493 10930 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:56.102993 10852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.824s	user 0.007s	sys 0.028s
I20260709 13:03:56.104955 10527 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.122539  8268 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:03:56.123401  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.034651  8196 rpcz_store.cc:276] 0709 13:03:52.557625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.867143 (+309518us) service_pool.cc:224] Handling call
0709 13:03:52.867406 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.969503 (+102097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.969531 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:53.000698 (+ 31167us) log.cc:844] Serialized 26 byte log entry
0709 13:03:53.142592 (+141894us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:53.142630 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.142700 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:55.192318 (+2049618us) raft_consensus.cc:1685] finished
0709 13:03:55.192338 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.192462 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121104,"raft.queue_time_us":125791,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":28424,"thread_start_us":95650,"threads_started":1,"wal-append.queue_time_us":219466}
I20260709 13:03:56.125063  8268 pending_rounds.cc:85] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
I20260709 13:03:56.131115  8198 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:56.131023  8807 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:56.132144  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.132601  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 389) took 2867 ms. Trace:
I20260709 13:03:56.106905 10821 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:56.140558  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.134722  8199 rpcz_store.cc:276] 0709 13:03:53.158674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.166942 (+2008268us) service_pool.cc:224] Handling call
0709 13:03:55.181076 (+ 14134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.963466 (+782390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.025930 (+ 62464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:56.092308 10913 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.125751 10527 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:56.128368  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:56.142740  8193 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:56.148105  8198 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:56.148386  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.151111  8810 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:03:56.151822  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1406) took 2872 ms. Trace:
I20260709 13:03:56.130563  8268 pending_rounds.cc:107] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:56.158882  8268 raft_consensus.cc:2889] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:56.160127  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 46844.4us
I20260709 13:03:56.160673 10930 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:56.161273  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.161199 10930 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.157974  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.160338  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.161455  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.106103 10937 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.183281  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.179103  8196 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:56.146824 10781 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:56.105368  8805 rpcz_store.cc:269] 0709 13:03:53.044731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.046409 (+  1678us) service_pool.cc:224] Handling call
0709 13:03:55.241970 (+2195561us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54004e02d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:55.242094 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439028992}
I20260709 13:03:56.177421 10930 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:56.148316  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.211462  8808 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:56.212908  8200 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
W20260709 13:03:56.207366  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 46060.8us
I20260709 13:03:56.214342  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.215593 10915 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:56.216252 10915 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.216982 10915 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:56.218719  8198 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
W20260709 13:03:56.206655  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 126951us
I20260709 13:03:56.228742  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.225090  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.226801  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.230130  8197 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:56.245738 10796 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.246271 10796 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:56.246568 10952 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:03:56.248593  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 302) took 3116 ms. Trace:
I20260709 13:03:56.248924  8120 rpcz_store.cc:276] 0709 13:03:53.132124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.251816 (+119692us) service_pool.cc:224] Handling call
0709 13:03:53.252151 (+   335us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:53.324824 (+ 72673us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:53.368726 (+ 43902us) log.cc:844] Serialized 14 byte log entry
0709 13:03:55.554670 (+2185944us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18003f68e0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c823a 00007fbd24d32a2a
0709 13:03:55.997491 (+442821us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:55.998695 (+  1204us) log.cc:844] Serialized 52 byte log entry
0709 13:03:55.999020 (+   325us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:55.999213 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.999599 (+   386us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.248158 (+248559us) raft_consensus.cc:1685] finished
0709 13:03:56.248251 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.248431 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149665,"prepare.queue_time_us":43740,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":213607,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":4729,"spinlock_wait_cycles":4444032,"thread_start_us":281327,"threads_started":1,"wal-append.queue_time_us":2742355}
I20260709 13:03:56.135521 10750 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.254391  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.262044  8196 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:56.250545 10796 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.272087  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.273128  8198 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:03:56.274178  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:56.274443  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 222944us
I20260709 13:03:56.270639  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.259232 10795 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:56.238674 10821 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.307729  8197 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:56.313863 10648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.009s	sys 0.018s
I20260709 13:03:56.313980 10922 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:56.314196  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 578) took 2205 ms. Trace:
I20260709 13:03:56.314692  8811 rpcz_store.cc:276] 0709 13:03:54.003686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.007857 (+  4171us) service_pool.cc:224] Handling call
0709 13:03:54.122693 (+114836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.962956 (+1840263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.153400 (+190444us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540049f554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.209412 (+ 56012us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508948736}
I20260709 13:03:56.316601  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.308492  8193 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:56.238178 10788 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.311260  8198 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:56.321566  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.323803  8200 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
W20260709 13:03:56.324901 10949 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.288s	user 0.000s	sys 0.004s
I20260709 13:03:56.325274  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.326254  8197 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:56.327195  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:56.266402 10889 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.328418  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:56.316561 10648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.743s	user 0.010s	sys 0.018s
I20260709 13:03:56.245922 10869 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.324940  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.157181  8266 rpcz_store.cc:276] 0709 13:03:53.268755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.268954 (+   199us) service_pool.cc:224] Handling call
0709 13:03:53.269536 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.413096 (+143560us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:53.452885 (+ 39789us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.193831 (+740946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.193877 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:54.193923 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.133848 (+1939925us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54003b8dd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.141305 (+  7457us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.141574 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303261,"raft.queue_time_us":303818,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":329616640,"thread_start_us":434379,"threads_started":2,"wal-append.queue_time_us":57484,"wal-append.run_cpu_time_us":1524,"wal-append.run_wall_time_us":1016616}
I20260709 13:03:56.315764 10795 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.209851 10736 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.349076  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:56.349697  8193 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.348287  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.348358  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.355585  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.349272 10795 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.314849 10922 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.368851  8200 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:56.351840 10779 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:56.367600  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 297063us
I20260709 13:03:56.373257  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.383512  8194 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:56.372818 10788 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.384944  8194 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:03:56.386101  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 75615.7us
I20260709 13:03:56.387532  8194 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:03:56.390097  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.383168  8198 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:56.399832  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.400498  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 393) took 2954 ms. Trace:
I20260709 13:03:56.400794 10821 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.401625  8238 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.393666  8199 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:56.400871  8200 rpcz_store.cc:276] 0709 13:03:53.445744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.380612 (+2934868us) service_pool.cc:224] Handling call
0709 13:03:56.399480 (+ 18868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.399785 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:56.399810 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:56.399995 (+   185us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:56.400164 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.400236 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.400412 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:56.406327 10840 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.406502  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.391957 10784 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:56.406925 10781 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.406901 10840 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.410238 10527 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:56.408591  8237 connection.cc:256] RPC call timeout handler was delayed by -1.3648655129999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 13:03:56.417707  8192 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:03:56.422302 10859 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.455032  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:56.421990  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1409) took 2993 ms. Trace:
I20260709 13:03:56.412304 10781 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:56.423460 10833 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.422703 10736 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:56.454751  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 233164us
I20260709 13:03:56.413823  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.423540  8198 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:56.454335  8192 pending_rounds.cc:85] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 3
I20260709 13:03:56.456921 10869 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.458214 10889 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:56.424194  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.455550  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:56.459553  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0651655130000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:03:56.456576 10964 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:56.458573  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.462635 10948 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:56.463156  8198 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
W20260709 13:03:56.423189 10947 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:03:56.458312 10869 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.465653 10869 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.412061 10946 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.435408  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.466890 10946 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.467381 10750 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.432981  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.437220  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.434924  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:56.470738  8803 raft_consensus.cc:2368] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6.
I20260709 13:03:56.438040  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.457860  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.439989  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.473665 10963 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:56.414072 10779 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.474493  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.474880 10779 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.437721  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.475449  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:56.443077  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:56.417955 10954 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:03:56.446326 10891 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.466205 10922 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.474397 10963 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.448551 10915 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.457988  8192 pending_rounds.cc:107] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:03:56.481419  8192 raft_consensus.cc:2889] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.457062 10781 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.481617 10963 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.482617  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.448906 10876 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.401932 10937 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.437055  8808 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:56.457931  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 44167.3us
I20260709 13:03:56.484457  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1764) took 2509 ms. Trace:
I20260709 13:03:56.475324 10779 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.458840 10889 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.410616 10784 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:56.480825  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.466383  8193 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:56.485140  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.483774  8122 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:56.470805  8270 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:03:56.422997  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1788) took 3931 ms. Trace:
I20260709 13:03:56.456739  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:56.488564  8121 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:56.469105 10946 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.411362 10821 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:56.502007 10876 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:56.502471  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45809.7us
I20260709 13:03:56.502633 10876 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.503296 10876 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.502233 10821 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.506063 10937 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.506521 10937 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:56.506935 10937 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.413197 10849 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.422207 10838 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.507458 10821 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.506198  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:56.509223  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:56.466660 10913 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:56.415042 10951 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:56.485210 10889 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.503446  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.482980 10915 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.492502 10784 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:56.425181 10527 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.456161  8267 rpcz_store.cc:276] 0709 13:03:53.328510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.328673 (+   163us) service_pool.cc:224] Handling call
0709 13:03:53.363395 (+ 34722us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:53.573919 (+210524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.573953 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:53.712298 (+138345us) log.cc:844] Serialized 582 byte log entry
0709 13:03:55.258502 (+1546204us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:55.871036 (+612534us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:55.871147 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.871334 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.270360 (+399026us) raft_consensus.cc:1685] finished
0709 13:03:56.270381 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.321589 (+ 51208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61523,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":2401,"spinlock_wait_cycles":2015104,"thread_start_us":2145857,"threads_started":2,"wal-append.queue_time_us":1359572}
I20260709 13:03:56.531546  8119 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:56.445459 10726 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:56.540088  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.541517  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.542222  8116 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:56.542713  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:56.544193 10726 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.544603  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.544214  8269 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.545794  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.546868  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1797) took 3484 ms. Trace:
I20260709 13:03:56.547809  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.550729  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.551468  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.552237  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:56.552711  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.543512  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.545631 10840 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.554786  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1434) took 3648 ms. Trace:
I20260709 13:03:56.554996  8802 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:56.553972  8273 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:56.547245  8191 rpcz_store.cc:276] 0709 13:03:53.062343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.184299 (+1121956us) service_pool.cc:224] Handling call
0709 13:03:54.184573 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.900213 (+1715640us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:56.318185 (+417972us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.408153 (+ 89968us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.411761 (+  3608us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.445604 (+ 33843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:56.445651 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:56.445693 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.546447 (+100754us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540035bbd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.546487 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.546716 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64349,"prepare.queue_time_us":545591,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":45672,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":72639,"spinlock_wait_cycles":3801057280,"thread_start_us":443919,"threads_started":2}
I20260709 13:03:56.491181  8195 rpcz_store.cc:276] 0709 13:03:52.491864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.495619 (+  3755us) service_pool.cc:224] Handling call
0709 13:03:52.545664 (+ 50045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.962499 (+416835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.962526 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.962935 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:03:53.783393 (+820458us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b1800321d00. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd248d04bc 00007fbd21c1e48b 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1
0709 13:03:53.783537 (+   144us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:53.783574 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.371119 (+587545us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400364054. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:54.371164 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:55.382975 (+1011811us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b24002bee18. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21ac19c4 00007fbd21abfacb 00007fbd21c7adc9 00007fbd21c7aa55 00007fbd21c7a09d 00007fbd248ac10e 00007fbd248c388c 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221
0709 13:03:56.402824 (+1019849us) raft_consensus.cc:1685] finished
0709 13:03:56.407074 (+  4250us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.422827 (+ 15753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149737,"raft.queue_time_us":143919,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21513,"spinlock_wait_cycles":685770496,"thread_start_us":84347,"threads_started":1,"wal-append.queue_time_us":179014}
I20260709 13:03:56.552204  8805 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:56.540580 10869 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.542591 10909 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.465099 10920 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:03:56.561795 10920 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:56.559206  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.562315 10909 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.462474 10912 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:56.563691 10912 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.564443 10726 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:56.565012  8150 heartbeater.cc:646] Failed to heartbeat to 127.6.215.126:41935 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.215.126:41935 timed out after 15.000s (SENT)
I20260709 13:03:56.565800  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:56.566646  8122 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:56.566869  8265 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:56.570468 10866 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:56.581892 10866 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.570868  8192 rpcz_store.cc:276] 0709 13:03:52.906415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.155590 (+1249175us) service_pool.cc:224] Handling call
0709 13:03:54.183135 (+ 27545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.524202 (+2341067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.554594 (+ 30392us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54002062d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:56.554737 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5137607936}
I20260709 13:03:56.572144 10838 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:56.569176 10788 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.573529 10946 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:56.584379 10866 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.562274 10920 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:56.584873  8192 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:56.585112  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.429317 10795 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.581951  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.585862 10920 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.562984  8121 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:56.561921  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.585815  8802 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:56.587406  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.452140 10930 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.587849 10795 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.587630 10927 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.484848  8274 rpcz_store.cc:276] 0709 13:03:53.975104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.095088 (+1119984us) service_pool.cc:224] Handling call
0709 13:03:55.095467 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.208241 (+112774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.208275 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.210402 (+  2127us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.977631 (+767229us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:56.369787 (+392156us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.371829 (+  2042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.388255 (+ 16426us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.422393 (+ 34138us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:03:56.484096 (+ 61703us) raft_consensus.cc:1685] finished
0709 13:03:56.484217 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.484376 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":431264,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":140,"raft.queue_time_us":119106,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":21813,"spinlock_wait_cycles":5364480,"thread_start_us":1245817,"threads_started":3,"wal-append.queue_time_us":888065}
I20260709 13:03:56.587739 10796 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.588421  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.609238  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.589368  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.599422  8269 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
W20260709 13:03:56.588979  8166 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.013s	sys 0.019s
I20260709 13:03:56.593538  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:56.637235  8166 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.014s	sys 0.023s
I20260709 13:03:56.637036  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.585959 10912 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:56.650158  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 188947us
I20260709 13:03:56.651007  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.646013  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:56.651741  8267 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.649469  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.606067  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:56.640735  8192 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:56.697739 10912 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.697504  8271 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:56.607548  8806 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:56.696626  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:56.701561  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64900.2us
W20260709 13:03:56.638486  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 1.0762e+06us
I20260709 13:03:56.647042  8268 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:56.646551  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 84692.8us
W20260709 13:03:56.645653  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 267460us
I20260709 13:03:56.706110  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.646355  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.711711 10869 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.590090 10700 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:03:56.735337  8272 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.646009 10937 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:56.736624  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.737327  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.737998 10937 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:56.738453  8163 connection.cc:256] RPC call timeout handler was delayed by -2.4036880819999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:03:56.739009  8163 connection.cc:256] RPC call timeout handler was delayed by -2.3537533699999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:03:56.739452  8163 connection.cc:256] RPC call timeout handler was delayed by -1.9318719749999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:03:56.740268  8163 connection.cc:256] RPC call timeout handler was delayed by -1.7563719749999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 13:03:56.739970 10779 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.740869 10849 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.741125  8266 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:56.740660  8163 connection.cc:256] RPC call timeout handler was delayed by -1.539615289999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 13:03:56.745419  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:56.745724  8163 connection.cc:256] RPC call timeout handler was delayed by -1.539615289999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:03:56.746316  8163 connection.cc:256] RPC call timeout handler was delayed by -1.5315152899999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:03:56.729315  8118 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:56.746717  8163 connection.cc:256] RPC call timeout handler was delayed by -1.5315152899999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:03:56.742201 10779 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:56.747090  8163 connection.cc:256] RPC call timeout handler was delayed by -1.4820152899999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:03:56.747859  8163 connection.cc:256] RPC call timeout handler was delayed by -1.4820152899999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:03:56.748581  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.749617 10710 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.749950  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:56.750548 10964 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:56.749986 10710 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:03:56.748178  8163 connection.cc:256] RPC call timeout handler was delayed by -1.1553152899999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:03:56.762902  8163 connection.cc:256] RPC call timeout handler was delayed by -1.1427152899999555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:03:56.764380  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.751808  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 45916.5us
I20260709 13:03:56.765868  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.700266 10830 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.661614 10915 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:56.763732  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.776366  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:56.702561 10912 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.753597 10903 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.766983 10710 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.781076  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.778729  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.785967  8270 raft_consensus.cc:2368] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
I20260709 13:03:56.754197 10866 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:56.769225 10779 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:56.769562 10920 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.792800  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.773653 10915 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:56.794981  8266 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:56.796734  8266 pending_rounds.cc:85] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:03:56.796986  8266 pending_rounds.cc:107] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:56.797183  8266 raft_consensus.cc:2889] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.783207 10912 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.784358 10648 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:56.770044 10876 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.803541 10830 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.804965  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.805586  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.829159  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:56.832819  8274 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:56.835248 10876 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:56.787626 10903 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:56.838505  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 54327.7us
I20260709 13:03:56.839193 10796 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.772928 10869 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:56.792357 10779 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.847500  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.850299  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.803552 10677 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:56.854940  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.856503  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:56.799137 10915 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:56.805768 10648 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:56.796419 10980 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:56.860662  8199 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
W20260709 13:03:56.862798  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 59574.8us
I20260709 13:03:56.870930  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.873462 10930 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.874925 10927 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.877619  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:56.857070 10779 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:56.848881 10866 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.885277 10866 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:56.887179  8237 leader_election.cc:400] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6.
I20260709 13:03:56.887496  8237 leader_election.cc:403] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.887763  8272 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:56.888499  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:56.889523 10929 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:56.890774 10796 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:56.891661 10796 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6.
I20260709 13:03:56.870143 10980 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.893512 10750 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:56.864212  8121 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:56.893915 10750 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:56.867806  8200 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:03:56.894994  8166 leader_election.cc:336] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.761s (SENT)
W20260709 13:03:56.895622 10971 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:03:56.897552 10830 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.898018  8123 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:56.869971 10648 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:56.893781 10980 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:56.900876  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43761.6us
I20260709 13:03:56.788219 10849 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.908267 10909 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.909771  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:56.910054 10849 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:56.898488  8118 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:56.911156  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:56.902969  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.897622  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.902534  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:56.913481  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:56.914381  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43522.9us
I20260709 13:03:56.912469 10726 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:56.894883 10750 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.846997 10889 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:56.918593 10726 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:56.920146  8269 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:56.917320  8273 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:56.929448 10838 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:56.929951 10838 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:56.930331 10838 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.923712  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.862181 10784 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.919436 10726 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.153997  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.020731  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.127797  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:56.936389  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:57.047652  8267 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:57.119426  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:56.938702  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:57.161126  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.120060  8196 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:57.160697  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 140161us
I20260709 13:03:56.990712  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:57.162782  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.938139  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:56.902184 10796 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.113081  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.168341  8274 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:57.167008  8118 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:57.021641  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:03:57.176424  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 162691us
I20260709 13:03:57.178133  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.179064  8121 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:03:57.181238  8119 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:56.905825 10677 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:03:57.184191  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 281709us
I20260709 13:03:57.187299  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:57.188237  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.189054  8125 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:56.942524 10876 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:57.078285 10788 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:56.920586 10795 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:57.208411  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.215838 10915 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.217481 10677 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.946679 10912 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.254305  8195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50476
I20260709 13:03:57.255084  8195 raft_consensus.cc:606] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:57.255395  8195 raft_consensus.cc:614] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:57.256098 10912 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:57.248399 10795 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.185931 10956 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:57.257553 10956 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:57.257927 10956 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.258673 10915 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:57.207113 10876 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:57.073396 10710 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.220474  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:57.220945  8272 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.226608 10784 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:57.228668  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.176669 10750 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.071513 10648 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:56.940018 10903 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:57.193583  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.257213 10795 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:57.264732  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.244086 10937 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.920183 10781 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.271823  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:57.272547  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 210510us
I20260709 13:03:57.278537  8810 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:57.272887 10996 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:57.275573 10922 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.290359  8273 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:57.292636  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.293334  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:57.291846  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:57.294251  8806 raft_consensus.cc:2410] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:57.294204  8265 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 3.
W20260709 13:03:57.299823  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 79465.5us
I20260709 13:03:57.302682 10648 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:57.263602 10980 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.297641  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:03:57.332480  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.305174  8777 leader_election.cc:400] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
I20260709 13:03:57.358995  8777 leader_election.cc:403] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:03:57.359546  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58447.7us
W20260709 13:03:57.366876 10999 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:57.367192 10838 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.361649 10648 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.386001  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.369300 10710 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:57.369608  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.370813 10876 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.379958 10980 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:57.387835  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.513s (SENT)
I20260709 13:03:57.381292  8268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:57.388285  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.388432  8268 raft_consensus.cc:606] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.388770  8268 raft_consensus.cc:614] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:57.389678 10710 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.389974  8123 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:57.381955 10781 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:57.391408 10876 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.391542 10838 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:57.394515  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:57.401022  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 102549us
I20260709 13:03:57.409751  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:57.409698  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49460.5us
I20260709 13:03:57.288960 10937 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.413491  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.445134  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:57.446995  8270 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:57.448319  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:57.357295 10779 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.321521 10866 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:03:57.410899  8808 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.452005  8811 raft_consensus.cc:2410] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:57.456681  8272 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:57.460209 10750 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.460801 10648 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
W20260709 13:03:57.461308 10985 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:03:57.361771 10996 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.471661 10866 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:57.472054 10866 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:57.472967 10996 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:57.472985 10866 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.474500 10866 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:57.474754 10989 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.301s	user 0.003s	sys 0.000s
I20260709 13:03:57.475965  8272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19747a1b37df480faebc96d93689cda5"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:57.476687  8272 raft_consensus.cc:606] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.477022  8272 raft_consensus.cc:614] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:57.478163  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:57.479699  8272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:57.480552  8272 raft_consensus.cc:606] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:57.480921  8272 raft_consensus.cc:614] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:57.486052  8274 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:03:57.486702 10726 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.487118 10779 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:57.490191 10990 log.cc:927] Time spent T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:03:57.492725  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 106808us
I20260709 13:03:57.446380 10998 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:57.415973 10956 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:57.500244  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 86834.6us
W20260709 13:03:57.502260  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 91271.7us
I20260709 13:03:57.509853 10648 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:03:57.506228 10996 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:03:57.521798 10889 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:57.524236 10937 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:57.531113  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:03:57.531729  8273 raft_consensus.cc:606] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:57.494988 10998 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:57.534690 10710 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:57.549325  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.547308  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1798) took 1108 ms. Trace:
I20260709 13:03:57.550699  8125 rpcz_store.cc:276] 0709 13:03:56.438515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.441451 (+  2936us) service_pool.cc:224] Handling call
0709 13:03:56.441781 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.190851 (+749070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.546783 (+355932us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400149454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:57.546939 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718106496}
I20260709 13:03:57.547294  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:57.540336 10998 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.560254 10988 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:57.546114 10710 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:57.563454  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:57.561478 10937 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:57.578922  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.567019  8808 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:57.570218 10937 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:57.588255 10710 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.585667 10889 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:57.592108 10956 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:57.594344  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:57.596424  8810 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.597808  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.598691  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.594674 10849 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.600162  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.600621  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.601337  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.601672  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.601822  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.602762  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:03:57.602818  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.603837  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.604228  8199 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:03:57.600219 10849 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.606655  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.615301  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.606323 10889 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.627280  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.627776  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:57.616297 10849 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:57.628366  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.628489  8808 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:57.629473  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:57.617504 11006 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:57.585919 10876 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:57.619410 10993 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:57.634910 10993 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:57.635098  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:57.635875 10993 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:57.636713 10992 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:57.637094 10992 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.637418  8091 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.637907 10992 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.638307 10963 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:57.639199 10963 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:57.618747  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.606217 10838 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:57.639933 10750 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:57.640638 11006 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:57.641131 10946 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:57.639914 10909 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:57.641649 10946 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.642001 11000 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:57.640414 10838 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.642576 11000 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:03:57.622804 10995 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.350s	user 0.000s	sys 0.003s
I20260709 13:03:57.624539  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.641739 10909 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.626617  8199 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.642927 10784 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:57.629859 10779 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.629863  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.643577  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.645799 10710 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:57.646545  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.647085  8200 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.644084  8193 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.602865 11004 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:03:57.649991 11004 raft_consensus.cc:3055] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:57.650311 11004 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.643769 10946 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.651122 11004 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.583673 10795 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.640342 10963 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:57.624701  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.631431  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.654417  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.644755 10909 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.655539  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.655730 10909 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.656538  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.657078  8196 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:57.659631  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.660128  8196 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.653333 10795 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:57.639302 10992 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.661950  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.654387  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.662494  8195 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:57.663234  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.663787  8197 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.658355 10956 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:57.665657 10956 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.666046 10956 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.628247 10889 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:57.643573 11000 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.670444 10876 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.638427  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:03:57.641214 11006 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.679869 11006 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.681238  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.681718 11004 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:57.682313  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 43949.6us
I20260709 13:03:57.683066  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:57.683828 10963 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:57.684212 10963 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.684535 10963 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:57.685698  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54338.6us
I20260709 13:03:57.651666 10946 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.689689 10889 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:57.690045 10726 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.690095 10889 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.690884 10889 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:57.692382  8810 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:03:57.685643 11002 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.693509 10876 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:57.643047 10838 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.690847  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:57.704691 10993 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:57.705070 10993 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:57.705438 10993 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.672178  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.695811  8192 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:57.710065 10795 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:57.710521 10795 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.710924 10795 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.712129  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.696574  8199 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:57.712800  8191 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:57.713333  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.697309  8193 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:57.698231  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.698724 11002 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:57.699548  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.710518  8195 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:03:57.716311  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.674746  8197 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:57.697278  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.717506  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.717622  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.718080  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.715238  8196 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:57.719043  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:57.700666 10998 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.712013 10994 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:03:57.724488  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.724607  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.725837  8200 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:57.731884  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.734498 10964 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:57.734906 10964 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.735167 10876 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:57.735642 10796 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.735754 10876 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:57.733889 10889 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.745360  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:57.746989  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.738685 10996 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:57.703125 10963 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.724092 10849 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:57.724743 10700 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.755642  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.727684 10726 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.735232 10964 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.763288  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.727360 10866 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.768610 10849 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:57.775295  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.775388 10849 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.763572 10779 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:57.777439  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:57.777635 10779 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:57.778136  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.770444 10750 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:57.755812 10996 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:57.779052  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.754390 10869 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:57.774230 10946 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.783239  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.783730  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.725090 10956 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.795059  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:57.806212  8265 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:57.768936  8808 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.787205 10796 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:57.790833 10996 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.819159  8196 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:57.819605  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.778545 10779 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.808152  8197 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:57.797468 11000 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:57.821601 10796 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:57.808652 10922 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:57.808143 10869 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:57.753193 10876 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:57.837409  8071 auto_rebalancer.cc:893] Removing replace marker failed: Replica afd11cff97554063a80d743fdf2b934d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:57.837893  8071 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:03:57.838176  8071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:57.822489 10726 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.830566 10796 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.832446 10781 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.797757 10937 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.847574 10922 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:57.854697  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.847036 10946 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:57.875236  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 119022us
I20260709 13:03:57.845089 11000 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:57.889382 10726 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:57.890069  8019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 255) took 14014 ms (client timeout 15000 ms). Trace:
W20260709 13:03:57.890410  8019 rpcz_store.cc:269] 0709 13:03:43.833833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.833982 (+   149us) service_pool.cc:224] Handling call
0709 13:03:57.843258 (+14009276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:53.519729 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:54.122563 (+602834us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:54.149900 (+ 27337us) write_op.cc:435] Acquired schema lock
0709 13:03:54.155676 (+  5776us) tablet.cc:662] Decoding operations
0709 13:03:54.570780 (+415104us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:54.570843 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:54.570873 (+    30us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:03:54.572672 (+  1799us) tablet.cc:701] Row locks acquired
0709 13:03:54.572692 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:03:54.572844 (+   152us) write_op.cc:270] Start()
0709 13:03:54.572963 (+   119us) write_op.cc:276] Timestamp: P: 1783602234572798 usec, L: 0
0709 13:03:54.572987 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:03:54.894542 (+321555us) log.cc:844] Serialized 9349 byte log entry
0709 13:03:55.323760 (+429218us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b1800451de0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:03:56.441557 (+1117797us) op_driver.cc:464] REPLICATION: finished
0709 13:03:56.840552 (+398995us) write_op.cc:301] APPLY: starting
0709 13:03:56.864814 (+ 24262us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:56.911541 (+ 46727us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:56.911586 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:57.066192 (+154606us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:57.066588 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:03:57.066639 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:57.067200 (+   561us) log.cc:844] Serialized 158 byte log entry
0709 13:03:57.067418 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:57.067812 (+   394us) write_op.cc:454] Released schema lock
0709 13:03:57.067908 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:57.068370 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:57.068398 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2305797,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":334370,"apply.run_cpu_time_us":6277,"apply.run_wall_time_us":277949,"num_ops":23,"prepare.queue_time_us":255501,"prepare.run_cpu_time_us":20612,"prepare.run_wall_time_us":1703181,"raft.queue_time_us":322820,"raft.run_cpu_time_us":19483,"raft.run_wall_time_us":276322,"replication_time_us":1836170,"spinlock_wait_cycles":6493568,"thread_start_us":915837,"threads_started":4,"wal-append.queue_time_us":283102}]]}
I20260709 13:03:57.852279 10998 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:57.897614  8191 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:03:57.898533  8193 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:57.844775 10993 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.848956 10795 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:57.904561  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:57.905472  8265 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:57.907557  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 128550us
W20260709 13:03:57.908301  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 108872us
I20260709 13:03:57.914458  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:57.913267  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:57.885776  8021 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:57.920310  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:03:57.932412  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 80923.7us
W20260709 13:03:57.933224  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 177640us
I20260709 13:03:57.939363  8123 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:57.942478  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:57.943961  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:57.946134  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.940295  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.947202  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.920686 10963 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:57.961679 11010 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:03:57.904628 10869 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:57.972951  8117 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.954480  8021 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:03:58.127306  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 205619us
W20260709 13:03:58.100694 11009 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:03:57.969803 11021 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:03:58.067731  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:57.945245 10922 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.065608 10956 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:58.109958  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.068616  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.222707  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:57.980502  8265 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:58.067442  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.225742  8118 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:58.226552  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.227051  8118 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:58.227718  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.228513 10964 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.073311 10781 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:58.229144 10710 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.112164  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:58.062430  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 82441us
I20260709 13:03:58.068684  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:03:58.064769  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79408.6us
I20260709 13:03:58.232558  8119 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.984849 10527 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:58.077811 11012 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:03:58.068082  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:57.979206 11020 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:58.099684 10750 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:58.056682 10946 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:58.144336  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 46218.4us
I20260709 13:03:58.247342  8265 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:58.248351  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 186901us
I20260709 13:03:58.097826  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.210079  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.210410  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.210803  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.211127  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.211401  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.148144 10948 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:58.253993  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.211796  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.255057  8806 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:58.212339  8805 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:58.212962 11004 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:58.213611  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.213562  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:58.214834  8807 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:58.214936  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.219614 10795 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:58.220521 10993 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:58.102969 11006 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:58.268419  8273 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:58.099726 10994 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:57.970304 11000 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.229691 10781 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:58.237707  8125 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:58.275221  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.275885  8125 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:58.094659 10963 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:03:58.251279  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:58.251502  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.252312  8811 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:58.229655 10710 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.253052  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.258725  8122 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:58.260219  8021 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 6, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:58.238682 10527 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:58.176832 10648 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:03:58.284798  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.269372  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.276968  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.257637 11004 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:58.285739  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.294834  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:58.297847  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 316015us
W20260709 13:03:58.299549  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 57424.9us
I20260709 13:03:58.297439  8021 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 7, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.302582  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.277966 10781 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:58.327553  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.328393  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.330186  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.331246  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.331840  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.255991 11013 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:03:58.332585  8270 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:58.340369  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:58.303129  8274 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:58.335486  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 56514.4us
I20260709 13:03:58.343214  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.268711 10956 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:03:58.336143  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.347992  8118 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:03:58.342772  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.257514 10948 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.351850  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.274914 11006 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.355122  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.279047 10994 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:58.356017  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 55491.8us
I20260709 13:03:58.361320  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.333076 10700 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.363933  8266 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:58.358093  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.358729  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.360432  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.360734  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.362031  8269 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:03:58.361334  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.366309  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:58.366858  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.332916 10840 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:58.266153 10750 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.367431 10840 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.368880  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:58.369707 10840 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:58.371253  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.371753  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:58.372457  8117 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:58.374408  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.375151  8269 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.379560  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.384696  8806 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:58.386965  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.339506 11020 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:58.397579  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.401693  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.402338  8806 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.407742  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.408015  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.408694  8269 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:58.408339  8021 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.410440  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.419741  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.420295  8269 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:03:58.421504  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.425727  8269 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.426514  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.427165  8269 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:58.386020  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.429901  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.432121  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.432407  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.433203  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.433816  8021 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.437081  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.437387  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.403194  8808 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:58.480134 10964 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:58.480718 11027 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:03:58.485406  8117 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 4: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:03:58.433563 10996 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 13:03:58.497439  8269 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.499737  8121 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:58.504024  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.415469 10840 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:03:58.512442  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 179540us
I20260709 13:03:58.542228  8809 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:58.533463  8121 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:58.411327 11004 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.523203  8021 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 6, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 6 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.477607 11014 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:58.547299  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 174099us
I20260709 13:03:58.550289  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:58.551112  8809 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:03:58.544418  8166 leader_election.cc:336] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.646s (SENT)
I20260709 13:03:58.553293  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.420397 10527 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.543900  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.544015  8802 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:58.559686  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:58.552912  8166 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:58.561158  8806 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:58.563133  8806 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:58.562382  8021 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 3, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 3 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.563331  8121 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:58.564951  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.628046  8269 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
W20260709 13:03:58.628226  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 83846.9us
W20260709 13:03:58.628545  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 78692.2us
I20260709 13:03:58.628935  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.629635  8269 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.630013  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.505250 11040 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:58.630714  8271 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:58.632498  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.564621 10779 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.511569 10996 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.638334  8269 raft_consensus.cc:2368] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:58.637993  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:58.561609 11014 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:58.640367  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.641608  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:03:58.644760 11038 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:03:58.645416  8271 raft_consensus.cc:2368] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:03:58.646175  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.644071  8269 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.646832  8271 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.649242  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.648823  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.649652  8274 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:58.635385  8021 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: leader changed from <none> to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:03:58.688608  8269 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:03:58.691883  8271 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:58.701026  8274 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:58.703079  8271 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:03:58.703277  8269 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:03:58.703518  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65596.3us
I20260709 13:03:58.693470  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:58.632112 10840 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:58.640306 11004 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.636214 10849 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:58.705446  8269 pending_rounds.cc:85] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
I20260709 13:03:58.635527 11043 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:58.713850  8269 pending_rounds.cc:107] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:58.714262  8269 raft_consensus.cc:2889] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.709679  8021 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:58.709105  8124 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:58.710891  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:58.752523  8116 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:03:58.553406 11020 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.756529  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.757704  8269 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:58.758493  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.759845  8269 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:03:58.707055 10963 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.768352  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.642122 11040 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:58.772413  8119 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.000s
I20260709 13:03:58.743844 11043 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:58.762480 10840 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:58.713714 10849 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:58.769585  8021 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 1 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.650143 10956 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:03:58.649456 10779 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.777305  8119 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:58.707056 10948 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:58.710558 11047 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.743374 10994 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:58.753296 10889 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:03:58.787535  8122 consensus_meta.cc:287] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.000s
I20260709 13:03:58.823618  8122 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:03:58.766964 10710 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:58.793049  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 82236us
W20260709 13:03:58.765823 11025 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:03:58.794373 11039 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:03:58.794245 11043 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.801160  8121 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:58.806886  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.810040 10996 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:58.810786  8021 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 6, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 6 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.836627  8021 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.811932  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.841370  8116 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:58.798640 10849 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:58.814079 11040 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:58.819233  8811 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:03:58.828203  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:03:58.843472  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:58.849828  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50367.7us
W20260709 13:03:58.855592  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.798823 10840 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.795965 10963 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:58.867226  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.850140 11047 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:58.871953  8122 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:58.877919  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.879069  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.872277  8119 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:58.883600  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.884629  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.885334  8121 raft_consensus.cc:2410] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:58.883637  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:58.887645  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:58.888841  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.889479  8122 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:03:58.882897  8117 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:58.870379 11056 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:58.891882  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:58.890755  8117 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:58.797210 11014 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:58.896104 10750 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.896660  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:58.894845  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:58.882702 10956 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:58.881336 11047 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:58.906011  8117 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:58.898660 11034 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.898306 11043 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:58.892287 11056 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:03:58.909041 11044 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.266s	user 0.001s	sys 0.001s
I20260709 13:03:58.907984 10956 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:58.930583  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:58.929472  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78908.5us
I20260709 13:03:58.891243 10795 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:58.897864 10750 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:58.932288  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:58.891407 11058 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:03:58.909157 11047 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:58.953645  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:03:58.881044 11040 consensus_queue.cc:1175] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:58.952796 10996 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.963215  8166 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:58.962116  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:58.925014 10838 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:03:58.964493 11040 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.925047 11061 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.956123 11058 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.002120  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:58.955852 11028 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 13:03:58.962880 10796 consensus_meta.cc:287] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.107s	user 0.010s	sys 0.000s
I20260709 13:03:59.009968  8120 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:03:59.010208 11034 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:59.009866 11058 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.010679 11034 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:59.011597 11034 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:03:58.964488 11051 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:59.012460  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:03:58.963063 10992 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.987722 10840 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.010282 10796 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.015672 10796 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.016305  8267 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.019646  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:58.986817 10963 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:58.928726 11056 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.023435  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:59.010593  8125 raft_consensus.cc:2410] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:59.006923  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.049721  8196 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:59.030544  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 68523.9us
W20260709 13:03:58.992616 11030 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.598s	user 0.001s	sys 0.000s
I20260709 13:03:59.033517  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.034590  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:58.956267 10779 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.052832  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.056490  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:58.932185 10956 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:59.001773 10781 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.057080  8268 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:03:59.059976  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.055394  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
W20260709 13:03:59.053897  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 145462us
I20260709 13:03:59.016656 10849 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.059195 10781 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.062484  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.062260  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.062775  8192 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:59.008724 11036 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:59.000535 10937 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:59.058140  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 95037.5us
I20260709 13:03:59.064659  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.040689 10677 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.132256  8163 leader_election.cc:336] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.646s (SENT)
I20260709 13:03:59.132833  8193 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.136873 10849 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.053463 10963 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.091094 11004 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:03:59.065104  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.135452 11049 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.083222 10992 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:03:59.137777  8163 leader_election.cc:336] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.655s (SENT)
I20260709 13:03:59.081554 10996 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:03:59.139657  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:59.139926  8271 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:59.140815 10849 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:59.141718  8196 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:03:59.141815  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:59.134454  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69877.4us
I20260709 13:03:59.141166  8271 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:59.143144  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:59.075106  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.147125  8194 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:59.147691  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:59.148381  8120 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:59.141178 11047 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:59.142387  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 80209.8us
I20260709 13:03:59.228488  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:59.230235  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.148375  8268 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:03:59.161530 10677 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.201983 11043 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:59.202603  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:59.231518  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:03:59.204047  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 62321.9us
I20260709 13:03:59.204583 10849 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:59.205175 11061 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.063637 10909 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:59.207144  8163 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.710s (SENT)
I20260709 13:03:59.282745  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.302531  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:59.303149  8271 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:59.133873 11036 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:03:59.190686  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 45872us
I20260709 13:03:59.145032 10779 raft_consensus.cc:2764] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:59.300603  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:59.301462  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:59.300097  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:03:59.303241  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 71780us
I20260709 13:03:59.302752  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:03:59.302531  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 95404.2us
I20260709 13:03:59.299038  8807 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:59.353760  8804 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:03:59.355681  8124 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:03:59.355636  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.355232  8116 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.356418  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.353101  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.364509  8271 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.364723  8268 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:59.361624  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1437) took 1075 ms. Trace:
W20260709 13:03:59.365563  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 67185.8us
I20260709 13:03:59.365821  8266 rpcz_store.cc:276] 0709 13:03:58.286597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.286705 (+   108us) service_pool.cc:224] Handling call
0709 13:03:58.328894 (+ 42189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.373333 (+ 44439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.332336 (+959003us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54003b9a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:59.361572 (+ 29236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80146688}
I20260709 13:03:59.231580 10838 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:59.367177  8166 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.283596 11043 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:59.367154  8272 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:03:59.352054 11024 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:59.373214 11069 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:03:59.377787 11036 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.378821 11036 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.381549 11035 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.367724 10840 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:59.382856 11047 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.382545 10840 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.384536 10726 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:59.384922 10726 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:59.385458 10840 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.381052 10956 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.387562 10956 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.304466 10796 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:59.368047  8271 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:59.394819  8271 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:59.399392  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.389824  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1436) took 1103 ms. Trace:
I20260709 13:03:59.390949  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.388230 11015 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:59.303925 10710 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.395532  8271 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.302845 10909 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:03:59.367792 10963 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:59.408219  8272 rpcz_store.cc:276] 0709 13:03:58.286281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.288042 (+  1761us) service_pool.cc:224] Handling call
0709 13:03:59.352952 (+1064910us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b58000f5d98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:03:59.389750 (+ 36798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3787136}
I20260709 13:03:59.411716 10779 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.408390 11047 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:59.368072 10849 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:59.389218 11043 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.403301  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:03:59.417790  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.398113 11024 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.407992 10956 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:59.418112  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.367972 11002 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:59.419587  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.407763 10796 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:59.417812  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.423681  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.413142 10903 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.422043  8196 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:03:59.444680  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:03:59.414870 10909 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:59.425463  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:59.424348  8116 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:03:59.447448  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.447260  8803 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:59.449028 10903 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.446795 10779 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:59.414518 10710 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.450115 10840 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.453647  8197 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:59.453962 11058 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:59.420043 11061 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:59.417243 10677 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.408020 10838 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:59.456039  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.414733 10963 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:59.456288  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.460855  8268 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:59.443610 11002 consensus_queue.cc:1243] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:59.424793 11040 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:03:59.464000  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55532.1us
I20260709 13:03:59.418761 10849 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:59.445436 11014 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:03:59.468559  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.497786 11014 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.498512  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.499261 11024 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.499752 11014 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:59.499996 11024 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:59.500584 11024 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:59.501492 11024 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.504603 10849 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.505880 10849 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.507097 11006 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.499445 11043 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.468966  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.508440  8196 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:59.509411  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.509975  8196 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:59.510641  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 429) took 1448 ms. Trace:
I20260709 13:03:59.510998  8267 rpcz_store.cc:276] 0709 13:03:58.061873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.062867 (+   994us) service_pool.cc:224] Handling call
0709 13:03:58.100131 (+ 37264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.016668 (+916537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.510410 (+493742us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54003b9f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:59.510583 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106835328}
I20260709 13:03:59.458349 11018 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.460021 11031 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:59.512188 11031 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:59.512359  8267 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:59.513095 11031 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.514097 11031 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.515416 10909 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.502965 11056 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.516630  8195 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.517602 11056 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.459625 11061 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:59.520176 11061 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.509920 11043 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.474658 10988 consensus_queue.cc:1059] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:59.522979 10988 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:59.523310 10988 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:03:59.524230 10988 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.476339 10710 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:59.477923 11016 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.332s	user 0.001s	sys 0.008s
I20260709 13:03:59.473749 10779 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:59.485802 10838 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.489681 10963 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.492889 10903 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.525326 10988 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:59.528661 10963 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:59.533111  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.537114 10946 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:59.537475 10946 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:03:59.494781  8810 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:03:59.496114 10796 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.538228 10946 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.539001  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 588) took 1391 ms. Trace:
I20260709 13:03:59.539196 10946 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.539369  8810 rpcz_store.cc:276] 0709 13:03:58.148464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.209790 (+ 61326us) service_pool.cc:224] Handling call
0709 13:03:59.538832 (+1329042us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54004e2354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:59.538929 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862235008}
I20260709 13:03:59.536556 10922 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:59.540761 10922 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:03:59.511080  8196 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:59.541574 10922 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.542366  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.542752 10922 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.546286 10781 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.546751 10781 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.420208 11047 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.547540 10909 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.525064  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.493997  8270 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:03:59.552556  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:03:59.554556  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.598132  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:59.602126 11070 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.602677 11070 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.604786 11070 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.606038 11019 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:59.606535 11019 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.608536 11019 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:03:59.610137  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.612490  8116 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:59.613183  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:03:59.613817  8118 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:03:59.618775  8196 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:59.621428  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:03:59.621639  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:03:59.603156 11006 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:03:59.596199 11028 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.620209  8200 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:59.630852  8200 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:59.596566 11018 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.624848  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:59.632725  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 209121us
I20260709 13:03:59.634645  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 587) took 1491 ms. Trace:
I20260709 13:03:59.635339  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.659519  8197 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:03:59.659785  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.666563  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.638376 11034 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.611227 10710 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:59.622536 11004 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:03:59.629501 11077 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.672643  8200 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.686122  8200 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.686918  8195 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:59.681512  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:59.632484 10909 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:59.687510  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 213550us
I20260709 13:03:59.682214 11043 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.698904 11042 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:59.671895 10903 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.697100  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:03:59.710608  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.628999 11006 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.714394  8195 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:59.697767 10781 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:03:59.731315  8196 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:59.731739  8195 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.709688 11043 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.721742 11002 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.662828  8808 rpcz_store.cc:276] 0709 13:03:58.143521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.145082 (+  1561us) service_pool.cc:224] Handling call
0709 13:03:59.634479 (+1489397us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54004e8754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:03:59.634588 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300587904}
I20260709 13:03:59.739162  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.745838  8195 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:59.745878  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1449) took 1406 ms. Trace:
I20260709 13:03:59.747008  8200 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:59.748220  8200 pending_rounds.cc:85] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 3
I20260709 13:03:59.694202 11004 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.747032  8269 rpcz_store.cc:276] 0709 13:03:58.339867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.064330 (+724463us) service_pool.cc:224] Handling call
0709 13:03:59.064626 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.064817 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:59.083088 (+ 18271us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.521163 (+438075us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b180034e700. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c823a 00007fbd24d32a2a
0709 13:03:59.745391 (+224228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:59.745468 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:59.745527 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.745630 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.745782 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18341,"prepare.run_cpu_time_us":6792,"prepare.run_wall_time_us":21267,"raft.queue_time_us":3575,"spinlock_wait_cycles":19215616,"thread_start_us":219401,"threads_started":1}
I20260709 13:03:59.750828  8200 pending_rounds.cc:107] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:59.751699  8196 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:59.751761  8200 raft_consensus.cc:2889] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.699944 11077 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:03:59.753211  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.763243 10726 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.764607 10726 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.766485 11006 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.767196 11077 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:03:59.767832  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 57310.7us
I20260709 13:03:59.768550  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.770620  8166 leader_election.cc:400] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6.
I20260709 13:03:59.771425  8166 leader_election.cc:400] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:03:59.772315  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.772931 11079 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.732156 11061 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.773552 11079 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.776211  8266 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:59.778395  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.778985  8266 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:03:59.779834  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:03:59.780356  8266 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:03:59.750720 11002 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.787066 11028 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:59.787251 11002 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.789582  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:03:59.854976  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:03:59.859238  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64317.3us
I20260709 13:03:59.860028  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:03:59.862416  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.863227  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:03:59.851601  8088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.601s (SENT) [suppressed 29 similar messages]
I20260709 13:03:59.864985  8191 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:59.740357 11043 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:59.868741  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 129718us
W20260709 13:03:59.869359  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78141.9us
I20260709 13:03:59.873822  8120 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.878957  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.879586  8193 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:03:59.881551  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.877394  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:03:59.884754  8191 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:03:59.867890 11055 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:03:59.865304 11014 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.867604 10937 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.917689 11065 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:59.918066 11065 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:03:59.918097 10937 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:03:59.918908 11065 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:03:59.920101 10937 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.922160  8191 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:03:59.895000  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 105503us
I20260709 13:03:59.926699  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:03:59.867266 10849 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.884717 11006 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:03:59.884967 11081 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:59.867635 11047 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:03:59.917483 11004 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:03:59.877736 11021 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.930503  8120 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:03:59.966745  8197 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:59.874060 11043 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.970018  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1459) took 1085 ms. Trace:
I20260709 13:03:59.970419  8268 rpcz_store.cc:276] 0709 13:03:58.884140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.403021 (+518881us) service_pool.cc:224] Handling call
0709 13:03:59.403540 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.467677 (+ 64137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.969784 (+502107us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54001be9d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:03:59.969956 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126772096}
I20260709 13:03:59.974730  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:59.956748 11065 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.960513 11081 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:59.971511 10869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.043s	sys 0.022s
I20260709 13:03:59.966789 11049 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.978896  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:59.966696 11021 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:59.991787  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 140219us
I20260709 13:03:59.976706 11006 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:59.998625  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:03:59.959851 11000 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:59.999864 11093 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:03:59.972872 10996 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:03:59.993085  8197 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.985020 10946 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:59.998167 10869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.044s	sys 0.022s
I20260709 13:03:59.989653 11033 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:04:00.008976 10988 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:00.018186  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1443) took 1728 ms (client timeout 1987 ms). Trace:
W20260709 13:04:00.018548  8270 rpcz_store.cc:269] 0709 13:03:58.289447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.360218 (+ 70771us) service_pool.cc:224] Handling call
0709 13:04:00.018027 (+1657809us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400210f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:00.018133 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574893312}
I20260709 13:04:00.019703  8273 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:04:00.014074  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.986624 11081 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:00.014726  8238 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:00.020493  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.021114 10781 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:00.008824 11021 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.021330 11045 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:03:59.984721 10909 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:59.980394 11042 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:04:00.007119 11006 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:00.041144 10796 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:04:00.039870 10876 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:00.045923 11033 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:00.022912 11076 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:00.046453 11033 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:00.040038 11019 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:04:00.047425 11033 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.048542 11033 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.050415 11002 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.051136 11042 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:00.051518 11042 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:00.014937 10946 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:00.042158  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.017706 10988 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:00.039829 11031 consensus_meta.cc:287] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 13:04:00.081529 10988 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.077584 10996 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:00.074811 10946 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.082194 10996 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.084296 10996 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.086620 11043 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.090786 11079 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:00.094187 10946 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.100356 10946 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.102234 11042 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.115896 11042 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:00.122587 11048 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.366s	user 0.002s	sys 0.003s
I20260709 13:04:00.124686 11014 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:00.125121 10946 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:00.046422 10876 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.129707 10876 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.130556  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 1767) took 1258 ms. Trace:
I20260709 13:04:00.130928  8122 rpcz_store.cc:276] 0709 13:03:58.872456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.878831 (+  6375us) service_pool.cc:224] Handling call
0709 13:04:00.130387 (+1251556us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b54000b04d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:00.130481 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22776192}
I20260709 13:04:00.133792 11061 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:00.138001  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.138265 10946 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.139297 10849 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:00.139760  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.141088  8195 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:00.142594 11081 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.143901  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.139006 10876 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.145028 10948 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.145633 10948 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:00.143028  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.147557 10948 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.148514  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:00.149046  8124 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:00.148937 10988 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.149739 10784 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.150187 10784 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.150493 11043 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.152096 10784 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.152841 10876 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:00.160265  8199 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:00.160677  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.161249  8195 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.168018  8195 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:00.150451  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.154573  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:00.171583  8122 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:00.155591  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:00.153273 10946 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.152473 11021 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:00.174119  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 290047us
W20260709 13:04:00.177690  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 154000us
W20260709 13:04:00.180146  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 282678us
I20260709 13:04:00.181705  8777 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:00.181906  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:00.185082  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:00.187255  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:00.188386  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:00.177434 11076 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:00.200129  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:00.185071 10796 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:00.203954  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:00.204519  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:00.204939  8266 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:00.188637 10876 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:00.206171  8804 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:00.185528 10964 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:00.206806  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:00.191663  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:00.204445 11032 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:04:00.209412 11028 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:00.209827 11028 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:00.210192 11028 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.188364 11014 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:04:00.205265 11024 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:00.214910 11024 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:00.215814 11024 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.189620 11070 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:00.208940  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:00.218003  8270 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:00.206749  8267 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:00.191669  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:00.221021 11033 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.220286 10876 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:00.223176 11105 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:00.225241 10988 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.328425 10876 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.219731 10796 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:00.328920 10876 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.329648 10796 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.226158 11081 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.231020 10527 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.232208 10726 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:00.333550 10726 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:00.217738 11076 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.217059 11028 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.239638  8271 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.333822 11070 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.347327 11070 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.247562  8117 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.248137 11015 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:00.349587 11015 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:00.350370 11015 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.249868  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:00.351714  8808 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:04:00.250391 11000 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:00.352510 11000 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.353456 11028 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.250636 11108 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:00.354451 11108 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.356346 11108 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.250752  8803 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:00.250290  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:00.349167 11070 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:00.251250  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:00.251848 11032 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:00.255853 11049 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:00.361693  8117 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:04:00.362007 11049 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:00.363966 10889 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:04:00.364312  8117 pending_rounds.cc:85] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 4
I20260709 13:04:00.253482  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1456) took 1373 ms. Trace:
I20260709 13:04:00.258775  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:00.344290  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:00.365235  8273 rpcz_store.cc:276] 0709 13:03:58.880526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.383291 (+502765us) service_pool.cc:224] Handling call
0709 13:04:00.019456 (+636165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.020051 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.253282 (+233231us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400210f50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:00.253424 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462611712}
I20260709 13:04:00.366057  8802 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:00.366367 11032 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:00.367158 11032 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.364575  8117 pending_rounds.cc:107] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:04:00.373335  8117 raft_consensus.cc:2889] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:00.374500  8117 pending_rounds.cc:107] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:00.375408  8117 raft_consensus.cc:2889] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:00.376780  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1847) took 1521 ms. Trace:
I20260709 13:04:00.378654  8117 rpcz_store.cc:276] 0709 13:03:58.855081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.874793 (+ 19712us) service_pool.cc:224] Handling call
0709 13:03:58.875187 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.775516 (+900329us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b1800211920. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d63646 00007fbd24c9d58e 00007fbd24d1ef9e 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:00.247397 (+471881us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b58002ddad0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d1efe7 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:00.376540 (+129143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.376724 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850322048}
I20260709 13:04:00.364024  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1799) took 1587 ms. Trace:
I20260709 13:04:00.381712  8271 rpcz_store.cc:276] 0709 13:03:58.776168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.367678 (+591510us) service_pool.cc:224] Handling call
0709 13:03:59.367949 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.239189 (+871240us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5800500fd0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d1efe7 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:00.363680 (+124491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.363710 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.363749 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:00.363778 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.363854 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.363968 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2829,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":864869120}
W20260709 13:04:00.532217  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.498039  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.397969  8811 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:00.679338  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.679792  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.674928  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 454553us
W20260709 13:04:00.681286  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.681210  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:00.685370  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:00.688117  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:00.689744  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:00.689915  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:00.690546  8273 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:00.694090  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:00.477773 11077 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.695199  8810 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:00.466657 11107 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:00.477737 10946 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.674718 11015 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.690023 11076 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.692236 11032 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.697093  8777 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:00.397244 11049 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.703135  8809 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:00.417294 10876 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:00.706112  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.690231 11081 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:04:00.697577 10527 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:00.708464  8125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1836) took 2427 ms (client timeout 2537 ms). Trace:
I20260709 13:04:00.717072  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:00.717252  8125 rpcz_store.cc:269] 0709 13:03:58.280898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.337517 (+ 56619us) service_pool.cc:224] Handling call
0709 13:04:00.708324 (+2370807us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b5400307354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:00.708425 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513264384}
I20260709 13:04:00.707340  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1852) took 1095 ms. Trace:
I20260709 13:04:00.714752  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:00.718401  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:00.719242  8809 raft_consensus.cc:2410] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:00.699342 11014 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:00.708586  8124 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:00.718660  8120 rpcz_store.cc:276] 0709 13:03:59.612368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.621168 (+  8800us) service_pool.cc:224] Handling call
0709 13:04:00.707205 (+1086037us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54000affd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:00.707292 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578772352}
I20260709 13:04:00.696347 11107 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:00.721638  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.698503 10946 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:00.724095  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.705264  8805 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:00.706439 11000 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.720451 11014 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.719375 10527 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.724496 11075 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:00.714270 10964 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:00.726828  8194 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:00.726486  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 799884us
I20260709 13:04:00.704226 11076 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.726305  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.732836  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:00.727701  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.726832 11049 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.735972  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.742730  8195 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:00.736299  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.743397  8238 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:00.737025  8198 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:00.744215  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.736922 11065 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:00.737392  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 546258us
I20260709 13:04:00.729763 11014 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.749117  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.749768  8198 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:00.740867 11028 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:00.744912  8195 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
W20260709 13:04:00.747288  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.756805  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.758005  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:00.759104  8163 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:00.748133  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:00.731631 11075 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:00.698019 11077 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.754324  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.737013 10876 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.761327  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.732051 11000 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.769740  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.774799  8166 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:00.746640 11021 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:00.755067 11043 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:00.766584 11061 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:00.766794 11063 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:00.781519  8804 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:00.760526 11028 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:00.772943 11049 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:00.773548 11079 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.768731 11075 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.782205 10849 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:00.795662  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:00.755193 11065 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.803123  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.792974  8123 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:00.782791 11043 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:00.810230 10963 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.784358 11063 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:00.793951 10946 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.815040  8194 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:00.795028 11028 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:00.791776 11107 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.813318 10963 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.774250 11000 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.796855 11021 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:00.813567 11109 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:04:00.811414 11043 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:00.819074 11063 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.832320  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:00.818656 10903 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:00.853160  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:00.803781 11049 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:00.855341  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:00.869432  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:00.874348  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:00.863770  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 121736us
I20260709 13:04:00.896325  8273 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:00.853909 11077 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:00.900046  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 183607us
I20260709 13:04:00.887002 11107 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.870939 11033 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:00.940639  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.922588  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.957139  8194 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:00.863283 10849 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:00.954150  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 267295us
I20260709 13:04:00.961445  8120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:04:00.851917 11021 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:00.969455  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.970579  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:00.971506  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:00.972010  8194 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:04:00.898483 10946 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.918228 10948 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:00.890421 11081 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:00.924376 10903 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:00.978412  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:00.988466  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 44911.6us
I20260709 13:04:00.974131 11076 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.938277 11061 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:00.972898 11101 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:04:00.997470  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 142225us
I20260709 13:04:00.995178  8120 raft_consensus.cc:606] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.000731  8120 raft_consensus.cc:614] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:00.955017 10527 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.961223 10849 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:00.991710 11081 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:01.025270 11000 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.025701 11081 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.025913 11000 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.026388 11000 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.028342 11000 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:00.993835 10796 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:00.996764 11055 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.014925 10527 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.015036 10849 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.023228 11133 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:01.023703 11049 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:01.025533 11114 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:04:01.035995  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 77382.8us
I20260709 13:04:00.991470 10946 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.049256 10903 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:01.049858 10903 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.055408  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.056095  8803 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:01.056877 11065 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.057368 11118 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:04:00.997848 11120 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:04:01.058522  8123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1834) took 2792 ms (client timeout 2729 ms). Trace:
W20260709 13:04:01.058892  8123 rpcz_store.cc:269] 0709 13:03:58.270028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.398238 (+128210us) service_pool.cc:224] Handling call
0709 13:04:01.058366 (+2660128us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b540029ac54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:01.058458 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5249240960}
I20260709 13:04:01.063726 11063 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.066572  8195 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:01.072247  8807 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:01.066028 11063 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:01.089257  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.082044 11065 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.102232 11065 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.107164  8195 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
W20260709 13:04:01.106143  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 152169us
W20260709 13:04:01.107052  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 187462us
I20260709 13:04:01.041596 10527 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.110539  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:01.114259  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.114825  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:01.045275 11133 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.115859  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:01.116612  8811 raft_consensus.cc:2368] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:01.116950  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.032706 11061 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.118057  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.120164  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.120520 11108 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:01.123957 11108 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:01.124910 11108 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.125792 11033 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:01.126278 11033 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:01.126791  8196 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:01.129405 10903 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.130568  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.132655 10937 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:01.132429 10849 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.133033 10937 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.133430 10937 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.136250  8805 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:04:01.138012  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.139837 10527 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.140312 11055 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:01.109722 11014 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.121914 10946 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.143401  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.144461  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.145558 11079 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.146766  8119 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:01.146273  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1872) took 1005 ms. Trace:
I20260709 13:04:01.146740  8163 leader_election.cc:400] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:01.147693  8163 leader_election.cc:403] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:01.147342  8191 rpcz_store.cc:276] 0709 13:04:00.140569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.145182 (+  4613us) service_pool.cc:224] Handling call
0709 13:04:00.145504 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.726041 (+580537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.726071 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.726477 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.856228 (+129751us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:00.856281 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.856347 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.146072 (+289725us) raft_consensus.cc:1685] finished
0709 13:04:01.146091 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.146216 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580182,"raft.queue_time_us":580381,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":129407,"threads_started":1,"wal-append.queue_time_us":417659}
I20260709 13:04:01.150578  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.152539  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.149732  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.153649  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.154209  8804 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:01.154686  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.154206  8123 raft_consensus.cc:2376] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4. Re-sending same reply.
I20260709 13:04:01.154598  8124 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:01.159304  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.160657  8119 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:01.166464  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.115414 11119 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.169785  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.167655  8120 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:01.115597 11118 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.173187  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.173882  8122 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:01.173650 11081 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.117694 11134 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.114775 11065 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.174327 11133 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:01.177670 11021 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.180685 11043 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:01.181823 11129 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:04:01.146023 10937 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.186034 11028 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.187674 11006 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.188922  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.210494  8125 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:04:01.191803  8124 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:04:01.194516  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.197453 11075 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.176148 11119 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.200070  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.213326  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.201740  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.214884  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.215413  8119 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:01.204458  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 211418us
I20260709 13:04:01.205233  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.207973  8118 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:01.199328 11055 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:04:01.226007  8121 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:01.210968  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.211257  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:01.220163  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 257268us
I20260709 13:04:01.231712  8809 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:01.211514  8123 raft_consensus.cc:2393] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:01.153883 11131 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:01.218113  8116 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:01.232136  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.226646  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.234961  8124 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:04:01.235772  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.233275  8273 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:01.236370  8122 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
W20260709 13:04:01.208738  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 232244us
I20260709 13:04:01.231197  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.238049  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.232683  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:01.244694  8118 raft_consensus.cc:2393] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:01.246616  8125 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:01.249083  8119 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:01.197167 11118 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.253803 10937 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.241055 11006 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.202649 11134 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.262873 10726 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.264083 10726 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.264541  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:01.265764 11117 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:01.266358 11117 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:01.267088 11021 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:01.267360 11118 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.268399  8117 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:01.268769 11021 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:01.270464 11075 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.270666 11028 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.272215  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.272383 10946 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:01.273676 10946 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:01.274142 10946 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:01.274931 10946 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.275790 11147 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:01.278278 11081 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.280319 11014 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.282246 11043 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.287335  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.287734 11134 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.290993  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.291678  8804 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:01.297713  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:01.301975  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:01.303002  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.303746 11021 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.304415  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.304347 11117 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:01.305202 11021 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:01.306118  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.306792  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.307536  8808 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:01.305645 11117 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:01.309739  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:01.312704  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.313622  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:01.314181  8192 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.314416  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:01.315029  8193 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.314476  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:01.310181 11117 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:01.316306 11144 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:01.316461 11118 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.316931 11118 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.317950  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.317646 11117 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.318483  8191 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:01.318781 11117 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.318869 11118 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:01.319664  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.321069  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:01.321827  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.322067 11115 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:01.322486  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.322623 11115 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.323053  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.323417 10796 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:01.324615 11115 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.324327 10796 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.322922 10677 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:01.316838  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.317574  8197 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:01.314735  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.329208  8120 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:04:01.318996  8198 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:01.330338  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.332901  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.351703  8192 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:01.334304  8120 pending_rounds.cc:85] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 6
I20260709 13:04:01.353255  8120 pending_rounds.cc:107] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:04:01.354023  8120 raft_consensus.cc:2889] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:01.355975  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 56319.6us
I20260709 13:04:01.282286 11119 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.360311  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.303855 10963 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:01.362819  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 254487us
I20260709 13:04:01.321972 10876 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:01.363619  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:01.366822  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.367399  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.316396 11021 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.325127 11115 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:04:01.346871 11131 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.331761 10677 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.362784  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:01.329919 11055 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.373062  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.331068 11014 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:01.369513  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.381314  8118 raft_consensus.cc:2376] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6. Re-sending same reply.
I20260709 13:04:01.358757 11118 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:01.374797  8191 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:01.374038  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.375747  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:01.370064  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:01.377986  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:01.379812  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:01.401136  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.403441  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.405510 11118 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.315452 11043 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:04:01.406472  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.377485 11137 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.406919  8191 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:01.373777 11079 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:01.409691  8273 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:01.410960  8272 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:01.417459 11139 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:01.419656 11139 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:01.421245  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:01.421428  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 57801us
I20260709 13:04:01.411758  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.373512 10677 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.374064 11065 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:01.430160  8806 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:04:01.418599 11146 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:01.407330  8193 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:01.412802  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.432097  8269 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:01.432413  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.432870  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.412277  8271 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:04:01.433518  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.412550  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.434159  8265 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:01.435042 11121 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:01.435292  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.435868  8269 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 4.
I20260709 13:04:01.437104  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.429103 11065 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:01.437973 11065 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.439054  8268 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:01.436582  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.412014 11140 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:04:01.441555 10903 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:01.442042 10903 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.444036 10903 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.419898  8270 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:01.384503 10963 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.420522 11139 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:01.418370  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 185763us
I20260709 13:04:01.444739 10963 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.408753 11047 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:01.446200 11047 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:01.446682 10963 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.414443 10527 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.423943 11115 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:01.414871 11124 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.418506  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.460852  8272 raft_consensus.cc:2410] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:01.418651  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.426051  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.380370 11075 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:01.425127  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.465150  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.465777  8272 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:01.413280  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.413411  8163 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.438056  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.418080  8197 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:01.442340 11140 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:01.424440  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:01.418009  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 48025us
I20260709 13:04:01.461612  8267 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.462071  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.417160 11079 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:01.470228  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 56905us
I20260709 13:04:01.447341 10527 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.432394  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.474047  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.474858  8193 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:01.471971  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.475760  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.475656  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.476166  8270 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.476778  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.476322  8124 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:01.477869  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.478523  8193 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:01.479645  8193 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:01.479513  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.481282  8193 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:04:01.481518  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:01.483227  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:01.483613  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.484169  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:01.380553 10876 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.487552  8193 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:01.414160 11118 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:01.490113  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.490653  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.450217 11024 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.417367 11014 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:04:01.503957  8124 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:01.504877  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.503293  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.506242  8123 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:01.506867  8270 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:01.508256  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.493168  8267 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:01.498322  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.510818  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:01.500598  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.501272  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.470978 11115 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.477052 11079 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.509457  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.476588 11134 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.469733 11146 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:01.514196  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.477327 11126 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:01.469638 11140 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:01.518061  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.516793  8089 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.522441  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.523455  8270 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:01.422065 11137 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.488708 11075 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:01.530224  8193 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:04:01.476828 11136 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:04:01.503870 11021 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:01.521859  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:01.533941  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.504151 11108 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:01.500272  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:01.503598 10963 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:01.538856  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:01.559497  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:01.523026 11115 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.447070 11047 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.530966  8124 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:01.561865  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:01.541491 11037 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.513041 11024 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.547812 11075 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:01.561040  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:01.566150 11141 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.526470 11119 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.555889 11033 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.643632  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:01.644765  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 128048us
I20260709 13:04:01.648641  8123 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:01.566912 11170 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:01.568379  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:01.665947  8089 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:01.671361  8808 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:01.569694  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.544301 11126 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:01.552567  8116 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.526495 11076 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:04:01.469611 11124 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.571966  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:01.469858 11121 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.589555  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.532797 11006 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:04:01.555081 11021 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.623991  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.589105 10963 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:04:01.626020 11152 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:04:01.626708 11159 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:04:01.627300 11153 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:04:01.629422  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:01.534444 11134 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.564656 11142 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.563030 10988 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:01.568531  8193 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:01.561234  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:01.565065 10796 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.639463 11065 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:01.644804 11114 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:01.642298 11075 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.641981 11146 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.634675 11140 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:01.683421  8269 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:01.731335  8268 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:01.729954 11124 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.907532 11021 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.671427 11170 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:01.681442 11151 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:04:01.909446  8118 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:04:01.721417 11126 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:01.645079 11141 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:01.723109 11162 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:01.720219 10903 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
I20260709 13:04:01.720788 10527 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.644829 11136 consensus_queue.cc:1243] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:04:01.676519 11122 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.724609 11033 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.797601  8116 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:01.848086  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:01.928858  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 360565us
I20260709 13:04:01.726979 11137 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:01.958285  8118 pending_rounds.cc:85] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 7
I20260709 13:04:01.980341  8118 pending_rounds.cc:107] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:04:01.980612  8118 raft_consensus.cc:2889] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:01.960892  8191 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:01.980895  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 453) took 1211 ms. Trace:
I20260709 13:04:01.981264  8195 rpcz_store.cc:276] 0709 13:04:00.760370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.761106 (+   736us) service_pool.cc:224] Handling call
0709 13:04:01.971224 (+1210118us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540022c254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:01.971330 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684003072}
I20260709 13:04:01.664117 10677 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:01.882445 11117 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.001s
I20260709 13:04:01.983173  8119 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:04:01.682314 11157 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:04:01.726363 11024 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:01.728323 11119 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:01.973121  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:01.930699  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.917371 10946 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:01.957770 11144 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:01.937548 11170 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.972506 11063 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.937819 10796 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.000829 11122 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:02.011390 11137 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:02.008826 11124 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.025251 11121 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.029623  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.058866  8273 raft_consensus.cc:2376] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5. Re-sending same reply.
I20260709 13:04:02.000989 11117 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:02.013371  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:02.061228  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47939.5us
I20260709 13:04:02.000887 10946 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:02.024029 11065 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.005383 11144 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:02.009070 10876 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.049239  8195 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:02.051170  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:02.057336  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 386916us
I20260709 13:04:02.058215  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.067912  8274 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:02.059589  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.068894  8193 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:02.059612  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:01.917498 11142 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.063730  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.070334  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:02.008019 11006 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:04:02.071568  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.072840  8273 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:02.077129  8272 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.077625  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.078699  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.079190 11136 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:02.060856 11117 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:02.081198 11117 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.082620 11117 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.084141 11142 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.074010 11119 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:02.084831 11119 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.085155 11119 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:02.086061  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.086733  8265 raft_consensus.cc:2368] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:02.087414  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.088299  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.090041 11134 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.090303  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.091259  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.091876  8267 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:02.093405  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:02.079227  8273 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:04:02.094208  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.089989  8805 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:04:02.089164  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.070420  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:02.029814 11163 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:02.013024 11063 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.110525  8265 raft_consensus.cc:2368] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:02.100359  8806 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:02.107915  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:02.082545 11079 consensus_meta.cc:287] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.001s
I20260709 13:04:02.071262 10946 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.076478 10876 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:02.074334 11137 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.071852 11144 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.116645  8274 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:02.118227  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:02.138967  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 68616.4us
I20260709 13:04:02.124558  8272 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:02.076260 11121 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:02.140781 11046 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:04:02.153565 11121 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.037796 11122 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.156296 10946 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.059667 11115 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.152251 10677 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.158618  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.061529 11124 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.198108  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:02.220677  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.238770  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:02.202801  8116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:04:02.176880  8267 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:02.260360  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:02.230602  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 175009us
I20260709 13:04:02.224462  8271 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:02.174600  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.285449  8200 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:02.244259 11179 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:02.116073 11033 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.114655 11163 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.135370 10876 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.146024 11137 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.120541 11079 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.190958 11046 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 13:04:02.201633  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 131373us
I20260709 13:04:02.138319 11055 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:02.285584  8272 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:02.285625  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.286366  8193 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:02.319319  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.309031  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 342) took 1121 ms. Trace:
I20260709 13:04:02.326781  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 332) took 1175 ms. Trace:
I20260709 13:04:02.311656  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:02.399433  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 113875us
I20260709 13:04:02.400339  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.398742  8117 rpcz_store.cc:276] 0709 13:04:01.151650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.152293 (+   643us) service_pool.cc:224] Handling call
0709 13:04:02.326623 (+1174330us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400307d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:02.326727 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265231104}
I20260709 13:04:02.334861  8195 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:04:02.403414  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.399969  8120 rpcz_store.cc:276] 0709 13:04:01.188472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.189369 (+   897us) service_pool.cc:224] Handling call
0709 13:04:01.189616 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.354425 (+164809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.308796 (+954371us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400085054. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:02.308964 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320256768}
I20260709 13:04:02.403280  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:02.403931  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:02.404212  8200 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:02.404304  8123 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.217438 11142 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:02.406212  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.163838 11134 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:02.405272  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:02.307096 11118 consensus_meta.cc:287] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.797s	user 0.005s	sys 0.002s
I20260709 13:04:02.395642  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.415617  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:02.287837 11121 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.216799 11122 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.318248 11115 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.406162 11047 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:02.297425 11033 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.428807 11047 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.430184 11033 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.417421  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.431347 11047 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.432123  8805 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:02.399605 10903 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:02.431838  8124 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:02.424177  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:02.158839 11049 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:02.423561  8123 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
W20260709 13:04:02.318886 11181 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:04:02.424150  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.444576  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.397516 11137 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.426513  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.427220  8194 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:02.396680 11055 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:02.229457 10946 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.435189  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.283126 10849 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.406049 11173 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:02.409117 10988 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.408979 11065 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.438450  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.402850 11021 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.442108  8810 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:02.442551  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:02.455008  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.445080  8166 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:02.445326  8120 raft_consensus.cc:2410] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:02.447167  8195 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:02.320948 11119 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.321779 11075 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.417985 10726 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.411445 11134 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.452217  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:02.456300  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:02.431830 11047 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:02.456521  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:02.458316  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:02.459488  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.443725 11046 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:02.417143 11118 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.416888 11142 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.449334 11063 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.323074 11170 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.449091 10796 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.496398  8117 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:02.496966  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:02.528213  8195 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:02.528564  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69147.5us
I20260709 13:04:02.564116  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:02.564563  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 67724.1us
I20260709 13:04:02.460525 10946 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:02.472930 11126 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:02.458791 11115 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:02.470393 11198 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:04:02.565451  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.566658  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:02.532819 11193 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:02.442684 10903 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.568168  8123 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:02.496992 11134 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:02.533700  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 75456.6us
I20260709 13:04:02.598070  8166 leader_election.cc:400] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:02.470144 11049 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:02.574903  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1480) took 1156 ms. Trace:
I20260709 13:04:02.457444 10988 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.580111  8125 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:02.457561 11065 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.532924 11177 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:02.574023 11117 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:02.529315 10964 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:02.496309 10726 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.599478  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:02.499179 11122 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.599718 11187 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:02.600841 11079 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.574723 11033 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:02.601600  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.622969  8273 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:02.556646 10849 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:02.602841  8268 rpcz_store.cc:276] 0709 13:04:01.418857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.439703 (+ 20846us) service_pool.cc:224] Handling call
0709 13:04:01.439921 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.905258 (+465337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.574670 (+669412us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001c2fd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:02.574838 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669471104}
I20260709 13:04:02.625542 11171 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.562263 11183 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:02.567175 11014 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.612746 11180 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.612851  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.602257 10796 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:02.626690  8274 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.626518 11180 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.613564 11163 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.630332 11180 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.582607  8195 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:02.631258  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.632117  8195 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:02.577749 11126 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:02.633541 11126 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.619123  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:02.633107  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:02.635506  8195 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.533331 11047 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.642941 11047 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.621635 11065 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.621932 10988 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:02.615212  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 114766us
I20260709 13:04:02.635015  8274 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:02.645267 11063 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.650681 11170 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.651882 11075 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.658587 10903 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.562460 11055 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.659557 11055 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.662222 11119 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.664283 11118 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.665186 10876 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.581624 10946 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:02.666280 10946 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.664330  8195 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:02.457279 11173 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.669478  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.672640 11021 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.674137  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:02.675190  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1484) took 1255 ms. Trace:
I20260709 13:04:02.675539  8271 rpcz_store.cc:276] 0709 13:04:01.419931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.433862 (+ 13931us) service_pool.cc:224] Handling call
0709 13:04:02.675028 (+1241166us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54002eccd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:02.675140 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741923712}
I20260709 13:04:02.677594 11120 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:02.677953 11120 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:02.678671 11120 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.681466  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1859) took 1182 ms. Trace:
I20260709 13:04:02.681836  8119 rpcz_store.cc:276] 0709 13:04:01.499444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.500380 (+   936us) service_pool.cc:224] Handling call
0709 13:04:02.681278 (+1180898us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54004097d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:02.681413 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083928448}
I20260709 13:04:02.683522  8192 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:02.684547  8192 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:02.685940  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 490) took 1122 ms. Trace:
I20260709 13:04:02.686321  8811 rpcz_store.cc:276] 0709 13:04:01.563302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.563409 (+   107us) service_pool.cc:224] Handling call
0709 13:04:01.590342 (+ 26933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.958317 (+367975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.958349 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:01.958391 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:01.958426 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.685725 (+727299us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54005b0254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:02.685771 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.685886 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845886336}
I20260709 13:04:02.689661  8192 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:02.605507 11198 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:02.697208  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78172.3us
I20260709 13:04:02.698534  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 1886) took 1215 ms. Trace:
I20260709 13:04:02.698874  8197 rpcz_store.cc:276] 0709 13:04:01.483295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.484782 (+  1487us) service_pool.cc:224] Handling call
0709 13:04:02.698283 (+1213501us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54000299d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:02.698463 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086810368}
I20260709 13:04:02.699549  8166 leader_election.cc:400] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:02.700043  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1792) took 1224 ms. Trace:
I20260709 13:04:02.700380  8118 rpcz_store.cc:276] 0709 13:04:01.475156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.475271 (+   115us) service_pool.cc:224] Handling call
0709 13:04:01.496876 (+ 21605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.986747 (+489871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.699852 (+713105us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540029b654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:02.699991 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948177152}
I20260709 13:04:02.702401  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:02.702843  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 137508us
I20260709 13:04:02.600072 11174 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.163s
I20260709 13:04:02.705166  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1476) took 1293 ms. Trace:
I20260709 13:04:02.714437  8266 rpcz_store.cc:276] 0709 13:04:01.411681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.413070 (+  1389us) service_pool.cc:224] Handling call
0709 13:04:02.697870 (+1284800us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54003b9f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:02.705113 (+  7243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181343488}
I20260709 13:04:02.716316  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:02.717033  8810 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:02.578696 11070 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:04:02.718257  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.656808 11144 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.670006 11173 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:02.724217  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:02.694227 11183 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:02.696908 10796 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:02.729611  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.694954 11033 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:02.714429 11047 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:02.728392  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.733456  8267 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:02.727332  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:02.626345 11014 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.736470  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.730309  8274 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:02.732682  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.739055  8273 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.719273 11180 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:02.734875  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:02.694824 11122 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.725875 11065 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:02.734521 11173 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:02.737149 11183 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.670068 10964 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.736544  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:02.731436  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.781220  8271 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:02.781788  8266 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:02.750651  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:02.782645  8267 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:02.750950 11177 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.751605  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1860) took 1251 ms. Trace:
I20260709 13:04:02.752473  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:02.785300  8199 raft_consensus.cc:2376] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10. Re-sending same reply.
I20260709 13:04:02.752926  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:02.754102  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:02.754760  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.755132 11079 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:04:02.740797 11203 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:02.760198  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:02.790445  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.766587 11198 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.772820 10796 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.797487  8119 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:02.788591  8120 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:02.783661  8122 rpcz_store.cc:276] 0709 13:04:01.499713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.499825 (+   112us) service_pool.cc:224] Handling call
0709 13:04:01.519618 (+ 19793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:02.306318 (+786700us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18000b9920. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd248d04bc 00007fbd21c1e48b 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd24d20060 00007fbd24d20bfb 00007fbd24d2b64b
0709 13:04:02.306432 (+   114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.306455 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:02.306884 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.447755 (+140871us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:02.472371 (+ 24616us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.472583 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.472667 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.751339 (+278672us) raft_consensus.cc:1685] finished
0709 13:04:02.751434 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.751550 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9383,"prepare.queue_time_us":27139,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":37033,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8297,"spinlock_wait_cycles":55255040,"thread_start_us":182019,"threads_started":2,"wal-append.queue_time_us":304512}
I20260709 13:04:02.791102  8124 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:02.799926  8273 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:02.752907 11142 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.805704  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.801968  8271 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:02.807083  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.807725  8124 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:04:02.808748  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.809516  8124 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:02.803970  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:02.792845 11065 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:02.804986 10964 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:02.797410 11173 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:02.814034  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.841447  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.812902  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:02.740722 11204 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:04:02.842691  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.845631  8120 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:02.845023  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:02.846318  8122 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:02.792784 11191 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:02.845916 11033 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.779295 11180 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.864912 11190 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:02.865379 11190 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:02.865643  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1494) took 1376 ms. Trace:
I20260709 13:04:02.866142 11190 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.866690  8270 rpcz_store.cc:276] 0709 13:04:01.488758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.904373 (+415615us) service_pool.cc:224] Handling call
0709 13:04:01.960576 (+ 56203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.987253 (+ 26677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.987281 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:02.736922 (+749641us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b2c0012ef08. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:04:02.737275 (+   353us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.778914 (+ 41639us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:02.778949 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.779023 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.865367 (+ 86344us) raft_consensus.cc:1685] finished
0709 13:04:02.865386 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.865587 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26329,"raft.queue_time_us":101346,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":8188,"spinlock_wait_cycles":31216000,"thread_start_us":41325,"threads_started":1,"wal-append.queue_time_us":102937}
I20260709 13:04:02.867684 11173 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.874753 11014 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.828969 11126 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.875891  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.877281 11141 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:02.792801 11177 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:02.879901 11065 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.882239 11134 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:02.883256  8121 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:02.883710  8116 raft_consensus.cc:606] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:02.884074  8116 raft_consensus.cc:614] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:03.009763  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:02.917156  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 126485us
W20260709 13:04:02.957639  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.984211  8122 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:04:02.917819  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.072058  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:03.075026  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.034487  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:02.904795  8267 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:03.077032  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:02.893164  8124 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:03.081151  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:03.083149  8124 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:03.085867  8270 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:03.086311  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:03.089139  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.089915  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:03.090629  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.091079  8192 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:03.089972  8199 raft_consensus.cc:2410] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:03.091972  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.092514 11079 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:03.094303  8163 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.086038 10988 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.989907 11205 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:04:03.095402 11118 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:02.990783 11137 consensus_meta.cc:287] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.001s
I20260709 13:04:03.070602 11190 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.091914 11115 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:03.100740  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:03.032873 11204 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.891526 11122 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:03.003362 11063 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.032877 11141 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:02.989614 11144 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.085858 10677 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:03.093657 11199 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:03.084471 11055 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:03.098289 11043 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:03.171056 11043 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:03.171468 11043 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.148550 11204 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.118547 11028 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:04:03.172669 11187 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:03.172982 11187 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:03.102510 11121 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:03.173828 11121 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.173756 11187 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.175101 11187 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.175850 11121 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:03.105383 11137 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.178442 11137 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.118384 11189 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:04:03.179623 11189 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:03.179942 11189 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:03.181250  8119 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:03.183403  8806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 609) took 1624 ms (client timeout 1516 ms). Trace:
I20260709 13:04:03.183873 11204 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:03.185544  8125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1861) took 1685 ms (client timeout 1972 ms). Trace:
W20260709 13:04:03.185920  8125 rpcz_store.cc:269] 0709 13:04:01.499971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.500067 (+    96us) service_pool.cc:224] Handling call
0709 13:04:03.185381 (+1685314us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003cf5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:03.185492 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359182592}
I20260709 13:04:03.188285  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1819) took 1154 ms. Trace:
I20260709 13:04:03.096237 11079 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:03.190286 11079 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:03.192652  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.192696  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.137763  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:03.193719  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56041us
I20260709 13:04:03.194011 11137 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:03.194411 11137 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.138531 11164 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:03.194806 11137 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.120188 11115 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.197175 11115 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.139565 11077 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:03.144074  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:03.145932  8273 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:03.205729  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:03.206248  8273 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.095726 10988 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.146665  8266 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:03.105443 10903 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:04:03.122612  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:03.251914  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.085711 11209 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:03.103399 11075 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:03.168797 11199 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:03.262125 11199 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.205181 11055 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.139135 11208 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:03.198160  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.194393  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.200466  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.188624  8265 rpcz_store.cc:276] 0709 13:04:02.033851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.111198 (+ 77347us) service_pool.cc:224] Handling call
0709 13:04:02.111505 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:02.413752 (+302247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.413782 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:02.414199 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.549658 (+135459us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:02.698332 (+148674us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.698609 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.187943 (+489334us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400308ed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:03.187987 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.188037 (+    50us) raft_consensus.cc:1685] finished
0709 13:04:03.188122 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.188238 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":229918,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":14819,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12064,"spinlock_wait_cycles":694512512,"thread_start_us":249597,"threads_started":2,"wal-append.queue_time_us":204882}
I20260709 13:04:03.201541  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:03.271965  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 73923.7us
W20260709 13:04:03.183761  8806 rpcz_store.cc:269] 0709 13:04:01.558623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.558766 (+   143us) service_pool.cc:224] Handling call
0709 13:04:03.183223 (+1624457us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54004e2354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:03.183344 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920495488}
W20260709 13:04:03.272476  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 78156us
I20260709 13:04:03.208587  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.275306  8193 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:03.180717 11189 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.252811  8197 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:03.275259  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:03.260193  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 137804us
I20260709 13:04:03.205390 11115 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.278340  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:03.278512  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:03.279145  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 181359us
I20260709 13:04:03.279168  8265 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:03.279284  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:03.224289  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 80278.6us
I20260709 13:04:03.258522  8273 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:03.272785  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.201983  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.280809  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.280944  8192 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.281391  8273 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:03.167054 11046 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.204687 11063 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.284580  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.294880  8196 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.294744 11063 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.297432 11063 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.297914 11063 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:03.298349 11063 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.301607  8196 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:03.302806  8196 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:03.283671  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.258800 11204 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:03.259660 11209 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.261137 11075 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.312041  8265 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:03.316906  8192 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:03.106401 11118 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.317525  8196 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:03.324373  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.271929 11077 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:03.324883  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.323604  8193 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:03.328424  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.323755  8192 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:03.278151 11187 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.332108  8197 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:03.222430 11147 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:04:03.335883  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.167512 11141 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.306051 11121 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:03.321836 10964 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:03.325872 11075 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.344597  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.311376 11204 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.342979  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.332230 11193 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:03.317531 11209 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:03.336668 11189 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.357430  8197 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:03.357529  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.358289  8193 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:03.332633 11115 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:04:03.335533 10796 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:03.342557 10963 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:03.388867 11223 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:03.322953 11046 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.395550  8193 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:03.393419  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.348409 10876 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.398536  8197 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:03.344664 11121 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:03.400875  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 120358us
W20260709 13:04:03.403476  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 96763.8us
I20260709 13:04:03.355895 11204 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:03.359395 11180 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.385849 11063 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.344341 11119 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:04:03.423943  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.421254  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:03.393493 11024 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:03.355681 11144 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:03.392926 11193 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:03.401796 11121 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.430974  8195 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:03.431607  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.352843 11183 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:04:03.386622 11014 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:03.400228 11174 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:03.436187  8197 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:03.402478 11208 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:03.393201 10677 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:04:03.453178  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51963.4us
I20260709 13:04:03.453898  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.460336 11138 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:03.461053 11141 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.461828 11193 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.464176 10988 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.466445 11184 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.466904 11184 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.469846 11118 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.470356 11118 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:03.470669 11118 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:03.471386 11118 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.460736 11138 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:03.472447 11118 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.445250 11021 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.472458 11138 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:03.476511 11228 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:04:03.397456 11216 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:04:03.450214 11147 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.474346  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.473230  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:03.482483  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.482625  8197 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:04:03.450443 11144 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:03.452704 11055 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.474059  8193 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:03.484357  8238 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:03.489174  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:03.490096  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.490711  8806 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:03.494917  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:03.469225 11184 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.500234  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.502082  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.450768 11122 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:04:03.458969 10796 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:04:03.480791 11077 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:03.506592  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.504698  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.508950  8807 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:03.510186  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.500456 11183 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:03.537068  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 254036us
I20260709 13:04:03.481479 11137 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.498613 11115 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:03.536741  8806 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:03.498718 11079 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:03.497793 10963 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:03.485698 11147 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.457535 11174 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.508333 11119 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.534803 10677 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.503235 11141 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:04:03.502291 11024 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:04:03.565653 11043 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.566190 11229 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:03.574517 11229 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.574864 11229 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.574941  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:03.575536  8193 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:03.556306 11227 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:03.541656 11180 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:03.507121 11228 consensus_queue.cc:1243] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:03.541834 11055 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:03.564931 11119 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.580401 11055 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.559846 11131 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:03.544659 11046 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.572947 11176 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:03.573570 11043 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.573727 11077 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.566534 11199 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.558359 11208 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:03.579922  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 229787us
I20260709 13:04:03.556592 11115 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:03.584147  8193 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:03.545317 11121 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.565075 11079 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:03.573464 11174 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.508556 11209 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:03.558874 11144 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:03.702237  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.730671  8197 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:03.632520  8808 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:03.612123  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 190956us
I20260709 13:04:03.759275  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.756325 11138 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.768496  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50538 (request call id 14) took 1556 ms. Trace:
I20260709 13:04:03.768633  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:04.152149  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:04.159391  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.002s	sys 0.019s
I20260709 13:04:03.842715  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1870) took 1440 ms. Trace:
I20260709 13:04:03.769608  8124 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:03.884128  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.768190  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 620) took 1345 ms. Trace:
I20260709 13:04:04.208216  8808 rpcz_store.cc:276] 0709 13:04:02.422995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.423122 (+   127us) service_pool.cc:224] Handling call
0709 13:04:03.632123 (+1209001us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:03.632314 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.767958 (+135644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.768138 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9676032}
I20260709 13:04:03.769164  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:03.840019  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:04.210158  8192 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:04:03.883538  8191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1523) took 2493 ms (client timeout 1986 ms). Trace:
W20260709 13:04:03.839385  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 80177.8us
W20260709 13:04:04.210944  8191 rpcz_store.cc:269] 0709 13:04:01.366014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.425836 (+ 59822us) service_pool.cc:224] Handling call
0709 13:04:03.858759 (+2432923us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001ae0d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:03.858869 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148294016}
I20260709 13:04:04.212265  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:04.213912  8116 rpcz_store.cc:276] 0709 13:04:02.172706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.172827 (+   121us) service_pool.cc:224] Handling call
0709 13:04:03.729312 (+1556485us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540011d5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d22853 00007fbd29cf060a 00007fbd232767d4 00007fbd23276762 00007fbd23276691 00007fbd2327660c 00007fbd232758c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:03.729445 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376332672}
W20260709 13:04:04.205890  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.002s	sys 0.019s
I20260709 13:04:04.209908  8120 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:04:04.225633  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.225966  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:04.226162  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:04.226648  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.227160  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.227974  8124 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:04.204826  8197 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:04.206809  8121 rpcz_store.cc:276] 0709 13:04:02.402215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.402684 (+   469us) service_pool.cc:224] Handling call
0709 13:04:02.402924 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.883605 (+480681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.842519 (+958914us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540011d5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:03.842666 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104403200}
I20260709 13:04:04.205336  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:04.235301  8193 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:04.203269  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.585664 10677 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:03.628995 11224 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:04:03.603984 11176 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:03.631045 11217 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:04:04.260035  8116 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
W20260709 13:04:03.974762 11075 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.003s
I20260709 13:04:04.266261  8116 pending_rounds.cc:85] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 5
I20260709 13:04:03.727695 11187 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:03.661751 11119 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:03.688086 10964 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:04.289178 10964 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.726174  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:03.754227 11115 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.278556  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.671161 11108 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:03.967449 11174 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.005215 11000 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.266842  8121 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:03.666946 11055 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.768252 11065 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:04.244092 10876 consensus_meta.cc:287] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.005s
I20260709 13:04:04.283699  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:03.691319 11107 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:03.841799 11231 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.158615 11237 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.588260 11227 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:03.841490 11242 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.287266 11169 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:03.613281 11233 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:04.266323 11250 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:04:04.121708 11137 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.243909 11252 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:03.655736 11244 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:03.699918 11188 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:04.289989  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.609763 11131 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.324244 11000 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.335769 11065 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.358460  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.359193  8268 raft_consensus.cc:2410] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:04.360033 11000 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.360530 11244 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:04.360913 11065 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.360723  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:03.589819 11180 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.204280 11043 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.367079 11242 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.369789  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 633) took 1673 ms. Trace:
I20260709 13:04:04.290884  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 482) took 1401 ms. Trace:
I20260709 13:04:03.630486 10963 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.291534 11147 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:04.291749 11255 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:04:04.293854 10903 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:03.842195 11136 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.289054  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:04.288335  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.434806  8272 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:04.305459  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:04.435452  8808 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:04.350934 11229 consensus_meta.cc:287] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.776s	user 0.000s	sys 0.010s
I20260709 13:04:04.225677 11238 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.266568  8116 pending_rounds.cc:107] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:04:04.307878  8271 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:04:04.304025  8088 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:04.441138  8116 raft_consensus.cc:2889] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:03.911109 11249 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:04.364416  8802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 617) took 1960 ms (client timeout 2104 ms). Trace:
I20260709 13:04:04.305395 11166 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:04.323225  8089 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.014s	sys 0.031s
W20260709 13:04:04.449420  8089 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.014s	sys 0.031s
W20260709 13:04:04.449712  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 689119us
I20260709 13:04:04.450642  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:03.910602 11246 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.436585 11209 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:03.904659 11079 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.451292  8192 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:04:04.334733  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 51108.1us
I20260709 13:04:04.284654 11075 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.322412 11121 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:04.363950  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:04.356791  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 466) took 1217 ms. Trace:
I20260709 13:04:04.474603  8270 rpcz_store.cc:276] 0709 13:04:03.139790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.144932 (+  5142us) service_pool.cc:224] Handling call
0709 13:04:03.145217 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.197963 (+ 52746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.197989 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.198026 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:03.198052 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.356558 (+1158506us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400211454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.356603 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.356736 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120892672}
I20260709 13:04:04.476055  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.361613 11244 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.366683 11227 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.367305 11120 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.310590 11070 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:04.279728 10677 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.308102 11108 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:04.294302 11176 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.365062 11188 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:04.412671  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 199615us
I20260709 13:04:04.370613  8200 rpcz_store.cc:276] 0709 13:04:02.889376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.894396 (+  5020us) service_pool.cc:224] Handling call
0709 13:04:02.907972 (+ 13576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.914409 (+  6437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.914441 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.914482 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:02.914512 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.290640 (+1376128us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b540021be54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.290682 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.290796 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14384384}
I20260709 13:04:04.312902 11033 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:04:04.322454 11138 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.434760  8274 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:04.490303  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.491369  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.491930  8274 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:04.188362 11199 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.439057  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.369905 11043 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.493011  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:04.425693 11217 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:04:04.336838 10876 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:04.370133  8809 rpcz_store.cc:276] 0709 13:04:02.696671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.697202 (+   531us) service_pool.cc:224] Handling call
0709 13:04:02.719665 (+ 22463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:02.847604 (+127939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.847632 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:02.848159 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.921689 (+ 73530us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:02.921725 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.367991 (+1446266us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b54005b0ed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.368033 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.368076 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:04.368086 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.369732 (+  1646us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44371,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"spinlock_wait_cycles":169297280,"thread_start_us":127226,"threads_started":2,"wal-append.queue_time_us":161766,"wal-append.run_cpu_time_us":1742,"wal-append.run_wall_time_us":1001736}
W20260709 13:04:04.441781  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 137843us
W20260709 13:04:04.294960 11204 consensus_meta.cc:287] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.864s	user 0.006s	sys 0.003s
I20260709 13:04:04.281837 11187 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:04.364243 11233 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:04.369131 11131 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:04.446918  8194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1520) took 3081 ms (client timeout 3272 ms). Trace:
I20260709 13:04:04.353433 11107 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.368126 11237 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.470561  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.451393  8193 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.467080  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:04.323611 11174 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:04.472810  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 118444us
I20260709 13:04:04.470988  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:04.513856  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 48300.7us
I20260709 13:04:04.473698  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:04.515033 11134 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.515147 11262 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.517259 11043 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.478696  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.443720 11065 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.482596  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:04.518488  8268 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:04:04.446563 11147 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.485589  8116 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:04.521272  8116 pending_rounds.cc:85] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 5
I20260709 13:04:04.521575  8116 pending_rounds.cc:107] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:04.521802  8116 raft_consensus.cc:2889] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:04.493659  8272 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:04.521203  8237 leader_election.cc:336] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.516s (SENT)
I20260709 13:04:04.522289  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:04.457319 11166 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.523007  8272 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:04.362519 11169 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:04.523209  8271 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 3.
I20260709 13:04:04.523896 11169 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.442427 11136 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.498747  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:04.501679  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.370651 11252 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:04.504305  8194 rpcz_store.cc:269] 0709 13:04:01.365101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.367155 (+  2054us) service_pool.cc:224] Handling call
0709 13:04:04.446744 (+3079589us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540022cc54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:04.446867 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398655232}
I20260709 13:04:04.443190 11229 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.510617  8192 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:04.447304  8802 rpcz_store.cc:269] 0709 13:04:02.403767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.406568 (+  2801us) service_pool.cc:224] Handling call
0709 13:04:03.726076 (+1319508us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03f8c 00007fbd21c03ef6 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:04.338000 (+611924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12252928}
I20260709 13:04:04.512001  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1516) took 1335 ms. Trace:
I20260709 13:04:04.514456  8089 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:04.438997 10903 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.524490 11166 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.502382  8266 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
W20260709 13:04:04.532079  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.531356  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1514) took 1452 ms. Trace:
I20260709 13:04:04.558035  8267 rpcz_store.cc:276] 0709 13:04:03.079063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.079198 (+   135us) service_pool.cc:224] Handling call
0709 13:04:03.079484 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.096562 (+ 17078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.096592 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:03.097003 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:04:03.207514 (+110511us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:03.272184 (+ 64670us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.272368 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.272433 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.531174 (+1258741us) raft_consensus.cc:1685] finished
0709 13:04:04.531193 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.531302 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8448,"prepare.queue_time_us":65025,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":15165,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6641,"thread_start_us":82552,"threads_started":1,"wal-append.queue_time_us":238507}
I20260709 13:04:04.533742  8268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:04.536100  8272 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:04.559435  8268 raft_consensus.cc:606] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:04.489215 11070 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.537959  8808 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:04.539284  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:04.515755 11247 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:04.553740  8265 rpcz_store.cc:276] 0709 13:04:03.176903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.285251 (+108348us) service_pool.cc:224] Handling call
0709 13:04:03.285516 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.325619 (+ 40103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.511797 (+1186178us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400345dd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.511948 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60601088}
I20260709 13:04:04.566854  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:04.525322 11169 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.520340 11248 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.579442  8193 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:04.540809 11209 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:04.602166  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:04.611415  8193 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:04.500099 11204 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.613766 11204 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.614490 10726 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.526901 11136 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:04.555174 11043 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.537392 11108 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.448652 11249 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.618026  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:04.581081 11119 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.561919 11247 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:04.565975 11049 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:04.541476 10876 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:04.474376 11246 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.623463  8267 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:04.624711 11124 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:04.625715 11242 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.626276  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:04.630072 11265 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:04:04.631534 11043 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.635643  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.635753 11108 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.636035 11245 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 13:04:04.638114  8193 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.599903 11256 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:04.638129  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 114918us
I20260709 13:04:04.638797 11180 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.647193 11247 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.446048 11238 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.611233 11209 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.602289 11233 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.737852 11233 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.649605  8267 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:04.578939 11147 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:04:04.609869 11264 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:04.718602 11070 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:04.718113 11174 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.517446 11188 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.725656  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:04.566295 11187 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.647339 11049 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.728937  8268 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.737102 11209 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.766287  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:04.537968 11065 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.751092  8121 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:04.616147 11248 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.769589  8124 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:04.756407  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.758782 11229 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.764390  8807 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:04.732755 11136 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.717624 11237 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.769495  8121 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:04.716782 11006 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:04.781366 11043 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.781740 11006 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.782428  8267 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:04.766940 11049 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:04.739531 11075 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.651835 11119 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.771567  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:04.780198 11070 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:04.743008 11264 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.780459 11107 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:04.727901 11256 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.791501 11120 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:04.797832  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:04.771929 11174 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:04.794600 11006 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.795047 10677 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.820351 11249 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.802181 11120 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:04.802937  8116 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:04.804589 11119 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.805608 11070 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.805987  8119 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:04.806248  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:04.807986  8195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 478) took 2162 ms (client timeout 1830 ms). Trace:
W20260709 13:04:04.827327  8195 rpcz_store.cc:269] 0709 13:04:02.645574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.669204 (+ 23630us) service_pool.cc:224] Handling call
0709 13:04:04.807795 (+2138591us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54001ed2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:04.807921 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739003264}
I20260709 13:04:04.808586 11000 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:04.811326  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1548) took 1608 ms. Trace:
I20260709 13:04:04.827827  8200 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.796627 11187 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.784461 11188 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.779574 10876 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.782984 11189 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.828117  8199 rpcz_store.cc:276] 0709 13:04:03.203145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.273011 (+ 69866us) service_pool.cc:224] Handling call
0709 13:04:04.809528 (+1536517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.809719 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.809743 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.809788 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:04.809827 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.809878 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.811169 (+  1291us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001ed2d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:04.811267 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533369216}
I20260709 13:04:04.814927 11174 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.829069 11198 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:04.824630 11120 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.863607  8193 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:04.864465  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.890071  8121 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:04.890885  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.891090 11238 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.891425  8121 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:04.865257 11070 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:04.869017  8199 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:04.894258 11248 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.815761  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.784205 11136 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.892838  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:04.865646 11265 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:04:04.904165  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.925112  8269 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:04.925982  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.926518  8269 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:04.927249  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:04.919286  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.929178  8124 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:04.930630  8269 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:04.918152 11192 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:04.918643 10876 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.923730 11065 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.868214 11000 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.931989 11136 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:04.912971 11174 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.866067 11049 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:04.936264  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.912742 11246 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:04.869943  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 427295us
I20260709 13:04:04.901319  8200 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:04.950635  8193 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:04.934383 11192 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:04.911772 11070 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.953887 11120 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.956700  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:04.958232  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 469) took 1817 ms. Trace:
I20260709 13:04:04.958577  8273 rpcz_store.cc:276] 0709 13:04:03.140604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.282371 (+141767us) service_pool.cc:224] Handling call
0709 13:04:03.282606 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.355231 (+ 72625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.355257 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.355299 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:03.355327 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.958036 (+1602709us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b5400189554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.958077 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.958182 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166637312}
I20260709 13:04:04.959761  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:04.960983  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1542) took 1761 ms. Trace:
I20260709 13:04:04.961311  8198 rpcz_store.cc:276] 0709 13:04:03.199759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.199873 (+   114us) service_pool.cc:224] Handling call
0709 13:04:03.259381 (+ 59508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.264920 (+  5539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.264949 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.264988 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:03.265018 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.960793 (+1695775us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b5400366354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.960834 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.960934 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12338048}
I20260709 13:04:04.962473  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:04.962828  8268 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:04.965184  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1885) took 1195 ms. Trace:
I20260709 13:04:04.965574  8119 rpcz_store.cc:276] 0709 13:04:03.769630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.769918 (+   288us) service_pool.cc:224] Handling call
0709 13:04:04.203179 (+433261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.826490 (+623311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.964984 (+138494us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54000affd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:04.965130 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385689856}
I20260709 13:04:04.974611 11256 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:04.962973  8198 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 3.
I20260709 13:04:04.905824 11189 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:04.978704 11115 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.001s
I20260709 13:04:04.979101 11115 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.913712 11198 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:04.984546  8806 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:04.940734 10876 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:05.029971  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.035207  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.023911  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1879) took 2587 ms. Trace:
I20260709 13:04:05.037585  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.037081  8123 rpcz_store.cc:276] 0709 13:04:02.436565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.440026 (+  3461us) service_pool.cc:224] Handling call
0709 13:04:02.440306 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:02.583173 (+142867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.023407 (+2440234us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400307354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:05.023839 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293551488}
I20260709 13:04:05.038574  8193 raft_consensus.cc:2393] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:05.043211 11190 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:05.043632 11190 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:05.043444  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.044157  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:05.044549  8193 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:05.044893  8125 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:05.045406  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1884) took 1276 ms. Trace:
I20260709 13:04:05.045598  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.045696  8125 rpcz_store.cc:276] 0709 13:04:03.769375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.769804 (+   429us) service_pool.cc:224] Handling call
0709 13:04:05.044024 (+1274220us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:05.045304 (+  1280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10309376}
I20260709 13:04:05.046581  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:04.967319 11264 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:05.031299 11280 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:04:05.059825 11033 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:05.067149  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.067798  8269 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:05.023348 11246 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.026495 11065 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.069553  8121 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:05.008287 11119 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:05.046303 11136 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.075582 11136 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.075830 11209 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.077507 11209 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.077698 11136 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:05.079270 11119 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.081270 11119 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.070220  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.053493 11275 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:05.055533 11043 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:05.085834  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:05.060814 11049 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.060201 11166 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:04:05.044456 11190 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.089537 11275 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.085532 11065 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:05.096585 11278 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:05.085510 11246 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.070791 11247 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.119457 11247 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.097924 11126 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:05.098141 11262 consensus_meta.cc:287] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.006s
I20260709 13:04:05.126197 11262 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:05.103864  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.047009 11192 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.114485 11070 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:05.114756 11279 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:04:05.116017 10876 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:05.116458  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.121678  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.130316 11033 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:05.131726  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.161761  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:05.120537 11190 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.124266 11180 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:05.141829 11115 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.215351  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.215516  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1875) took 2796 ms. Trace:
I20260709 13:04:05.216034  8117 rpcz_store.cc:276] 0709 13:04:02.418664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.430153 (+ 11489us) service_pool.cc:224] Handling call
0709 13:04:02.430561 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.563582 (+133021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.215305 (+2651723us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5400299354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:05.215465 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104840448}
I20260709 13:04:05.090893 11043 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:05.120096 11164 consensus_queue.cc:1175] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 8 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:05.268131  8193 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:05.152112 11275 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:05.160418  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.274578  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.209966  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.275482 10876 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.210803  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 50753us
I20260709 13:04:05.123072 11198 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.213624  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.215541 11180 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.215653 11070 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:04:05.215370 11033 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.273211 11043 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.310137  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.723639 11108 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:05.545181  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.725769 11192 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.223078 11262 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.523s
W20260709 13:04:05.642220  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.279815  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.212020 11126 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.591543  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.725217  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.746997  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.726055  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 355463us
I20260709 13:04:05.358601 11275 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.726308  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.306322  8118 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:05.751585  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:05.306137  8802 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:05.788275 10946 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:05.726368 11015 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.795212  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.796445  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:05.754463  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.754940 11262 consensus_queue.cc:1243] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:05.793200 10946 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.798328 11126 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.799065 10946 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.791844 11015 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.800239 11126 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.748504 11108 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.801535 11015 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.802353 11108 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:05.803215  8805 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:05.804934  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:05.805598 11065 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.806033  8193 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.808040 11252 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.790313 11177 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.799619  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:05.809953  8194 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.810335  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:05.810591  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.811277  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.811439  8122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1886) took 1964 ms (client timeout 1912 ms). Trace:
I20260709 13:04:05.811718  8808 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:05.811929  8122 rpcz_store.cc:269] 0709 13:04:03.847486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.847679 (+   193us) service_pool.cc:224] Handling call
0709 13:04:05.810192 (+1962513us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:05.811374 (+  1182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9882880}
I20260709 13:04:05.812093  8807 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
W20260709 13:04:05.817497  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.818269  8091 connection.cc:256] RPC call timeout handler was delayed by -1.6254421569999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:04:05.276001 10876 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.817561 11141 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:05.821987 11141 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:05.825994  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.831296 11164 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:05.831408  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.833765  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1837) took 1033 ms. Trace:
I20260709 13:04:05.834124  8274 rpcz_store.cc:276] 0709 13:04:04.800569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.832695 (+1032126us) service_pool.cc:224] Handling call
0709 13:04:05.832977 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.833149 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:05.833174 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:05.833214 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:05.833243 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.833289 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.833713 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:05.813756 10946 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.833510 11174 consensus_meta.cc:287] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.884s	user 0.016s	sys 0.001s
I20260709 13:04:05.840921  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.841257  8193 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:05.831892 11164 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:05.845773 11164 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.847128  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1911) took 1644 ms. Trace:
I20260709 13:04:05.847481  8197 rpcz_store.cc:276] 0709 13:04:04.202464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.265720 (+ 63256us) service_pool.cc:224] Handling call
0709 13:04:04.266005 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.362719 (+ 96714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.362752 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.362796 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:04.362831 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.846909 (+1484078us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b540014c3d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:05.846954 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.847073 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221388160}
I20260709 13:04:05.848807  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:05.852665  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.853834  8271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1829) took 1625 ms (client timeout 2068 ms). Trace:
W20260709 13:04:05.854192  8271 rpcz_store.cc:269] 0709 13:04:04.228888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.446391 (+217503us) service_pool.cc:224] Handling call
0709 13:04:05.853681 (+1407290us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54002ed1d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:05.853781 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30195456}
I20260709 13:04:05.856285 11192 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.856739 11192 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.845965 10903 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:05.857661  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.857936  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 499) took 2661 ms. Trace:
I20260709 13:04:05.845167 11140 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:05.858439  8274 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:05.859473  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.858273  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.860581  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1550) took 2656 ms. Trace:
I20260709 13:04:05.861049  8271 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:05.860757  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:05.861769  8197 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 5: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:05.854638  8194 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:05.858325  8811 rpcz_store.cc:276] 0709 13:04:03.197039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.197866 (+   827us) service_pool.cc:224] Handling call
0709 13:04:03.260014 (+ 62148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.438552 (+178538us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:03.438685 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:03.451986 (+ 13301us) log.cc:844] Serialized 26 byte log entry
0709 13:04:03.835361 (+383375us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:03.835401 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.857625 (+2022224us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b540061dad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:05.857669 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.857707 (+    38us) raft_consensus.cc:1685] finished
0709 13:04:05.857719 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.857882 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74545,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":118326144,"thread_start_us":499002,"threads_started":2,"wal-append.queue_time_us":786643,"wal-append.run_cpu_time_us":1556,"wal-append.run_wall_time_us":1001569}
I20260709 13:04:05.832521 11065 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.867967  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.868489  8193 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:05.860954  8196 rpcz_store.cc:276] 0709 13:04:03.203920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.303455 (+ 99535us) service_pool.cc:224] Handling call
0709 13:04:03.303704 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.329667 (+ 25963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.860388 (+2530721us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400364554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:05.860531 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31450496}
I20260709 13:04:05.862856  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:05.872428  8237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 3.073s (SENT) [suppressed 17 similar messages]
I20260709 13:04:05.831974 11246 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:05.862900  8274 raft_consensus.cc:2410] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:05.863876  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.818282 11275 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.876613  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.877099  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:05.877687  8199 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:05.874001  8197 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:05.873617  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:05.879055  8811 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:05.881001  8808 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:05.831212 11141 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:05.876323 11032 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.054702  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:06.055434  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 183325us
I20260709 13:04:05.864080  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:06.049386 11193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.419s	user 0.040s	sys 0.091s
I20260709 13:04:06.056782  8199 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:06.062260  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 1922) took 1110 ms. Trace:
I20260709 13:04:06.062615  8199 rpcz_store.cc:276] 0709 13:04:04.951777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.046156 (+1094379us) service_pool.cc:224] Handling call
0709 13:04:06.062206 (+ 16050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.056970  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.057185  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 1924) took 1021 ms. Trace:
I20260709 13:04:06.058005  8805 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:06.058768  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:06.054497 11032 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.051956  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.046021 11216 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.862564 11174 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.046500 11246 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.069433  8194 rpcz_store.cc:276] 0709 13:04:05.035415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.863892 (+828477us) service_pool.cc:224] Handling call
0709 13:04:06.057122 (+193230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:05.878492 10946 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.062019 11193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.448s	user 0.041s	sys 0.091s
I20260709 13:04:06.085220  8194 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:06.086472  8194 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:06.087211  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.089887  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1921) took 1138 ms. Trace:
I20260709 13:04:06.090274  8199 rpcz_store.cc:276] 0709 13:04:04.951553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.081733 (+1130180us) service_pool.cc:224] Handling call
0709 13:04:06.089066 (+  7333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.089250 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.089273 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.089307 (+    34us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.089335 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.089733 (+   398us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.089832 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.082336  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:06.081473  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 160426us
I20260709 13:04:06.081202 11141 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.879897 11065 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.082418 11032 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.093468  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 478) took 1602 ms. Trace:
I20260709 13:04:06.095345  8273 rpcz_store.cc:276] 0709 13:04:04.491036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.725021 (+1233985us) service_pool.cc:224] Handling call
0709 13:04:05.856912 (+131891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.857082 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:05.857106 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:05.857145 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:05.857173 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.857222 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.093285 (+236063us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002ed1d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.093411 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302673152}
I20260709 13:04:06.097069  8273 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:06.098412  8273 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:04:06.098716  8273 pending_rounds.cc:85] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
I20260709 13:04:06.098914  8273 pending_rounds.cc:107] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:04:06.099125  8273 raft_consensus.cc:2889] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:06.092617  8194 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:06.103307  8269 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:06.107996  8266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1520) took 2634 ms (client timeout 2117 ms). Trace:
W20260709 13:04:06.108363  8266 rpcz_store.cc:269] 0709 13:04:03.473727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.474134 (+   407us) service_pool.cc:224] Handling call
0709 13:04:06.107836 (+2633702us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400346f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.107935 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346872576}
I20260709 13:04:06.109454  8272 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:06.081231 11164 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:04:06.207150  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 1906) took 1273 ms. Trace:
I20260709 13:04:06.095211 11180 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.083990 11216 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.202943 11284 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:06.109543  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.088423 11246 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:06.224797  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 115336us
I20260709 13:04:06.330482  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:06.332566  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.334895  8238 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.330504  8195 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:06.336280  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:06.337122  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1564) took 1884 ms. Trace:
I20260709 13:04:06.337919  8238 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.337530  8195 rpcz_store.cc:276] 0709 13:04:04.452467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.863593 (+411126us) service_pool.cc:224] Handling call
0709 13:04:06.329921 (+1466328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.335863 (+  5942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.336861 (+   998us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540021af50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.337027 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3371588864}
I20260709 13:04:06.338857  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.212966  8271 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:06.298538  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 488995us
I20260709 13:04:06.341213  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.343300  8198 raft_consensus.cc:2410] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:04:06.300355  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.344305  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.307035  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1794) took 3555 ms. Trace:
I20260709 13:04:06.309047  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1902) took 1488 ms. Trace:
I20260709 13:04:06.207583  8124 rpcz_store.cc:276] 0709 13:04:04.933858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.934563 (+   705us) service_pool.cc:224] Handling call
0709 13:04:04.934814 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.952730 (+ 17916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.952758 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.952796 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:04.952826 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.206922 (+1254096us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54000dd754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:06.206967 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.207093 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40877824}
I20260709 13:04:06.348023 11156 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:06.349007 11156 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.349709  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 481) took 1590 ms. Trace:
I20260709 13:04:06.350215  8269 rpcz_store.cc:276] 0709 13:04:04.759454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.068387 (+308933us) service_pool.cc:224] Handling call
0709 13:04:06.349128 (+1280741us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400346554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.349387 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312497408}
I20260709 13:04:06.237679 11216 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.354089 11290 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:06.355221  8198 raft_consensus.cc:2410] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:06.355361 11156 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.356258 11156 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.356766  8198 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.357055 11156 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.357789 11291 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:06.358031  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.358593 11291 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.359594  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.360602 11156 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:06.219808  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 107933us
I20260709 13:04:06.361771 11124 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:06.328838  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 490) took 1216 ms. Trace:
W20260709 13:04:06.355281  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.346302  8121 rpcz_store.cc:276] 0709 13:04:04.821013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.892099 (+ 71086us) service_pool.cc:224] Handling call
0709 13:04:06.308714 (+1416615us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000deb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.308883 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355982592}
I20260709 13:04:06.201855  8193 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
W20260709 13:04:06.330101  8200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 1915) took 1879 ms (client timeout 1850 ms). Trace:
W20260709 13:04:06.366237  8200 rpcz_store.cc:269] 0709 13:04:04.450572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.489312 (+ 38740us) service_pool.cc:224] Handling call
0709 13:04:06.329681 (+1840369us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540021af54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.329877 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765185792}
I20260709 13:04:06.329382  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1557) took 2573 ms. Trace:
W20260709 13:04:06.302388  8091 connection.cc:256] RPC call timeout handler was delayed by -1.5606421569999611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 13:04:06.249940  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.369004 11043 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.369602  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 492) took 1256 ms. Trace:
I20260709 13:04:06.369886 11043 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.370350 11225 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.370759  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.221273  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.371150 11225 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.340567  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:06.373018  8091 connection.cc:256] RPC call timeout handler was delayed by -1.3644421569999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 13:04:06.333012  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.253808 10876 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.248982 10946 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.256453 11000 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.240833 11032 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.391800  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.392663  8194 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:06.233119 11033 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:06.393862 11033 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:06.246932 11065 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.394395 11164 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.259994 11120 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.240638 11176 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.246229 11174 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.222357 11190 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:04:06.238731 11189 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.396572  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 504) took 1863 ms. Trace:
I20260709 13:04:06.251544 11192 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.339290  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.372753  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.254240 11244 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.406957  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.254307 11246 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:06.242127 11292 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:04:06.408310  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.104492 11293 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.409906  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.410133 11293 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.261529 11286 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 13:04:06.259230 11258 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.411715 11258 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.413625  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 637) took 1251 ms. Trace:
I20260709 13:04:06.201601 11262 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:06.254354 11275 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.414059  8809 rpcz_store.cc:276] 0709 13:04:05.162382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.162500 (+   118us) service_pool.cc:224] Handling call
0709 13:04:05.267502 (+105002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:05.267870 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:05.267896 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:05.268322 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:04:05.754853 (+486531us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:05.754890 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.754950 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.261074 (+506124us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:06.413027 (+151953us) raft_consensus.cc:1685] finished
0709 13:04:06.413068 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.413436 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":238,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":2496768,"thread_start_us":395545,"threads_started":1,"wal-append.queue_time_us":508872}
W20260709 13:04:06.235317 11282 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.117s	user 0.004s	sys 0.006s
I20260709 13:04:06.416635  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:06.322969  8021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 166) took 14630 ms (client timeout 15000 ms). Trace:
I20260709 13:04:06.393193 11032 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.355470 11290 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.354197 10849 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:06.419798  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1835) took 2176 ms. Trace:
I20260709 13:04:06.410012  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.346104  8196 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.360598  8811 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:06.346196  8118 rpcz_store.cc:276] 0709 13:04:02.751781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.751906 (+   125us) service_pool.cc:224] Handling call
0709 13:04:02.752166 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.813877 (+3061711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.306515 (+492638us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b54000de154. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:06.306846 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5874106240}
I20260709 13:04:06.370214 11291 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.362377 11124 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.354100 11297 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.372731 11043 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:06.385651  8091 connection.cc:256] RPC call timeout handler was delayed by -1.1990113210000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:04:06.394868 11164 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.218748  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.433439 11063 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:06.400563  8200 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:04:06.433866  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 215058us
I20260709 13:04:06.401895 10946 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.424117 11124 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:06.435643 10946 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.436758 11297 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.438299 10946 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.402640 11245 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:06.439121 11245 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:06.440019 11297 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.440296 11245 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.441473  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 201646us
I20260709 13:04:06.442829 11262 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:06.443868  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:06.424885 10726 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:06.445608 10726 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:06.446230 11102 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:06.446982 10726 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.447724 11102 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:06.448897 11102 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:06.394212  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:06.462836  8166 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:06.464090 11075 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:06.465335 11075 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:06.410552  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.466902  8194 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:06.362712  8199 rpcz_store.cc:276] 0709 13:04:05.112633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.091122 (+978489us) service_pool.cc:224] Handling call
0709 13:04:06.106331 (+ 15209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.106650 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.106677 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:06.107070 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:04:06.328102 (+221032us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:06.328187 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.328325 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.328402 (+    77us) raft_consensus.cc:1685] finished
0709 13:04:06.328429 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.328594 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4931,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":21829,"thread_start_us":220468,"threads_started":1,"wal-append.queue_time_us":152290}
I20260709 13:04:06.410725  8198 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:06.368625  8191 rpcz_store.cc:276] 0709 13:04:03.755886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.213225 (+457339us) service_pool.cc:224] Handling call
0709 13:04:04.213532 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.370550 (+157018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.370578 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.424898 (+ 54320us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.561586 (+136688us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:04.561623 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.328727 (+1767104us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540022c754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:06.328787 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.328860 (+    73us) raft_consensus.cc:1685] finished
0709 13:04:06.328874 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.329177 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6785,"raft.queue_time_us":100,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":17205,"spinlock_wait_cycles":360395136,"thread_start_us":112702,"threads_started":1,"wal-append.queue_time_us":209793,"wal-append.run_cpu_time_us":1725,"wal-append.run_wall_time_us":1161074}
I20260709 13:04:06.419401 10849 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.468596  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.397034  8803 rpcz_store.cc:276] 0709 13:04:04.533821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.533975 (+   154us) service_pool.cc:224] Handling call
0709 13:04:04.562506 (+ 28531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.564131 (+  1625us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:04.601258 (+ 37127us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.395363 (+1794105us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18003f1600. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd248d04bc 00007fbd21c1e48b 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c823a
0709 13:04:06.395827 (+   464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.395915 (+    88us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:06.396041 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.396150 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.396363 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37305,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":627,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":224,"spinlock_wait_cycles":29880064,"thread_start_us":45020,"threads_started":1,"wal-append.queue_time_us":171192,"wal-append.run_cpu_time_us":1226,"wal-append.run_wall_time_us":1268343}
I20260709 13:04:06.374004  8193 rpcz_store.cc:276] 0709 13:04:05.113121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.055576 (+942455us) service_pool.cc:224] Handling call
0709 13:04:06.369215 (+313639us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400028d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.369426 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316915456}
I20260709 13:04:06.317414  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:06.295605  8023 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 2 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:06.402397 11281 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.287s	user 0.003s	sys 0.009s
W20260709 13:04:06.470374  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 153415us
I20260709 13:04:06.471957 11297 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:06.472395  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 1917) took 1522 ms. Trace:
I20260709 13:04:06.424502 11225 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.394402 11033 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.424758 11065 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.472784  8192 rpcz_store.cc:276] 0709 13:04:04.950323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.950464 (+   141us) service_pool.cc:224] Handling call
0709 13:04:04.953269 (+  2805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.953605 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.953629 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.954048 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:04:05.073246 (+119198us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:05.073284 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.073370 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.401056 (+1327686us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:06.471940 (+ 70884us) raft_consensus.cc:1685] finished
0709 13:04:06.471961 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.472209 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":946,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":12066176,"thread_start_us":118869,"threads_started":1,"wal-append.queue_time_us":150684}
I20260709 13:04:06.471932  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.469895  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.472707  8023 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:06.478264 11225 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.478684 11225 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:06.479162 11225 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.480538  8198 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:06.478657 11032 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.467769 11075 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.482013 11075 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.482470  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.409096  8807 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
W20260709 13:04:06.430394  8091 connection.cc:256] RPC call timeout handler was delayed by -1.1619421569999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 13:04:06.478379 11210 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:06.483978 11210 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.484956  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:06.485822  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.486310 10726 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.486722  8121 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:06.487923  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.488833  8124 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:06.470459 10849 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.490547 11287 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.491012  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.491449  8124 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:06.491182 11287 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.477301 11192 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:06.492683 11192 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.493291 11192 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.494050  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.481549  8192 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:06.481967 11032 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.495967  8121 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.496727  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.492671  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.497991 10849 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:06.499275 11063 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:06.499663 11063 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:06.486340 11210 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.502687  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:06.417526  8021 rpcz_store.cc:269] 0709 13:03:51.692395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.692572 (+   177us) service_pool.cc:224] Handling call
0709 13:04:06.322697 (+14630125us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:58.878870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:58.879453 (+   583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:58.879504 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:03:58.879525 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:59.201319 (+321794us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:59.201447 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:59.201473 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:03:59.202735 (+  1262us) tablet.cc:701] Row locks acquired
0709 13:03:59.202785 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:03:59.202959 (+   174us) write_op.cc:270] Start()
0709 13:03:59.203108 (+   149us) write_op.cc:276] Timestamp: P: 1783602239202894 usec, L: 0
0709 13:03:59.203131 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:59.203910 (+   779us) log.cc:844] Serialized 5156 byte log entry
0709 13:03:59.788161 (+584251us) op_driver.cc:464] REPLICATION: finished
0709 13:04:00.006052 (+217891us) write_op.cc:301] APPLY: starting
0709 13:04:00.006150 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:00.006456 (+   306us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:00.006571 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:00.043737 (+ 37166us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:00.044012 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:04:00.044060 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:00.044402 (+   342us) log.cc:844] Serialized 95 byte log entry
0709 13:04:00.044578 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:00.044732 (+   154us) write_op.cc:454] Released schema lock
0709 13:04:00.044784 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:00.045187 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:00.045218 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12138,"reported_tablets":28,"spinlock_wait_cycles":8960,"child_traces":[["op",{"apply.queue_time_us":217598,"apply.run_cpu_time_us":6703,"apply.run_wall_time_us":39140,"num_ops":13,"prepare.queue_time_us":37852,"prepare.run_cpu_time_us":12885,"prepare.run_wall_time_us":482672,"raft.queue_time_us":308204,"raft.run_cpu_time_us":11270,"raft.run_wall_time_us":169659,"replication_time_us":584893,"thread_start_us":553102,"threads_started":4,"wal-append.queue_time_us":201776,"wal-append.run_cpu_time_us":24104,"wal-append.run_wall_time_us":1638171}]]}
I20260709 13:04:06.434012 11108 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:06.427376 11164 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.524004 11108 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:06.508975  8023 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 3 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 4 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.525043 11108 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.450685  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 480) took 1723 ms. Trace:
I20260709 13:04:06.450980 11290 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.451457 11140 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:06.454558 11258 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.455534 11293 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:06.451603  8268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 479) took 1834 ms (client timeout 1990 ms). Trace:
I20260709 13:04:06.451638 11070 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:06.403597 11250 raft_consensus.cc:993] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:04:06.459239  8195 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:06.450928 11204 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:06.468166 11216 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:04:06.469189  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.435169  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:06.473647 11065 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.420395  8272 rpcz_store.cc:276] 0709 13:04:04.243050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.559760 (+316710us) service_pool.cc:224] Handling call
0709 13:04:06.109154 (+1549394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.109839 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.419300 (+309461us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400346f50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.419561 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3562985728}
I20260709 13:04:06.504594  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:06.482481 11075 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.427997  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.512456 10946 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:06.519009 11032 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:06.519631  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.520112 11033 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.544377  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46262.1us
I20260709 13:04:06.529378  8124 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:06.534617  8196 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:06.426084  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.529295  8267 rpcz_store.cc:276] 0709 13:04:04.726968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.738807 (+ 11839us) service_pool.cc:224] Handling call
0709 13:04:06.450411 (+1711604us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400211954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.450533 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27360640}
I20260709 13:04:06.479261  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:06.540432  8268 rpcz_store.cc:269] 0709 13:04:04.616820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.626058 (+  9238us) service_pool.cc:224] Handling call
0709 13:04:06.451302 (+1825244us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54001bdad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.451452 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28140800}
I20260709 13:04:06.548627  8121 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:06.546844  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:06.546936  8200 raft_consensus.cc:2376] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9. Re-sending same reply.
I20260709 13:04:06.550237  8197 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:06.539042 11140 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:06.552874 11063 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.558027 11225 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.559057 11065 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.559645  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:06.560500  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 138748us
I20260709 13:04:06.561507 11250 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.561903 11250 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.562300  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.560286 11164 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.540323 11287 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.543458 11204 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:06.568689 11293 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:06.569502  8804 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:06.569123 11140 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.570694 11140 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.571251 11120 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.571682 11120 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.572026 11120 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.573652  8270 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:06.574812  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:06.575443  8124 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:06.575788  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1828) took 2347 ms (client timeout 2142 ms). Trace:
W20260709 13:04:06.576159  8270 rpcz_store.cc:269] 0709 13:04:04.228680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.475832 (+247152us) service_pool.cc:224] Handling call
0709 13:04:06.575517 (+2099685us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54003b88d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.575674 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4799571328}
I20260709 13:04:06.559926 11225 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.543609 11216 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:06.578236  8810 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:06.573781  8806 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:06.578995 11275 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.579587 11275 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.580129  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 630) took 2111 ms. Trace:
I20260709 13:04:06.562352 11250 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.581471  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.583256 11204 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.578637  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 74188.4us
I20260709 13:04:06.580314  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 633) took 1421 ms. Trace:
I20260709 13:04:06.585644  8806 rpcz_store.cc:276] 0709 13:04:05.159177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.159291 (+   114us) service_pool.cc:224] Handling call
0709 13:04:05.750627 (+591336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.579230 (+828603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.580028 (+   798us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54004d7bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:06.580246 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881086336}
I20260709 13:04:06.571280  8122 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 13:04:06.570720  8804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 614) took 5009 ms (client timeout 1952 ms). Trace:
I20260709 13:04:06.580529  8810 rpcz_store.cc:276] 0709 13:04:04.468855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.468956 (+   101us) service_pool.cc:224] Handling call
0709 13:04:06.577743 (+2108787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.578941 (+  1198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.579900 (+   959us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54005b1b50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.580026 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4849381760}
W20260709 13:04:06.588263  8804 rpcz_store.cc:269] 0709 13:04:01.561188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.561634 (+   446us) service_pool.cc:224] Handling call
0709 13:04:06.570489 (+5008855us) spinlock_profiling.cc:243] Waited 4.86 s on lock 0x7b54005b1b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:06.570646 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11168662272}
I20260709 13:04:06.584115 11063 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.565500 10946 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:06.592926 11190 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.594991 11124 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.578569 11216 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.596909 11033 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.597613  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.565981 11245 raft_consensus.cc:1081] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:04:06.599120  8268 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:06.600759 11164 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.601241 11275 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.617641  8270 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:06.602170  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.606585  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:06.609436  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.588852 11065 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:06.607295  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.612402  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:06.623996  8271 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.625958  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.626756  8121 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:06.627070  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:06.627966  8274 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.627807 11246 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.629204 11246 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.628582 11164 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.630625 11164 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.630805  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.631181 11164 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.631990  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:06.632583  8268 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:06.628310 11245 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.613515 11124 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.614305 11216 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:06.637745  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52289.1us
I20260709 13:04:06.578672 10876 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.639741 11258 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.640281 11258 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.639648 10946 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.622866 11204 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.642230 11258 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.647745 11304 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:06.648190 11304 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.648512 11304 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.649475 10876 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.651144  8197 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:06.651697 10876 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.652311  8274 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:06.652849  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.643604 11210 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:04:06.658921  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:06.660212  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:06.660977  8274 raft_consensus.cc:2410] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:06.662582 11033 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.663048 11033 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.663516 11033 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.643052  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:06.635574 11245 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:06.669481  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:06.664921  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 185810us
W20260709 13:04:06.682538 11305 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:04:06.692898  8268 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:06.691726  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:06.684666 11245 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.694334 11297 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:06.696408  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.697746 11291 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:06.706423 11291 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:06.706894 11291 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:06.704322 11297 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:06.709065 11297 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.709851  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.710430  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.699137 11190 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:06.700845  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 88876.5us
I20260709 13:04:06.704366  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.704821  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.710529  8125 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:06.697781 11102 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:06.709765  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.686781 11246 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.723632  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:06.714386  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:06.662550 10964 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:04:06.728741  8124 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:06.732293  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:06.736171  8123 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:06.737622 11291 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.737879 11250 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.738307  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.738894 11291 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.739288  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.733559 11124 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:06.737774  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.740679  8117 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:06.741185  8268 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.741669  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:06.741767  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.742422  8117 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:06.742971  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:06.743595  8802 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:06.739987  8120 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:06.748287  8268 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:06.750623  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.737133  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.751184  8125 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:06.753703  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.758680  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.759204 11173 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:06.765148  8123 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
W20260709 13:04:06.767836  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 53426.5us
I20260709 13:04:06.704403 11077 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:04:06.770162  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 123072us
I20260709 13:04:06.766470 11250 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.768374  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.775508  8271 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
W20260709 13:04:06.770802  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43712.3us
I20260709 13:04:06.754881 11124 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:06.785121  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:06.785645 11308 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:04:06.785821  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.786602  8268 raft_consensus.cc:2410] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:06.759435 11177 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:06.803023  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:06.808554  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.809221  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:06.812472  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 147685us
I20260709 13:04:06.791426 11102 consensus_queue.cc:1243] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:06.801069 11177 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:06.820238  8088 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:06.824463  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 84503.6us
I20260709 13:04:06.831255  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.832018  8117 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
W20260709 13:04:06.841706  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.842924 11142 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:06.843355 11142 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:06.843997 11102 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.844583 11102 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:06.845389  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.846249  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:06.846969 11102 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.847523 11102 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:06.848810 11173 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.849398 11173 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.852262 11173 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:06.806216 11192 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.856735 11192 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:06.830391 11210 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:04:06.846208 11120 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.860275 11120 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.860939 11033 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.860343  8270 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:04:06.861843  8270 pending_rounds.cc:85] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 4
I20260709 13:04:06.862121  8270 pending_rounds.cc:107] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:04:06.862378  8270 raft_consensus.cc:2889] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:06.847541  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:06.863850  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.864516  8192 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:06.865064 11077 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:06.865573 11077 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:06.866437 11077 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.868124  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:06.869611 11139 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:04:06.869906  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:06.870432  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.871598 11108 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.871969 11108 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:06.872304 11108 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:06.875267  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53448.6us
W20260709 13:04:06.844470 11306 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:04:06.877795  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52624.5us
I20260709 13:04:06.823619 11177 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.858572 11210 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:06.880941  8119 raft_consensus.cc:2368] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:06.880704  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:06.882238  8118 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:06.857412 10876 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.896847  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:06.896772  8117 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:04:06.939680  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 59758.8us
I20260709 13:04:06.938467  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.941663  8270 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:04:06.880508 11120 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:04:06.884037 11210 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:06.831218 11250 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:04:06.949214  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.880731 11070 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.951099  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.955442  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:06.953946  8117 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:06.828892 11124 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.946477 10726 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:06.963289  8199 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:06.963451 11070 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:06.977689  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:06.965755  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:06.966049  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 79341.1us
I20260709 13:04:06.970516 11244 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:04:06.972301  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:06.988592  8124 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
W20260709 13:04:06.976294  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.977676  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:06.979212 11304 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.980544  8116 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
W20260709 13:04:06.992403  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 186437us
I20260709 13:04:06.993095 11075 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:06.993988 11070 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:06.994480  8194 raft_consensus.cc:2410] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:06.896788 11000 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:04:06.997942  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.999030  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:06.999904 11314 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:07.000031  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:07.000370  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.004932  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:06.962711 10876 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.005841  8199 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:06.995827  8192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50482
I20260709 13:04:07.007938  8192 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.012413  8192 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:07.006733  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.026923  8199 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.035619  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.036680  8806 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:06.979383 11164 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.046532  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.050678 11258 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.053596  8274 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:07.053882 11142 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:07.055227  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 51551.3us
I20260709 13:04:07.055330 11210 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.059895 10876 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.062337 11304 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.064520  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.065160  8120 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:07.065729  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.065917  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.066462  8120 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:07.066294 11245 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.067307  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.067834  8120 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:07.068295 11293 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.068557  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.069131  8122 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:07.069375 11250 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:07.004266 11156 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:07.066644  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.066318  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:07.083477  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.071218  8198 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:07.072415  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.085122  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.085928  8196 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.085156  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.087786  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:07.088716  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.091511  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.092705 11142 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.094125  8805 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:07.083277 11258 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:07.101122  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.053624  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.101935 10876 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:07.102319 10876 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.102655 10876 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.104571  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.105319  8193 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:07.107110  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:04:07.107245  8774 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.722s (SENT)
I20260709 13:04:07.110064 11075 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.110003 10876 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.112241 10876 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:07.112819  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.117991  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:07.121546  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 49516.7us
I20260709 13:04:07.123086  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.124931 11173 raft_consensus.cc:2764] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:07.125625 11173 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:07.125947 11173 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.070720 11250 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:07.126143  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.126820  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.127537  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.128589  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.129302  8119 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:07.130190  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.131338  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.132371  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:07.132912  8119 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.102492  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.126854  8810 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:07.133880 10876 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:07.134356 10876 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:07.128648  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:07.144146  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 134887us
I20260709 13:04:07.127494  8194 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:07.209008  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.152824  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:07.169833  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.251191  8124 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:07.240351  8238 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:07.154031  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.249899  8125 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:04:07.243341  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.239187  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.241253  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.232985  8805 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:07.268618  8192 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.251739  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:07.176620  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 69578.9us
I20260709 13:04:07.243440  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.271049  8194 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.185839  8196 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:07.241636  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.242688  8274 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:07.274101  8122 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:07.226660  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.275306  8197 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.251489  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:07.246865  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:07.271250  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.273298  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:07.274529  8117 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
W20260709 13:04:07.233083  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50819.1us
I20260709 13:04:07.290120  8804 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.293537  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.294174  8195 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.276016  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.252699  8119 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:07.295465 11297 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.295604  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.296344  8193 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:07.178920 10964 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 13:04:07.297248  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50481.3us
I20260709 13:04:07.127081 11250 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.297632 11189 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.291823 11070 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:07.298213 11070 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.298595 11070 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.301708 10964 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:07.302098 10964 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:07.239163 11033 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:07.295639  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.303952 11177 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.304742 10964 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.305497 11164 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.298218 11189 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.306375  8123 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:07.307758 11189 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.307945  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.308600  8200 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:07.135305 10876 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.311930  8194 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:07.313992  8192 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:07.317724  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.321918  8121 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:07.205425 11293 raft_consensus.cc:2764] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:04:07.315745 10964 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:07.323593  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47652.2us
I20260709 13:04:07.323303  8267 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:04:07.298311 11250 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.321806  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:07.324328  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.324923  8200 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:07.071725 11210 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.328034  8777 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:07.328886  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.258025 11244 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:07.327970  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.329985  8125 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:07.328006  8267 pending_rounds.cc:85] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
I20260709 13:04:07.126255 11173 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:07.333289  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 150710us
I20260709 13:04:07.330623  8119 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:07.331892  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.332697  8267 pending_rounds.cc:107] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:04:07.136118 11156 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:07.334332  8267 raft_consensus.cc:2889] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:07.334326  8123 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:07.335667  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.335899  8124 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:07.333513  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:07.337107  8194 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:04:07.338032  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.337554  8116 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:07.335352  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.340193  8117 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:07.327638 11297 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:07.329414 11189 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:07.329212 11304 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:04:07.353705 11189 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:07.354786 11189 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.331019 11287 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:07.347194  8191 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:07.356985  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.362152  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:07.321293 11140 consensus_queue.cc:1175] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:04:07.363719 11156 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.364836 11063 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.365495 11063 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.365913  8117 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:07.323057 11142 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:04:07.367190 11142 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:07.367514 11063 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:07.349510 11245 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:07.371398 11177 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.371711  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.370112 11304 consensus_queue.cc:1243] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:07.372427  8122 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
W20260709 13:04:07.372849 11108 consensus_meta.cc:287] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.500s	user 0.004s	sys 0.004s
I20260709 13:04:07.373610 11000 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:07.374014 11000 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:07.374660  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.374871 11000 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.376091 11000 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.370110 11297 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:07.378261 11297 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.378863 11287 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:07.381676  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:07.381891  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.382290  8119 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:07.373610  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.373215 11108 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.378907  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:07.391793  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.392176  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.392871  8806 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:07.396703  8195 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:07.401011 11033 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:07.401454 11033 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.403404 11033 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.407665  8191 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:07.388473 11245 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:07.410974 11245 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.411334 11245 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.401012  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.413625  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.414037  8118 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:07.401517  8200 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:07.401330  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.421813  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.423182  8804 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:07.425302  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.367515 11142 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:07.414848  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:07.423026  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 77528.7us
I20260709 13:04:07.432770  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.449074 11190 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:07.449673 11190 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:07.450476 11190 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:07.453238  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.454741  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:07.430011 11290 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:04:07.456475 11290 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:07.456831 11290 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:07.457615 11290 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.457990 11142 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.459535  8267 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:07.459538 11142 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.466028 11108 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:07.410647 11258 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:04:07.390909 11164 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:04:07.469810  8200 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:04:07.472020  8270 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:07.475157 11139 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:07.453948 11077 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:07.477452 11120 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:07.478492 11120 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:07.435516 11297 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:07.490840  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:07.426708 11204 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.498044  8196 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:07.399544 11244 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.458845 11290 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.426873 11173 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.488364 11120 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:07.496277 11297 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.465205 11070 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.520478  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:07.530828  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.535320  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.499752 11033 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.516976 10726 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:04:07.532878 11297 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.532150 11075 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:07.545701  8265 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:07.518185 11293 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:04:07.545707  8196 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:07.540771 10876 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:07.536278 11189 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:07.544780 11164 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.548066 11303 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.554575 11304 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:07.592165  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52578.1us
W20260709 13:04:07.605763  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 103229us
I20260709 13:04:07.561158 11075 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.619650  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:07.592067 11177 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:07.565017 11245 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:07.621275 11337 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:04:07.608454 10876 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:07.559141 11120 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.641922 11120 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:07.594552 11250 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:04:07.593835 11164 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.620060 11075 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:07.622275 11177 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:07.594972 11275 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:04:07.651553 11173 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.651697 11070 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:07.653779 11334 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:04:07.654567 11338 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:07.655028  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.656772  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.713277  8804 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.657158  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.657959  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.614360 11189 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:07.659646  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:07.660399  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.661101  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:07.661902 11340 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:07.661728  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.662135  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.661803  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.665239  8267 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:04:07.710547  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70447.8us
I20260709 13:04:07.716889  8124 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:07.725698  8118 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:07.667137 11346 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:07.731009  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.734678  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.735467  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:07.732049  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.736560  8807 pending_rounds.cc:85] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 5
I20260709 13:04:07.736876  8807 pending_rounds.cc:107] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:04:07.736387  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 109152us
I20260709 13:04:07.739464  8804 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:07.738830  8806 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:07.737114  8807 raft_consensus.cc:2889] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:07.727838 11244 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.735607  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:07.754007  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:07.776926  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.778195  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.778910  8808 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:07.779394  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.780143  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:07.780807  8804 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:07.782042  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:07.754834 11216 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:07.782717  8121 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:07.786902  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51393us
I20260709 13:04:07.800277  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.810235  8116 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
W20260709 13:04:07.810438  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.804131  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.768472 11177 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.806526 11033 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:07.802969  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:07.763623 11063 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:07.818063  8810 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
W20260709 13:04:07.819993  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.737500 10876 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.824694  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:07.751451 11346 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.767892 11108 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:04:07.847164  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:07.848562  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:07.849829  8191 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.854626  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.855198  8118 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
W20260709 13:04:07.865167  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.863088 10964 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.001s
W20260709 13:04:07.849187 11335 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:04:07.870464  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:07.872279 11351 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:04:07.875346  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.841205 11063 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:07.893196  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.897847  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:07.898465  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 95647.3us
I20260709 13:04:07.864152 11177 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.849767 11000 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.907014 11347 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:04:07.915395  8123 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:07.930763  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:07.935703  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:07.938278  8123 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:07.941401 11347 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.941882 11347 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:07.945554 11063 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:07.947659  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.970566  8125 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:04:07.984266  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.988387  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:08.099586 11360 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:04:07.980808 11366 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:08.148022 11366 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:08.149398 11366 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.166146  8117 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:08.173811  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.174577  8116 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:08.176167  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.177012  8121 raft_consensus.cc:2410] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:04:08.177670  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:08.178977  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:08.184494  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.188004  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.189284  8121 raft_consensus.cc:2410] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:08.190192  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:08.190665  8121 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.192468  8191 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:04:08.194393 11357 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:04:08.198318  8123 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:08.199908  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:08.111366 11297 consensus_meta.cc:287] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.000s
I20260709 13:04:08.187970  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.205256  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:08.206188  8123 raft_consensus.cc:2410] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:08.217746  8192 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:08.218112  8121 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
W20260709 13:04:08.219002  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 283472us
I20260709 13:04:08.220611  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.220870  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.162595 11346 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.227372  8270 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:08.234254  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:08.238302  8121 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:08.240260  8116 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:08.240191  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:08.243592  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.250839  8117 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:08.251802  8270 raft_consensus.cc:2368] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
W20260709 13:04:08.255820  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.261663  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:08.264596  8121 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:08.268740  8123 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:08.271229  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.275480  8123 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:08.287609  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.227841 11297 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.290262  8270 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:08.290297  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.297618  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.300149  8122 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:08.308269  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.312060  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:08.306084 11290 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:04:08.319613  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.324179 11063 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.324720 11063 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:08.326396  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.326795 11063 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:08.328300  8270 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:08.320159 11297 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:08.349164  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.350065  8270 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:08.354200  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:08.354997  8192 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.360834  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.363158  8270 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:08.366078  8267 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:08.360411 11367 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:08.368119 11367 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:08.369009 11367 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:08.371134  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.331617 11258 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:08.381434  8192 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:08.383586  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 75754.2us
I20260709 13:04:08.383679  8267 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:08.399003  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.380105 11347 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.395010 11142 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.404595 11142 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.413437  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.418823  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:08.421161 11142 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.426903 11210 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:08.427245 11366 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.427904 11366 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.430094 11366 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.430598 11366 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:08.431173  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:08.432440  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.432934 11293 raft_consensus.cc:2764] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:04:08.433060  8195 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:08.434262  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.435421 11366 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:08.436448 11366 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.438686  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.439306  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.439865  8269 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:08.439870  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.440784  8274 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:08.441761  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.442209  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.442510  8274 raft_consensus.cc:2410] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:08.438230  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.443508  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:08.444085  8810 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:08.444810 10876 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.445295 10876 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:08.446468  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.447224 11189 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:08.448246 11164 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.447302 10876 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.437580 11366 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.443835  8267 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:08.463475  8198 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:08.467098  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.427320 11210 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:08.470137 11210 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:08.472332  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.472594 11366 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.474108  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.493319  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.493577  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.494020  8270 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:08.494589  8198 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:08.478500 11210 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:08.507198  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:08.508345  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.479534 11347 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:08.510270  8265 raft_consensus.cc:2393] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 4: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:08.512338  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:08.514253  8265 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:08.515939 11290 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:08.515849 11102 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:08.516350 11290 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:08.516758 11290 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.518067  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.518762  8270 raft_consensus.cc:2368] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:08.519654  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.479375 11246 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:04:08.523118 11347 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.523523 11347 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.528726  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.529657  8272 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:08.548509  8810 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:08.549606  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.550096  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:08.557193  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44949.2us
I20260709 13:04:08.559090  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.565742  8272 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:08.580476 11290 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.583482 11366 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.613133  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.614486  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:08.615903  8163 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.507s (SENT)
W20260709 13:04:08.652457  8163 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.539s (SENT)
I20260709 13:04:08.620309  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.620859 11367 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.621246  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.621904  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.622653  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.623672  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:08.655802  8191 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.626449  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.627552  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.620949 11000 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:08.632133 11245 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:08.660966  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.640033 11210 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:08.644462  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.666460  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.620963  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.667059  8199 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:04:08.667212  8265 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:08.650828  8272 raft_consensus.cc:2376] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6. Re-sending same reply.
I20260709 13:04:08.661458  8267 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
W20260709 13:04:08.668316  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.625s (SENT)
I20260709 13:04:08.640503 10876 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:04:08.672458  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:08.675104  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:08.671172  8163 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.545s (SENT)
I20260709 13:04:08.675678  8267 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:08.682535 11077 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:08.682256  8163 leader_election.cc:336] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.547s (SENT)
I20260709 13:04:08.685236  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.678776 11075 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:04:08.693554  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.694260  8125 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:08.702186  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:08.702813  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50678.7us
I20260709 13:04:08.704267  8091 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:08.705065 11156 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:08.667281 11367 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.706009 11156 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:08.706212 11381 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:08.673183 11210 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.709517 11381 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:08.710342 11381 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.711206 11210 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.711584 11381 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.712183  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.712762  8274 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:08.670364 11000 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.714068  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:08.714811 11210 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:08.714879 11000 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:08.716012 11210 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.716984 11210 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.720963  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.730134  8194 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:08.723845  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.733582  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.733662  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.734501 11245 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:08.734622  8199 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:08.715947  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.734916 11245 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.737264 11245 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:08.739105  8125 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:08.741641 11367 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.715987 11290 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.708842 11347 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.747367 11347 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:08.753655  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 85378.9us
I20260709 13:04:08.754492 11102 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:08.754866 11102 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.755193 11102 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.760174  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:08.741081  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:08.724669 11210 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:08.728048  8166 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.655s (SENT)
W20260709 13:04:08.775995  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48335us
I20260709 13:04:08.732409  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:08.766759  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 61455.6us
I20260709 13:04:08.760777  8802 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.781467  8270 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
W20260709 13:04:08.781778  8163 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.655s (SENT)
I20260709 13:04:08.780138  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.784857  8191 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:08.790150 11245 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.792388 11245 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.793403  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:08.793952  8192 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:08.794420 11210 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.798199  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:08.798794  8270 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.801779  8119 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:08.801816  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:08.802940  8124 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.804527  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.782678  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:08.806506  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:08.812958  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:08.813581  8120 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:08.813856  8116 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:08.832770  8192 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:08.833917  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.841497  8270 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:08.843308  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.842592  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:08.846422  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 64761.8us
I20260709 13:04:08.852851  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:08.845542 11164 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:08.834893 11379 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:08.856182  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49770us
I20260709 13:04:08.850683 11075 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.850724 11347 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:08.852213 11210 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:08.882234  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.885124  8195 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:08.885556  8195 pending_rounds.cc:85] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:04:08.885773  8195 pending_rounds.cc:107] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:04:08.885977  8195 raft_consensus.cc:2889] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:08.891532  8124 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:08.873454 11077 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.896894  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:08.879073 11379 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:08.910032  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 73673.3us
I20260709 13:04:08.894495 11210 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:08.904604 11063 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:08.911770  8020 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 5, term changed from 4 to 6, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:08.886981 11374 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:04:08.920302  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:08.909538 11120 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:08.924834  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 164103us
I20260709 13:04:08.901151 11077 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.925597 11216 raft_consensus.cc:2764] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:08.931550  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:08.925752  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 83233.1us
I20260709 13:04:08.912024 11386 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:04:08.937979 11386 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:08.938321 11386 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:08.939096 11386 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.940148 11386 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.936734 11210 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.926210 11120 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.943229  8270 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:08.944017 11120 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.944298 11379 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:08.949079  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:08.949874 11156 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:08.950513 11102 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.952719 11102 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.953715  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:08.954001 11075 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:08.954470  8192 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.955577  8197 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.956964 11142 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:08.957473 11142 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:08.959667 11142 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:08.950440  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:08.960871  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:08.961079  8192 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:08.961663  8805 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.962232  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:08.963132 11142 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:08.966481 11142 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:08.967252 11142 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:08.971282  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51058.3us
I20260709 13:04:08.971997  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:08.978133 11102 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:08.981604  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:08.982298  8266 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:08.983115 11077 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:08.983492 11304 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:08.984650  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:08.987463  8198 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:04:08.987818  8198 pending_rounds.cc:85] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 2
I20260709 13:04:08.988037  8198 pending_rounds.cc:107] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:04:08.988235  8198 raft_consensus.cc:2889] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:08.989164 11245 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:08.989591 11245 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.989928 11245 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:08.992537  8023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 245) took 29964 ms (client timeout 15000 ms). Trace:
I20260709 13:04:08.994247  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:08.996062  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:08.997110  8805 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:08.997792  8802 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:09.010391  8197 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:09.013628  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:09.043860  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:09.045559  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 80461.2us
I20260709 13:04:09.045830  8020 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 9, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:09.059254  8020 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.026726  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:09.063071  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 112728us
I20260709 13:04:09.064116  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:09.064450  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.065907  8020 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 6, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:09.067580  8020 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 7 to 8, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 8 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.069175  8020 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 5 to 6, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 6 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:09.070997  8020 catalog_manager.cc:5697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:09.073576  8163 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.751s (SENT)
I20260709 13:04:09.073576  8192 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:09.075091  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.076566  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.076637  8020 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 2 to 8, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 8 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.079276  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:09.078900  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 136670us
I20260709 13:04:09.081516  8020 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 1 to 5, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:09.057705 11077 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.083508  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.073889 11386 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:09.058498 11063 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.058816 11396 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.083204  8020 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 6, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 6 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:08.993120  8023 rpcz_store.cc:269] 0709 13:03:39.030794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.031038 (+   244us) service_pool.cc:224] Handling call
0709 13:04:08.992438 (+29961400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:06.687331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:06.765659 (+ 78328us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:06.765705 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:04:06.765722 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:06.766365 (+   643us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.766455 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.766479 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:06.839838 (+ 73359us) tablet.cc:701] Row locks acquired
0709 13:04:06.839888 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:04:06.840064 (+   176us) write_op.cc:270] Start()
0709 13:04:06.840214 (+   150us) write_op.cc:276] Timestamp: P: 1783602246840003 usec, L: 0
0709 13:04:06.840237 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.840916 (+   679us) log.cc:844] Serialized 1360 byte log entry
0709 13:04:07.241740 (+400824us) op_driver.cc:464] REPLICATION: finished
0709 13:04:07.532884 (+291144us) write_op.cc:301] APPLY: starting
0709 13:04:07.539828 (+  6944us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:07.557375 (+ 17547us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:07.593447 (+ 36072us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:07.651979 (+ 58532us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:07.652213 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:04:07.652268 (+    55us) write_op.cc:312] APPLY: finished
0709 13:04:07.652557 (+   289us) log.cc:844] Serialized 35 byte log entry
0709 13:04:07.652721 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.652803 (+    82us) write_op.cc:454] Released schema lock
0709 13:04:07.652856 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:07.653232 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.653262 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4927917,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":239853,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":142405,"num_ops":3,"prepare.queue_time_us":109495,"prepare.run_cpu_time_us":24989,"prepare.run_wall_time_us":303477,"raft.queue_time_us":265507,"raft.run_cpu_time_us":14407,"raft.run_wall_time_us":180241,"replication_time_us":401355,"spinlock_wait_cycles":4736,"thread_start_us":414283,"threads_started":4,"wal-append.queue_time_us":128128,"wal-append.run_cpu_time_us":16608,"wal-append.run_wall_time_us":1692446}]]}
I20260709 13:04:09.072242 11177 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:04:09.092128  8020 catalog_manager.cc:5697] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:09.094540  8020 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 7, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:09.057876 11304 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:04:09.097119  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 125216us
I20260709 13:04:09.076917 11164 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:09.098515  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.086210 11139 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:09.096906 11374 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.097059 11386 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:09.086419 11077 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:09.106073  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.103262  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 7 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:09.090874 11297 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:09.107033 11297 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:09.104015 11139 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.107975 11139 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.109615 11381 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.107993 11297 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.110102 11381 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.112051 11381 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:09.114365  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.115612  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.116349  8802 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:09.117208  8020 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 7, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 7 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.127507  8020 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:09.129513  8020 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 3 to 4, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 4 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:09.135393 11386 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.137573  8020 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 4 to 7, term changed from 6 to 8, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to <none>, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:09.140745  8166 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.142681  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:09.143937  8802 raft_consensus.cc:2410] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:09.146996  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.147619  8810 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:09.147974  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:09.149008  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.149755  8804 raft_consensus.cc:2410] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:09.150682  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:09.151351  8808 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:09.115274 11077 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.154915  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:09.158607  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 75710.5us
I20260709 13:04:09.163786  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:09.120904 11075 raft_consensus.cc:2764] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:09.168789  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.169339  8809 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.139196  8020 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 2 to 5, term changed from 5 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to <none>, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:09.173406  8020 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 6 to 7, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:09.175796  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 85681.5us
I20260709 13:04:09.176182 11258 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:09.176568 11258 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:09.177759 11258 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.179080 11258 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.180060 11177 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:09.176524  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.096603 11396 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.185976  8196 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:09.189074  8802 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:09.186319  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.192955  8192 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:09.166014 11374 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:09.198392  8163 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.792s (SENT)
W20260709 13:04:09.198885  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58868.5us
I20260709 13:04:09.202401  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.175071  8020 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 5 to 8, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 8 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.210985  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.212316  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:09.214663  8198 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:09.215866  8088 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.218756  8088 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.224821  8805 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:04:09.225538  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:09.226933  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 54960.3us
I20260709 13:04:09.227649  8166 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.228552  8166 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.198160 10876 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:09.230581  8774 leader_election.cc:336] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.646s (SENT)
I20260709 13:04:09.240017  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:09.251019  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 48721.4us
I20260709 13:04:09.251724  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.220307 11156 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:09.256551  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.221427 11063 raft_consensus.cc:2764] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:09.154323 11139 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.230168 11297 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:09.265075  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:09.267437  8195 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:09.268482 11396 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:09.272260  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.273041  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.240247 11347 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.245255 11216 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.278601  8809 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:09.281646  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.294885  8270 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:04:09.218756 11402 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:04:09.254051 11367 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.305161  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:09.306435  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 81771.4us
W20260709 13:04:09.308552  8774 leader_election.cc:336] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.828s (SENT)
I20260709 13:04:09.308954  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.314945  8803 raft_consensus.cc:2410] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:09.247575 11398 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:04:09.292438 11102 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.222369 11164 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.316391 11210 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:09.280332 11297 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:09.281080 11399 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.313741 10964 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:09.348335  8163 leader_election.cc:336] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.932s (SENT)
I20260709 13:04:09.301934 11177 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:09.301844 11397 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.348788  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:09.352631  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 118542us
W20260709 13:04:09.352962  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 44436.4us
W20260709 13:04:09.353585  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.830s (SENT)
W20260709 13:04:09.356580  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 126376us
I20260709 13:04:09.344820 11210 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.364339  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.353667 11177 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.371711 11258 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.379300 11216 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.387624  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.388317  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.388962  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.355461 11402 consensus_queue.cc:1243] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:09.389639  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.394726  8266 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:09.389760  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.367954 11210 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.390386  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.389288  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.390225  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.397958  8265 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
W20260709 13:04:09.395560  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 47272.3us
W20260709 13:04:09.366876  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 115232us
I20260709 13:04:09.405390  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.406678  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.407326  8266 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.393040 11177 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.407915  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.417023  8274 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.425307 11077 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.427546 11077 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:09.429574 11412 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:09.431069 11412 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:09.432248 11412 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:09.429524 11216 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:09.438197 11297 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.444010  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.444893 11402 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:09.445267 11402 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:09.445670 11402 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.448581 11374 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:09.449630 11418 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.450187 11418 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.450538 11418 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.453827  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:09.455832  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.457178  8274 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:09.466601  8267 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:04:09.468113  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.469586  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.470192  8272 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:09.466943  8267 pending_rounds.cc:85] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 4
I20260709 13:04:09.471323  8267 pending_rounds.cc:107] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:04:09.471562  8267 raft_consensus.cc:2889] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:09.472846  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 115270us
I20260709 13:04:09.473801  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.475140  8274 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:04:09.482512  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.483363  8267 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.486912  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.487190  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.487519  8124 raft_consensus.cc:2376] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6. Re-sending same reply.
I20260709 13:04:09.488091  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.489212  8125 raft_consensus.cc:2368] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:09.489033  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.489090  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.491406  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.491703  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.492339  8121 raft_consensus.cc:2376] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5. Re-sending same reply.
W20260709 13:04:09.492414  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:09.495617  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 51686us
I20260709 13:04:09.495729  8200 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:09.496531  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.393759 11245 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.500892  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.501410  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.502146  8124 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:09.502929  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.503473  8122 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:09.505511 11189 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:09.505867  8268 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:09.506153  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.506800  8120 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:09.507848  8268 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:09.509040 11386 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:09.509733 11379 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:09.510547  8163 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.997s (SENT)
W20260709 13:04:09.511116  8163 leader_election.cc:336] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.003s (SENT)
I20260709 13:04:09.511435  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.512604  8269 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:09.512825  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.507843  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:09.513480  8118 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:09.474910 11374 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.514145  8194 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 4.
I20260709 13:04:09.527753  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.528350  8121 raft_consensus.cc:2376] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7. Re-sending same reply.
I20260709 13:04:09.516849 11367 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:09.519500  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45783.5us
I20260709 13:04:09.520287 11402 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.523705 11177 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:09.524230 11407 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.169s	user 0.000s	sys 0.004s
I20260709 13:04:09.523689  8267 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:09.525465  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.526268 11347 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:09.527077  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.541213  8116 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:09.532075  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.536037  8273 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:09.548040  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 194476us
W20260709 13:04:09.548720  8774 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.043s (SENT)
I20260709 13:04:09.549090  8774 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.551606  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:09.551512  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55259.9us
I20260709 13:04:09.552294  8121 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:09.554404  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.554508  8119 raft_consensus.cc:2368] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:09.555059  8121 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:09.533430 11063 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:09.565871  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.563345  8166 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.563195  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.542197 11413 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.563273  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:09.531361 11077 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:04:09.541431 11139 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:09.520306 11210 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.536285 11367 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.584990  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.586877  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.587337 11063 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:09.587733 11063 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:09.588631 11063 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.589829 11063 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.594439  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.595016  8118 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:09.593052 11139 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.603084 11245 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:09.604734  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.607218 11397 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:09.607717 11398 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.608098 11398 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.608594  8266 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:09.609124  8122 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:09.607471  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.615080  8265 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:09.619681  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:09.584546 11400 raft_consensus.cc:2764] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:04:09.621035  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.618980  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.621333  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:09.621556  8163 leader_election.cc:336] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.119s (SENT)
I20260709 13:04:09.631698  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:09.621838  8191 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:09.623886  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.624859  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.625281  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.632007  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.633821  8123 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:09.634140  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.634603  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.635614  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.634721 11164 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:09.637169 11164 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:09.633224  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.636127  8123 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:09.637677  8266 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:09.616990 10876 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:09.617117 11418 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.640331 11419 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:09.654930 11419 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:09.640391  8121 raft_consensus.cc:2368] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
I20260709 13:04:09.655426 11419 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:09.640483 11413 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.643882  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.657248  8116 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:09.644307 11430 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:09.658187 11402 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:09.658581 11430 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:09.648502  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:09.644487  8163 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.145s (SENT)
I20260709 13:04:09.645668  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:09.649081  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.659605 11430 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.644099  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.660210  8195 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.645367 10876 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:09.662109 10876 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.663285 10876 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.644997  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.665064  8118 raft_consensus.cc:2410] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:09.648669  8269 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:09.665763  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.647403 11418 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:09.650357 11422 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.667800  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:09.618055 11406 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:04:09.670006 11077 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.629652 11120 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.618636 11398 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.670523 11077 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.672466  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.672991  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.673539  8116 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.676599 11120 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:09.677009 11120 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:09.678026  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.678412  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.678959  8120 raft_consensus.cc:2376] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12. Re-sending same reply.
I20260709 13:04:09.679347  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.680217  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.682569  8120 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:09.673486  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.688124  8119 raft_consensus.cc:2368] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:09.688891 11177 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:09.650321  8125 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
W20260709 13:04:09.641490  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 108463us
I20260709 13:04:09.699182  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:09.700217  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55764.9us
I20260709 13:04:09.636178  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:09.706688  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 70575us
I20260709 13:04:09.707402  8808 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:09.709111  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:09.709687  8191 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.711005  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.714638  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:09.716419 11075 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:09.716840 11075 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:09.717195 11075 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:09.719316  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.723867 11290 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:09.725416  8091 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.730931 11290 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:09.731825  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.732317  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.736989 11075 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:09.761394  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.765748 11075 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:09.766811  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 203398us
I20260709 13:04:09.751573  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.738971  8198 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:09.745186  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.738252 11290 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:09.765988  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 217194us
W20260709 13:04:09.745465  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.769104  8120 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:09.770079 11297 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:09.770251  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.052s (SENT)
I20260709 13:04:09.773618  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.775671  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.759796  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:09.755848  8191 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:09.778119  8237 leader_election.cc:400] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:09.778450  8237 leader_election.cc:403] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:04:09.778831  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 71040.7us
I20260709 13:04:09.780040  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.783509  8119 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:09.784199  8195 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:09.786998  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.817924  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:09.818107  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 66621.4us
I20260709 13:04:09.818591  8125 raft_consensus.cc:2376] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9. Re-sending same reply.
I20260709 13:04:09.818930  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:09.780607  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.772580 11406 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:09.826726  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:09.827945  8117 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:09.828778  8198 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:09.831317  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 86213.6us
I20260709 13:04:09.832120  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:09.837667  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69171.6us
I20260709 13:04:09.842355  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:09.843119  8118 raft_consensus.cc:2376] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9. Re-sending same reply.
I20260709 13:04:09.849612  8091 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.822433 11402 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:09.853628  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:09.854357  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 69358.7us
I20260709 13:04:09.855247  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.863940  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:09.855906  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 85894.6us
W20260709 13:04:09.865135  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.866235  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:09.867955  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.821687 11258 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:09.866787  8808 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:09.817377 11400 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:09.869524  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.836561 11406 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.822757 11433 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.833300 11396 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:09.850373 11412 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.858390 11156 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:09.902981  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:09.903609  8811 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:09.913862  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60313.9us
I20260709 13:04:09.917917  8163 leader_election.cc:400] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:09.859911 11429 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.784756 11120 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:09.928658  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:09.924479  8163 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.827s (SENT)
I20260709 13:04:09.877295 11245 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.921974  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:09.890615 11406 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:09.900261 11290 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.949859  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:09.923482 11396 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:09.926628 11210 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:09.945102 11077 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:09.945644 11367 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:09.946162  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:09.956542  8271 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.900527 11434 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:09.923745 11429 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:09.952647  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:09.850920 11431 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:04:09.913623 11164 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:09.949039 11156 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:09.938194 11445 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:09.971360 11441 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:04:09.975260  8116 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:09.947048 11433 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:04:09.960814 11429 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.996028  8271 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:04:09.964016  8198 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:04:09.962586 11077 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:10.002064  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:09.991317 11304 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:10.008350  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 138919us
I20260709 13:04:10.009621  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:09.962601  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 84162.6us
I20260709 13:04:09.991699 11445 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:10.020370  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 156315us
I20260709 13:04:10.021118  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:10.013844  8774 leader_election.cc:336] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.755s (SENT)
I20260709 13:04:10.026443  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:10.026649  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.027330  8198 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:10.011139 11077 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:10.008867 11402 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:10.028738 11452 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.058990 11077 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:10.067515 11077 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.070848 11290 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:10.071341 11290 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.073207 11381 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:10.074560 11381 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:10.073184 11419 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.076385 11156 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:10.081661 11427 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:04:10.082051  8200 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:10.083513 11419 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.084661 11120 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:10.038316 11258 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:04:10.085999 11258 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:10.086356 11258 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:10.087129 11258 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.088182 11258 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:10.005959 11396 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.015019 11304 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.085536 11445 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.075448 11381 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.060679 11142 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.096266 11406 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.097640 11402 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:10.100066 11442 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:04:10.101886 11304 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:10.113101  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54532.7us
W20260709 13:04:10.118631  8163 leader_election.cc:336] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.984s (SENT)
I20260709 13:04:10.125779  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:10.119964  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58660.3us
W20260709 13:04:10.135083  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 105987us
I20260709 13:04:10.136510  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:10.137974  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.140908  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.048496 11449 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:04:10.145684  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:10.146255  8124 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.147985  8200 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:10.149137  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:10.150518  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0424307769999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:04:10.105141 11399 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:04:10.162047  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.168399  8269 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:10.163767  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.168771  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:10.169456  8267 raft_consensus.cc:2368] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:10.167846  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:10.169746  8274 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:10.170099  8274 pending_rounds.cc:85] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 8
I20260709 13:04:10.170290  8274 pending_rounds.cc:107] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:10.170512  8274 raft_consensus.cc:2889] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:10.164541  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:10.167256  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.166734  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.171737  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.172098  8272 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:10.172726  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:10.173149  8272 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:10.174438  8124 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:10.175246  8120 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:10.175989  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:10.176229  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:10.178359  8237 leader_election.cc:400] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:10.178675  8269 raft_consensus.cc:2376] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12. Re-sending same reply.
I20260709 13:04:10.179243  8265 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:10.179942  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.181813  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.182175  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.182900  8267 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:10.144042 10876 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:10.184228  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.186347  8266 raft_consensus.cc:2368] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:10.186702  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.190331  8271 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:10.163362 11210 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.160095 11418 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:10.190794  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.148792 11465 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:10.197599  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52539.4us
I20260709 13:04:10.148594 11379 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:04:10.183936 11245 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:10.185998 11467 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:10.175520 11189 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:04:10.221868 11458 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:10.204844 11164 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:10.254123  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.270092  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.309713  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 124265us
W20260709 13:04:10.315490 11462 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.179s	user 0.000s	sys 0.002s
I20260709 13:04:10.318568  8272 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
W20260709 13:04:10.341528  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 132963us
I20260709 13:04:10.344988  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:10.205070 11418 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.202396 11210 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.330994 11467 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:04:10.368009  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 168779us
I20260709 13:04:10.361766 11450 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.362353 11367 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:10.213672 11463 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:04:10.383471  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:10.386273  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:10.366830 11398 consensus_meta.cc:287] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.007s
I20260709 13:04:10.369490 11102 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.388329  8163 leader_election.cc:400] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:10.407473  8163 leader_election.cc:403] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:10.408322  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.329118 11464 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 13:04:10.413446  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.384374 11419 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:10.390409 11434 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:10.385520 10876 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:10.387624 11406 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:10.427361  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.428120  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.434022  8267 raft_consensus.cc:2410] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:10.437727  8266 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:04:10.438109  8266 pending_rounds.cc:85] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:04:10.438328  8266 pending_rounds.cc:107] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:04:10.438545  8266 raft_consensus.cc:2889] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:10.431291  8166 leader_election.cc:336] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.665s (SENT)
I20260709 13:04:10.440653  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.379209 11177 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:10.446135  8271 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:10.382419 11450 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.419036 11075 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:10.421799 11216 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8.
I20260709 13:04:10.423695 11419 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:10.381662 11465 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:04:10.406060 11398 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.474655 11445 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:10.474959 11075 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:10.499294  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:10.481408 11468 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:04:10.481596 11216 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.482187 11210 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.485564 11412 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:10.486255 11469 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:04:10.415835 11102 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.499929  8271 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:10.488029 11419 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:10.533592  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.541193  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:10.554556  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 59254.5us
I20260709 13:04:10.498273 11436 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.555292  8197 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:10.540438  8274 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:04:10.496500 11464 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.453712 11429 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:10.564579  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 384697us
I20260709 13:04:10.579118  8200 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:10.494735 11445 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:10.580120  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:10.501642 11075 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:10.564350  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.615877  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 171716us
I20260709 13:04:10.626957  8198 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:10.584013 11463 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.620247  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:10.630776  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:10.628925  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 197675us
I20260709 13:04:10.539812 11216 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.633553  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:10.635447  8166 leader_election.cc:336] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.803s (SENT)
I20260709 13:04:10.609328 11434 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:10.635999  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.627815 11142 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:10.713814  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78392.3us
W20260709 13:04:10.714488  8166 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.827s (SENT)
I20260709 13:04:10.638882  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.629001 11077 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:10.633530 11418 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:10.695093 11471 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:04:10.695916 11486 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:04:10.696846 11487 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:04:10.697674 11480 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:04:10.611284 11464 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:10.700278 11290 consensus_meta.cc:287] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.001s
I20260709 13:04:10.637622 11399 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.638794 11452 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:10.640616 11189 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:04:10.621966 10876 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.703315 11398 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:10.665728 11479 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:04:10.705838  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:10.717375  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:10.768093  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 75418.9us
I20260709 13:04:10.635226 11463 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.702411 11102 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:10.770109  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 131295us
I20260709 13:04:10.753924 11434 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.795830  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:10.777544 11430 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:10.842312  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.769742 11077 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.762408 11419 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.797073 11450 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:10.832468  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 202649us
I20260709 13:04:10.796772 11471 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:10.831671 11452 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:10.847066  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 132618us
I20260709 13:04:10.850070 11476 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.852015 11216 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.778394 11445 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:10.853458  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.855997  8166 leader_election.cc:336] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.858s (SENT)
I20260709 13:04:10.847036 11399 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.832278 11290 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.832877 11075 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.872655  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.873637  8197 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:10.852792 11374 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:10.848346 11077 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:10.876694  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:10.876878 11492 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:04:10.882231 11464 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:10.884248 11290 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.871912 11423 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.885855 11075 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.886332  8194 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:10.871178 11452 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.889072  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:10.898267  8197 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:10.889955  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:10.899019  8200 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:10.889277  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:10.872490  8166 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.895s (SENT)
I20260709 13:04:10.892596  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:10.887385  8774 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.869761 11474 raft_consensus.cc:2764] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:04:10.894455 11423 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:10.899739  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:10.900218  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.893618 11399 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:10.902079 11419 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:10.903218 11189 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.903744  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.889532 11471 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.899962  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:10.890121 11450 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.853979 11102 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:04:10.907828  8166 leader_election.cc:336] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.984s (SENT)
I20260709 13:04:10.914608 11402 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.916504 11423 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.908598 11374 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.908454 10964 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:10.922331  8166 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.923286  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:10.926117  8200 raft_consensus.cc:2410] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:10.926843  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:10.928324  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:10.872175 11476 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:10.923882 11471 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:10.936995  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49669.7us
I20260709 13:04:10.957862  8267 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:10.958606 11459 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.815s	user 0.000s	sys 0.006s
I20260709 13:04:10.898904 11435 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:10.930191 11466 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:10.959570 11507 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 13:04:10.924444 11367 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:10.987182 11367 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.987571 11367 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.966396 11429 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:10.971983  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:10.971251 11419 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:10.983733  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 75923.1us
W20260709 13:04:10.994136  8166 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.997s (SENT)
I20260709 13:04:10.994544  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.985821 11466 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:10.998773  8166 leader_election.cc:336] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.134s (SENT)
I20260709 13:04:11.000715  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:10.995319 11435 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.011603  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1876) took 1381 ms. Trace:
I20260709 13:04:11.012001  8121 rpcz_store.cc:276] 0709 13:04:09.626382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.757743 (+131361us) service_pool.cc:224] Handling call
0709 13:04:09.774405 (+ 16662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.779497 (+  5092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.779526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:09.817712 (+ 38186us) log.cc:844] Serialized 26 byte log entry
0709 13:04:10.127339 (+309627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:10.127380 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.127447 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:10.917538 (+790091us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:11.002226 (+ 84688us) raft_consensus.cc:1685] finished
0709 13:04:11.002246 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.008138 (+  5892us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10290,"raft.queue_time_us":9159,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5064,"spinlock_wait_cycles":41005440,"thread_start_us":266961,"threads_started":1,"wal-append.queue_time_us":313484}
I20260709 13:04:11.002652 11466 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.027905  8198 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:04:11.028275  8198 pending_rounds.cc:85] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 2
I20260709 13:04:11.028484  8198 pending_rounds.cc:107] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:04:11.028709  8198 raft_consensus.cc:2889] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:11.015740 10964 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:11.024514 11463 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.004395 11429 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.035208  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:11.026512  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:11.036281  8196 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:11.007781 11406 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:11.030179 11434 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:11.040865  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:11.049548 11494 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:11.049965 11494 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:11.050302 11494 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.050400 11479 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:11.036202 11075 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:04:11.054397  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.056381  8120 pending_rounds.cc:85] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 4
I20260709 13:04:11.056854  8120 pending_rounds.cc:107] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:11.057288  8120 raft_consensus.cc:2889] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:11.061659  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.042114 11142 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:11.063820  8117 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:04:11.036470 11450 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:04:11.068498  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.072696  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:11.073453  8805 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:11.043962 11077 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.044565  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:11.033835 11419 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:11.062251  8123 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:11.041417  8166 leader_election.cc:400] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:11.064697  8811 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:11.077520  8166 leader_election.cc:403] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:11.065972  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.078850  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:11.086357  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:11.035096 10964 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.067606 11245 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.089021 11474 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:04:11.095507 11474 consensus_queue.cc:1243] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:04:11.098243  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:11.093606 10964 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.099514  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:11.100262  8267 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:11.088449 11434 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.091264 11075 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:11.091748  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.091876  8803 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.093677 11374 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:11.067580 11406 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.101323 11450 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.085506 11419 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.101511  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:11.116700 11075 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:11.122887  8122 raft_consensus.cc:606] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Received request to transfer leadership
I20260709 13:04:11.094926 11245 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.116142 11216 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:04:11.128553 11516 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:11.129081 11075 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.131403 11216 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:11.132164 11216 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.127190 11456 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:04:11.134233 11509 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 13:04:11.136139 11245 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.138700 11077 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.127820 11515 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:11.139482 11515 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.139846 11515 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.142640 11419 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.123806 11374 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:11.132663 11504 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 13:04:11.125583 11476 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.128005 11406 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.146102  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.136776 11452 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:11.153949  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 102006us
W20260709 13:04:11.129781 11513 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:04:11.170046  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.170924  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:11.157392  8274 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:11.175420  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:11.119428 11479 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:11.156288 11216 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.184046  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.185644  8803 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:11.187902  8116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:11.167873 11374 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.188428  8116 raft_consensus.cc:606] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Received request to transfer leadership
I20260709 13:04:11.180666 11436 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:11.184957 11521 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:04:11.158869 11429 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:04:11.132125 11494 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.156675 11367 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:11.201428  8007 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for e848f577948c470fb4c95fcc2b55b7ef already in progress [suppressed 71 similar messages]
I20260709 13:04:11.199667 11436 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:11.205960 11512 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:04:11.206570 11452 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.209025  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:11.191164 11142 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.213650 11436 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.231887 11142 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.230567 11406 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.233085 11406 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.234637 11142 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.235169 11406 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.236081  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:11.236764  8196 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:11.237958 11494 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.238174 11479 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.252449  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.244210  8803 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.249393 11435 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:11.249585  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:11.255952  8266 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.246344  8198 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:11.268189 11436 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.270411 11436 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.273654 11374 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.273772  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1896) took 1104 ms. Trace:
I20260709 13:04:11.274219  8268 rpcz_store.cc:276] 0709 13:04:10.169366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.180458 (+ 11092us) service_pool.cc:224] Handling call
0709 13:04:11.273589 (+1093131us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54002ed6d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:11.273714 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883538816}
W20260709 13:04:11.278775 11478 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.798s	user 0.000s	sys 0.014s
I20260709 13:04:11.279371 11466 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:11.281901  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.284078 11490 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.284528 11490 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.286607 11490 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.289306  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:11.292425  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.270715 11139 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:11.307725 11139 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:11.308630 11139 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.293169  8271 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:11.295529  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:11.297297  8804 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.297775  8811 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:11.303119  8266 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:11.307406  8199 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:11.310374  8198 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.310606 11445 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.313650  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:11.272212  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2013) took 1137 ms. Trace:
I20260709 13:04:11.314396  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.317173  8197 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.322794  8807 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:11.322508  8194 rpcz_store.cc:276] 0709 13:04:10.134520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.137516 (+  2996us) service_pool.cc:224] Handling call
0709 13:04:10.428857 (+291341us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:10.429005 (+   148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.896281 (+467276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.271966 (+375685us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540014cdd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:11.272140 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054651904}
I20260709 13:04:11.324719  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:11.339943  8810 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:11.345146  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.345795  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.345809  8117 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.347016  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.348176  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.349960  8119 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:04:11.351015  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 159467us
I20260709 13:04:11.351666  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:11.336886 11517 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.244s	user 0.003s	sys 0.000s
I20260709 13:04:11.355225  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.357069  8804 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:11.358183  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.360344  8120 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.358606  8197 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:11.360625  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.361701  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.350263 11494 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:11.363358 11075 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.363513 11494 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:11.365267  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.366372  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.368556  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.369134  8274 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:11.373142  8268 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:11.381781  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.373675 11519 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.383814 11519 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.384732 11470 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:11.385690 11470 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:11.386094 11470 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:11.386935 11470 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.336351 11465 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:11.390573 11465 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:11.390929 11465 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:11.392127  8803 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:11.391788 11465 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.375919  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.394964 11515 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.376238  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:11.376930  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.397758  8119 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:11.375133  8198 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:11.401671 11177 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:11.390872  8117 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:11.418061  8120 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:11.363899 11075 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.425657  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.365993 11434 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:11.427079  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.428679  8268 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:11.432093  8267 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.433331  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:11.433634  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:11.434141  8194 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.374604 11466 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.435072  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:11.435686  8271 raft_consensus.cc:2410] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:11.439117  8199 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:11.436704  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.440459  8122 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:11.396672 10964 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.436560  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.441468  8265 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:04:11.441874  8270 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:11.447391  8193 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:11.447947  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 79677.7us
I20260709 13:04:11.450912  8273 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.450940  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.452030  8267 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:11.451129  8268 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:11.452788  8199 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:11.430473  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.455758  8120 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:11.460865  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.462301  8267 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:11.464031  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.465281  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.465622  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:11.465936  8270 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:11.430810 11419 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:11.467588  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.468626  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:11.471221  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:11.471817  8270 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260709 13:04:11.437552 11431 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:11.476310  8120 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:11.478070  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:11.472898  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:11.483963  8122 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:11.570351  8265 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.532771  8194 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:11.457660 11297 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:04:11.479089  8120 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:11.451365 10964 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.512323 11419 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:11.428460 11494 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.602015  8122 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:11.509084 11367 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.473416 11490 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 13:04:11.608361  8774 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.680s (SENT)
I20260709 13:04:11.608839  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:11.609937  8774 leader_election.cc:336] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.734s (SENT)
I20260709 13:04:11.610329  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:11.623823  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:11.626487  8803 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.640842  8807 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.607394 11423 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:11.607071 11474 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:11.615823 11396 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:11.639459 11515 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.647490 11466 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.624118 11506 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.290s
W20260709 13:04:11.653000 11525 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:04:11.654495 11528 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:04:11.652172 11431 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:04:11.675724 11519 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.650768 11423 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.692355 11542 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:11.715538  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 73901.2us
W20260709 13:04:11.710486 11533 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:04:11.716511  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:11.717720  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:11.717298 11519 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.719252  8774 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:11.668865 11474 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.722472 11423 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:11.719980 11542 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.724797 11542 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.704820 11419 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:11.728396 11537 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:04:11.713048 11549 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.717631 11075 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.719664 11539 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:11.722713 11474 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.746384 11431 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:11.755116 11536 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:04:11.755911 11541 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:04:11.775450  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.761471 11550 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:11.762663  8193 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:11.777400  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:11.776388 11550 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.781059 11519 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:11.781270  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:11.781967  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.782313 11543 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:11.782704  8811 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:11.783175  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:11.783892 11543 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:11.784250 11543 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.784535 11543 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.752483 11549 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.787592 11549 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.793968 11543 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.796279  8124 raft_consensus.cc:2410] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:04:11.797230 11543 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:11.798606 11528 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:11.799852 11539 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:11.800318 11539 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:11.768285 11216 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:04:11.719053 11466 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.764145 10964 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.769484  8802 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:04:11.771755 11538 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:04:11.772445 11532 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:04:11.801259 11139 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.812021  8265 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:11.825745  8807 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:04:11.836042 11547 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:04:11.838052 11430 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:11.838443 11430 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:11.838563 11539 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.844542  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:11.848512  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:11.867828  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.841099 11539 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.873199 11524 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:11.890395 11524 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:11.891476 11524 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.895051  8805 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:11.873808 11102 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:11.905923 11102 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:11.906767 11102 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.908984  8198 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:11.909873 11430 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.911057 11430 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.903096 11550 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.918231  8198 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.919515  8191 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:11.926644  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:11.927261  8197 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:11.925173 11290 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.928584 11290 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.929486 11367 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.929946 11367 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.930943 11290 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.932551 11367 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:11.934597  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:11.935077  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.936075 11515 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:11.936584  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.937117  8802 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:11.937919  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:11.939041  8191 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:11.936614  8807 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:11.923735 11550 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.943073  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:11.953950 11297 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:11.943506 11506 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:04:11.956715 11297 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.958643 11297 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:11.959105 11297 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.959672 11297 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:11.960264  8091 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:11.936522 11515 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.961495 11367 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:11.962441 11367 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:04:11.968544 11467 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:11.970333 11367 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:11.970705 11367 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:11.971486 11490 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:11.971853 11490 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:11.973762 11367 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.975848 11367 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.974941 11467 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:11.976398 11467 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:11.977108 11467 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:11.978165 11467 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.979488 11476 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.961153 11471 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:04:11.972749 11490 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.985858 11515 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:11.987017  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:11.985884 11490 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.962980 11550 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:11.991415 11550 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:11.996184  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 60644.2us
I20260709 13:04:11.996896  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:11.997707  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:11.998251  8198 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.003283  8803 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:12.006093  8198 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:12.010004  8123 pending_rounds.cc:85] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 3
I20260709 13:04:12.010331  8123 pending_rounds.cc:107] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:04:12.010588  8123 raft_consensus.cc:2889] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:11.997946 11475 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:12.014827  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:12.015209  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.019520  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:12.020119  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 59944.4us
I20260709 13:04:12.020820  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.021158  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.021641  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:12.022172  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.023690  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:12.024228  8269 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.033365  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.033906  8265 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:12.035028  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.035450  8121 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:12.036227  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:12.044381  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 59413.1us
I20260709 13:04:12.045051  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:12.013069 11471 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:04:12.046428  8121 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:12.019244 11475 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:12.049467  8265 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:12.049499  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:12.050431  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.050864  8266 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.051026  8198 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:12.007993 11297 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:12.045305 11452 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.062912 11139 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:12.063877  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.065267  8807 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:12.072714  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.073278  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.075392  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:12.073128  8266 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:12.077718  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.078302  8120 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:12.078447  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:12.079435 11471 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:12.079836 11471 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:12.080583 11471 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.081231 11475 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.082388 10964 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:12.082829 10964 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.083137 10964 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.048525 11561 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:12.086844  8269 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:12.087204  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:12.087708  8271 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.087888  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.090327  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:12.091835  8267 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:12.092075  8125 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:12.092816  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.093972  8266 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:12.094573  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.101687  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.101866 11210 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.102327 11210 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.102664 11210 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.102918  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.103039  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.103510  8121 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:12.103693 11543 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:12.104380  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.105400  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:12.060390 11413 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:12.106438  8271 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:12.107784  8121 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:12.056354 11562 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:12.054080 11406 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:04:12.114542  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.115876  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.116398  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:12.056461 11102 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:04:12.089305 11139 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:12.117908  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:12.129036 11402 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:12.130172  8118 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:12.085036 11452 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.132126 11413 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:12.129055 11566 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:12.132957  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1654) took 1045 ms. Trace:
I20260709 13:04:12.133206 11139 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.133333  8196 rpcz_store.cc:276] 0709 13:04:11.087835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.088278 (+   443us) service_pool.cc:224] Handling call
0709 13:04:11.103328 (+ 15050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:11.252155 (+148827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.132764 (+880609us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400364f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:12.132905 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306467584}
I20260709 13:04:12.120168 11519 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:12.134280 11413 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.143812  8273 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:12.145633  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:12.145774  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.146245  8196 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.136893 11452 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:12.147573  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 88223us
I20260709 13:04:12.148567  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.149188  8195 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:12.167340  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51032.4us
I20260709 13:04:12.133622 11139 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.174029  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.174492  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.175009  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:12.144977 11505 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.177850  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:12.144569 11435 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:12.149564 11472 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:12.202997  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:12.188524  8124 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:12.207022  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:12.208671  8196 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:12.209000  8163 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:12.179348  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.176412 11490 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.196621  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:12.178438  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 538) took 1090 ms. Trace:
I20260709 13:04:12.179873  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:12.199813  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:12.200579  8121 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:12.147183 11077 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:04:12.221839  8118 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.221437  8806 rpcz_store.cc:276] 0709 13:04:11.080542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.080660 (+   118us) service_pool.cc:224] Handling call
0709 13:04:12.171120 (+1090460us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400476b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:12.171258 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017030016}
I20260709 13:04:12.227419  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.196295 10876 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:12.175384 11399 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:12.233018  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:12.240064  8121 raft_consensus.cc:606] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Received request to transfer leadership
I20260709 13:04:12.173710 11519 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:12.208093 11434 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:12.201022 11472 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:12.207939 11445 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.202220 11561 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:12.208046 11554 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:12.210487 11433 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.258226  8196 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:12.203754 11543 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:12.249255  8195 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:12.249692  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:12.251603  8118 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:12.196460 11449 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:04:12.212870 11494 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:04:12.227735 11548 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:12.224687 11290 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:12.270341  8199 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:12.254925  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 75615.7us
I20260709 13:04:12.286128 11515 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.271381 11562 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:12.265995 11570 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:12.243537 11216 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:04:12.239607 11467 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:04:12.343006  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61182.8us
I20260709 13:04:12.348312  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.270498  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.252306 11519 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:12.349794  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 63008.4us
I20260709 13:04:12.260510 11542 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:04:12.259608 11445 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:12.267055 11543 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.287526 11419 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:04:12.349735 11515 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.351094 11570 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.261533 11561 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:12.397949  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:12.349088 11434 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:12.348474 11290 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.359915 11562 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:12.392940 11397 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:12.429441  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:12.425742 11543 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:12.437016 11563 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:12.437539 11569 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:04:12.437719  8089 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:12.480533  8265 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:12.444196 11465 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:12.400863 11573 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:04:12.456040  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:12.443348  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.483767  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 46129.8us
I20260709 13:04:12.344755 11472 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:12.404119 11374 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:12.424500 11568 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:04:12.486575  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.487852  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 90939.8us
W20260709 13:04:12.435015 11553 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.494s	user 0.000s	sys 0.003s
I20260709 13:04:12.427708 11519 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:12.401391 11515 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.397243 11399 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:04:12.425899 11445 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:12.435628 11570 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:12.396981 11077 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.502511  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:12.498662 11435 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:12.487474 11467 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:12.487954 11304 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:12.488042 11563 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:12.529006 11574 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:04:12.530467 11549 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:12.485543 11506 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:04:12.543882  8200 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:12.543618  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:12.500391 11374 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.549095 11434 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.554425 11210 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:12.555588 11578 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:04:12.625007  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 139342us
I20260709 13:04:12.543592 11399 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:12.539686 11077 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:12.669952  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 413837us
I20260709 13:04:12.671523  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:12.704214 11571 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:04:12.546921 11549 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:12.534240 10964 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:12.706183  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 159890us
I20260709 13:04:12.554486 11374 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:12.861964  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 235063us
I20260709 13:04:12.863339  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:12.655663 11399 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:12.869665 11399 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:12.872267 11139 consensus_meta.cc:287] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.003s
I20260709 13:04:12.872673 11139 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:12.873744  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 202297us
I20260709 13:04:12.874596 11139 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:12.875541 11290 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:12.876025 11290 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.876420 11290 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:12.877933 11542 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:12.878428 11542 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:12.879192 11542 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:12.681196 11304 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.234s
I20260709 13:04:12.705106 11524 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:12.885449 11435 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:12.925921 11590 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.883365 11563 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:12.984647  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.886986 11445 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:04:12.749807 11578 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:04:13.014242  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 220709us
W20260709 13:04:13.018360  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.054396  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:13.048188  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.013831 11397 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.055286  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:13.039753 11575 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
I20260709 13:04:13.039364 11413 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:13.035874 11524 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.039897 11590 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.072395 11467 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:13.107445  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1583) took 1018 ms. Trace:
W20260709 13:04:13.168853 11515 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.001s
I20260709 13:04:13.276829  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 550) took 1212 ms. Trace:
I20260709 13:04:13.297293  8269 rpcz_store.cc:276] 0709 13:04:12.088773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.088882 (+   109us) service_pool.cc:224] Handling call
0709 13:04:12.089173 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:12.165527 (+ 76354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.165798 (+   271us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:12.166346 (+   548us) log.cc:844] Serialized 52 byte log entry
0709 13:04:12.237501 (+ 71155us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:12.253684 (+ 16183us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.289060 (+ 35376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.289141 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.107215 (+818074us) raft_consensus.cc:1685] finished
0709 13:04:13.107238 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.107382 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107923,"prepare.queue_time_us":16024,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":103904,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":3615488,"thread_start_us":54643,"threads_started":2,"wal-append.queue_time_us":67378}
W20260709 13:04:13.282682  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 408329us
W20260709 13:04:13.149981  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.017s	sys 0.022s
W20260709 13:04:13.302829  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.019s	sys 0.024s
W20260709 13:04:13.168056 11589 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:04:13.305310  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.301074  8807 rpcz_store.cc:276] 0709 13:04:12.064157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.064414 (+   257us) service_pool.cc:224] Handling call
0709 13:04:12.064717 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:12.065052 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:12.091524 (+ 26472us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.657230 (+565706us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.708897 (+ 51667us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.709437 (+   540us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:12.709977 (+   540us) log.cc:844] Serialized 52 byte log entry
0709 13:04:12.710102 (+   125us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:12.710133 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.710196 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.170972 (+460776us) raft_consensus.cc:1685] finished
0709 13:04:13.170994 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.276760 (+105766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":549584,"prepare.queue_time_us":633329,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":34904,"raft.queue_time_us":35518,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":155300,"spinlock_wait_cycles":158605696,"thread_start_us":494021,"threads_started":2,"wal-append.queue_time_us":256677}
I20260709 13:04:13.307165  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:13.309041  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:13.276575 11304 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.079210 11571 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:13.279448 11210 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:13.314719  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 260418us
I20260709 13:04:13.072005 11562 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.297104 11467 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.317749  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:13.308081 11258 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:13.312265 11434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.005s	sys 0.013s
I20260709 13:04:13.071821 11397 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.304111 11139 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.312801 11515 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.322484 11467 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.076233 11549 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.325414 11584 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:13.325986 11258 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.326460 11591 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:13.326597 11524 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.314589 11077 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:13.319680 11570 consensus_meta.cc:287] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.000s
I20260709 13:04:13.296130 11413 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:13.324896 11434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.005s	sys 0.013s
I20260709 13:04:13.341882  8271 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:13.337635  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:13.337898  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:13.327721 11494 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:13.330169 11465 consensus_meta.cc:287] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.841s	user 0.009s	sys 0.008s
I20260709 13:04:13.328944 11571 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:13.317718 11304 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.341964  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:13.336469 11584 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:13.345052  8270 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:13.345283  8268 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:13.333798 11456 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.336908 11583 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.330437 11139 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.363288  8166 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:13.368400 11539 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:13.368799 11139 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.339319 11591 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.343312 11570 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.370537 11591 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.371366 11570 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:13.371855 11258 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.373063  8265 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:13.357445 11571 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.347393 11290 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.352195 11445 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.376451  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 693) took 1202 ms. Trace:
I20260709 13:04:13.360253 11562 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:13.393512  8802 rpcz_store.cc:276] 0709 13:04:12.174496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.174693 (+   197us) service_pool.cc:224] Handling call
0709 13:04:12.203025 (+ 28332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.426859 (+223834us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:12.495956 (+ 69097us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.541404 (+ 45448us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.546208 (+  4804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:12.546254 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:12.546299 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.376228 (+829929us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54004e16d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:13.376271 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.376392 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23636,"prepare.queue_time_us":777530,"prepare.run_cpu_time_us":2743,"prepare.run_wall_time_us":103894,"raft.queue_time_us":28224,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":6357,"spinlock_wait_cycles":533535360,"thread_start_us":94102,"threads_started":2,"wal-append.queue_time_us":385063}
I20260709 13:04:13.389381 11571 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:13.363185 11593 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:13.439178 11595 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.443069 11590 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.444103 11494 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:13.444576 11494 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.439613 11539 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.445912 11539 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.439685 11562 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.406847 11445 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.448606  8116 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:13.449419 11604 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:13.450179  8116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1974) took 1435 ms (client timeout 1573 ms). Trace:
W20260709 13:04:13.450575  8116 rpcz_store.cc:269] 0709 13:04:12.014904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.015002 (+    98us) service_pool.cc:224] Handling call
0709 13:04:13.449938 (+1434936us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400299854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:13.450123 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3295474432}
W20260709 13:04:13.457981  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 149008us
I20260709 13:04:13.461280  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:13.464632 11590 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.465199 11590 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.468647  8116 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:13.469066  8116 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:13.469781  8116 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.470690  8116 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:13.450786 11399 consensus_meta.cc:287] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:04:13.484436  8116 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:13.438621 11434 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.499665  8116 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:04:13.513820  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.517045  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:13.518308  8116 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
W20260709 13:04:13.518798  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.515483 11476 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.521026  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:13.524984  8116 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:04:13.510896 11397 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:13.513707 11570 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.496851 11434 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.540014  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:13.519224 11515 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:13.518674 11609 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.520720 11470 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:13.543058  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:13.520133 11588 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:13.547600 11560 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.503s	user 0.008s	sys 0.006s
I20260709 13:04:13.527014 11597 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.538756 11562 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:13.617045 11290 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:13.616837  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 98441.7us
I20260709 13:04:13.527777 11476 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.603776 11593 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.616362 11413 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:13.722472 11602 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:13.722926 11601 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.801750 11601 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.780336 11562 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.804817 11562 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.545507 11609 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.559909 11588 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.596496 11550 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:13.542361 11570 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.604092 11258 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.617895 11515 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:13.752808 11542 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:13.752882 11593 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.373603 11456 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.443408 11595 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.449915 11604 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.495579 11399 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.375029 11583 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:13.725080 11598 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:04:13.672992 11606 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:13.875428  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.616101 11597 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.650621 11304 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.650327 11290 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:13.497108 11584 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.172513  8120 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:04:14.199813  8116 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.003s
W20260709 13:04:13.938199 11605 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
W20260709 13:04:14.201057  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.201880  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.200259  8116 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.005s	sys 0.003s
I20260709 13:04:14.210898  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:14.136168 11467 consensus_meta.cc:287] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.801s	user 0.006s	sys 0.003s
W20260709 13:04:14.166944 11470 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.002s
W20260709 13:04:14.197726 11435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.001s	sys 0.008s
W20260709 13:04:14.209463 11297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.003s	sys 0.007s
I20260709 13:04:14.132815 11562 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.087845 11423 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:14.215252  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.175309 11570 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.174346 11476 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.218554  8270 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:14.221910  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 328615us
I20260709 13:04:14.223819 11554 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.224346 11554 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.226383 11554 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.226882 11554 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.227629 11554 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.230436 11554 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.230345  8804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 691) took 2056 ms. Trace:
W20260709 13:04:14.217664 11297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.007s
I20260709 13:04:14.216517  8117 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:14.212030 11304 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.233541 11304 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.234362 11456 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.216903 11467 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.235419 11604 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.222606 11449 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:14.173559 11494 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.236163 11449 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.236764 11467 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.238193 11449 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.176028 11601 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.239872 11595 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:13.945273 11550 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.222505 11413 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.242287 11550 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.241941 11413 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.243903 11583 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.232503 11608 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.245855 11608 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.216180  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:13.947613 11609 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.201192 11591 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.247335 11591 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.236071 11465 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.948673 11515 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.219744  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:14.215185  8088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.011s
I20260709 13:04:13.974644 11588 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:14.218627 11571 consensus_meta.cc:287] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.000s
I20260709 13:04:14.220489 11470 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.235661 11304 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:13.935973 11602 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:13.951956 11258 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.206131 11607 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:14.249420  8088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.012s
I20260709 13:04:14.231662  8804 rpcz_store.cc:276] 0709 13:04:12.173945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.174172 (+   227us) service_pool.cc:224] Handling call
0709 13:04:12.174420 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.426744 (+252324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.426775 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:12.426816 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:12.426846 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.230122 (+1803276us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54005401d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:14.230177 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.230294 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579854208}
I20260709 13:04:14.248592 11465 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:14.218062 11435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.001s	sys 0.008s
I20260709 13:04:13.947791 11542 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.248653 11608 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.245186 11413 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.207192 11606 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.231458 11562 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.266062 11290 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.266614 11258 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.257040 11470 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.253229 11571 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:14.268728 11546 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.954s	user 0.005s	sys 0.050s
I20260709 13:04:14.222896 11423 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.284605  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 76) took 2052 ms. Trace:
I20260709 13:04:14.262271 11607 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.300859 11571 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.266633 11602 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.285857 11515 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.286795 11591 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.288461 11542 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.289036 11562 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.307899 11593 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.288565  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:14.309216 11608 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:14.309793  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.309756 11608 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:14.310500  8125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 1977) took 2289 ms (client timeout 2130 ms). Trace:
W20260709 13:04:14.310912  8125 rpcz_store.cc:269] 0709 13:04:12.021328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.021449 (+   121us) service_pool.cc:224] Handling call
0709 13:04:14.310289 (+2288840us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b5400149454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:14.310397 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138280832}
I20260709 13:04:14.311738 11608 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.302215 11607 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.305091 11562 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.312657 11604 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.313400 11490 raft_consensus.cc:993] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:04:14.313176 11604 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.313903 11490 raft_consensus.cc:1081] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:04:14.318288  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.295385  8121 rpcz_store.cc:276] 0709 13:04:12.232213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.232886 (+   673us) service_pool.cc:224] Handling call
0709 13:04:14.284215 (+2051329us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400472aa0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24ca5520 00007fbd24d22652 00007fbd29cf060a 00007fbd232767d4 00007fbd23276762 00007fbd23276691 00007fbd2327660c 00007fbd232758c2 00007fbd2306348c 00007fbd230628c6
0709 13:04:14.284503 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81016192}
I20260709 13:04:14.298614 11423 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.320058  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:14.320647  8125 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:14.322230  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.315282 11604 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.322803  8120 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:14.322749  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.323405  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.326370  8116 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:14.326933 11435 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.327436 11435 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.329478 11466 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.330029 11466 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.331974 11466 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.332445 11466 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.332867 11466 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.334842 11466 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.332782  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.336335  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.336889  8802 raft_consensus.cc:2410] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:04:14.286808 11445 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.343393  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.344305  8121 raft_consensus.cc:2410] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:04:14.346299  8125 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:14.302181 11399 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.350642  8807 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:04:14.352106  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.309161 11583 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.355942  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.356158  8121 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:14.319068 11588 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:14.357846  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69333.2us
I20260709 13:04:14.360360  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:14.361528  8121 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.362880  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:14.363485  8125 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.363605  8807 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:14.321975 11494 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.370842  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:14.324431 11602 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.377966  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.335427 11542 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.386948  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:14.389036  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:14.397492  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 70594.8us
I20260709 13:04:14.389428  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:14.398803  8804 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.390981  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:14.391142  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.399582  8805 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:14.391649  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:14.391950  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.392903  8809 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:14.388957  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.391578  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:14.394220  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.402629  8803 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:14.402853  8270 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:14.395931  8125 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:14.350762 11604 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.342121 11554 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.350071 11593 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.351406 11474 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.386145  8116 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:04:14.404414  8120 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:14.406512  8808 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:14.403728  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.411309  8121 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:14.410840  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.410127  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:14.360798 11435 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.372262 11588 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.365397 11583 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.628387  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.612733  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.612769  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.663195  8194 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:04:14.649510  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.469937  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.541160  8088 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:14.469901  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.447726  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1919) took 1111 ms. Trace:
I20260709 13:04:14.588667  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.479561  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.453685  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.502048  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.469779  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.455650  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:14.570585  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64930.2us
I20260709 13:04:14.537703  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.470702  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.564602  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:14.604977  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.662868  8118 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:14.627486 11561 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.670259 11591 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:14.670707 11591 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.671217 11590 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.630872 11597 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.671505 11591 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.672323  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.672895  8123 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:14.637233 11506 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.436713  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.676641  8806 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:14.668684  8274 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:14.675714  8265 rpcz_store.cc:276] 0709 13:04:13.336058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.336157 (+    99us) service_pool.cc:224] Handling call
0709 13:04:13.346851 (+ 10694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.373461 (+ 26610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.447510 (+1074049us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5400154854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:14.447671 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59891072}
I20260709 13:04:14.677254  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:14.665755  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 124691us
I20260709 13:04:14.455184  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:14.478892  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.432305  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.507493 11258 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:14.457173  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.691135  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.670454  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.691360  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.446089  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 408) took 3089 ms. Trace:
I20260709 13:04:14.692359  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:14.669855  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 105371us
I20260709 13:04:14.507496 11423 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.700745  8125 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:14.424819  8804 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:14.663265  8196 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:14.669657  8273 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:14.397663 11562 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.473863  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.702708 11562 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.703512  8810 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:14.396008 11515 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:14.572978  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:14.704474  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 389069us
I20260709 13:04:14.621091 11549 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:14.406008 11571 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.479236  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.456377 11606 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.693902  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:14.709321  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.695616  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.449746 11290 raft_consensus.cc:993] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:04:14.545450 11623 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.412824  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:14.688452 11583 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.725638  8121 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.507678 11466 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.705157 11258 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.693681 11506 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.728581  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.729166  8265 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:14.409255 11542 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.691233  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.692359  8119 rpcz_store.cc:276] 0709 13:04:11.356232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.398324 (+ 42092us) service_pool.cc:224] Handling call
0709 13:04:11.398652 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.398962 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:11.398989 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:11.399744 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 13:04:11.644791 (+245047us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:11.673911 (+ 29120us) log.cc:844] Serialized 14 byte log entry
0709 13:04:11.933211 (+259300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.933279 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.243614 (+310335us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003bc560. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:14.268233 (+2024619us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:14.445878 (+177645us) raft_consensus.cc:1685] finished
0709 13:04:14.445899 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.446033 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240857,"prepare.queue_time_us":28830,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1565,"raft.queue_time_us":243709,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":7512,"spinlock_wait_cycles":62275072,"thread_start_us":190949,"threads_started":1,"wal-append.queue_time_us":276674}
I20260709 13:04:14.706336  8123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:14.533011 11471 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:14.706804  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 385522us
I20260709 13:04:14.466491 11470 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.576287 11419 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.405812 11399 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.396937 11494 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.470489 10964 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.456534 11622 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.469817  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.543927 11465 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.677313 11396 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:14.699460  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:14.599009 11630 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.722955  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.872740  8808 raft_consensus.cc:2393] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:14.700291 11550 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:14.724239  8124 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:14.723793  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.724992  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.730414  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.447163 11584 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.260s
I20260709 13:04:14.634624 11472 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.407235 11602 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.901062  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.677253 11474 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.790532 11561 raft_consensus.cc:1081] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:04:14.445492 11554 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.840471  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.916574  8195 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:14.839908  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 264970us
I20260709 13:04:14.831624  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:14.917538  8265 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:14.848662 11542 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.735092  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.707532 11423 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.877710  8121 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:14.732990  8088 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:14.734685  8270 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:14.730990 11633 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.199s
I20260709 13:04:14.922946 11635 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.923329 11631 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.923841 11631 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.925909 11631 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.923539 11635 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.927651  8265 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:14.927938 11433 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.928529  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.928433 11433 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.921203  8273 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:14.929725 11494 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.930120  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.930711 11470 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:14.930984  8273 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:14.931355  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 198476us
I20260709 13:04:14.931705  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.932669  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.928545 11635 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.731971 11623 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.933142  8273 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:14.933626 11629 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.934227 11629 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.934311  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:14.934180  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.935379 11623 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.735168 11466 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.933688 11628 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:14.936718 11413 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:14.936583 11628 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.936908 11629 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.937134 11413 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:14.937376 11466 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.937664 11413 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.938097  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:14.939270 11628 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.939687 11629 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:14.939817 11628 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:14.933084  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:14.795058  8118 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:14.734719  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.940658 11565 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:14.467558 11593 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.943270  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:14.943624 11593 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.944003 11623 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:14.930338 11433 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.902554  8267 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:14.873216 11396 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:14.945521 11396 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:14.946647 11629 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:14.946923 11413 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.948443  8265 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:14.892410 11419 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:14.903724 11634 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:04:14.904328 11398 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:14.893666 11630 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.953210 11398 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.954080 11419 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.955113 11398 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.956686 11245 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:14.957023 11245 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:14.957723 11245 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.958772 11245 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:14.959264 11396 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.909938  8192 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:14.432273 11604 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.756173 11583 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.765290 11590 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.164s
I20260709 13:04:14.762633 11258 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.863992  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.969451  8193 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:14.763592 11588 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.969622  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.973316 11602 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.977706  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.978246 11554 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.978792  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.979398  8193 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
W20260709 13:04:14.979849 11603 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.439s	user 0.004s	sys 0.009s
I20260709 13:04:14.980190  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.980736  8193 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:14.981909  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1881) took 3625 ms. Trace:
I20260709 13:04:14.982153 11630 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.983074  8199 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:14.892258 11399 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.989442 11604 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.990391 11402 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:14.990876 11402 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:14.990958 11399 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:14.993201 11423 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.892807 11622 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:14.995575  8268 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:14.996397 11622 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.997428 11397 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:14.999361  8268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1592) took 1459 ms (client timeout 1857 ms). Trace:
W20260709 13:04:14.712363  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.000066  8268 rpcz_store.cc:269] 0709 13:04:13.539956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.540060 (+   104us) service_pool.cc:224] Handling call
0709 13:04:14.997299 (+1457239us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002eccd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:14.999278 (+  1979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3339156224}
I20260709 13:04:14.847179 11562 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.879195 11450 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.841540 10876 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:14.850113 11506 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.705296 11515 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:14.934787  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.998008 11397 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:14.801963  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.052429 11396 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:14.951866  8809 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:14.763294  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.053800  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.053939  8196 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:04:14.916412 11156 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:04:14.721177 11571 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:14.917625  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:14.999418  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 269218us
I20260709 13:04:14.918793  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.001710  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.002496  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.085632  8118 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:15.086025  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.003288  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.004159  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.004115  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.005671  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.087282  8777 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:15.006327  8192 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:15.006742  8120 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:14.980794  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.010195  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:15.087332  8125 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:15.010816  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:15.011839  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:14.978816  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:14.916028  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.026576  8271 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:14.982268  8117 rpcz_store.cc:276] 0709 13:04:11.356670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.403207 (+ 46537us) service_pool.cc:224] Handling call
0709 13:04:11.403468 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.233167 (+2829699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.981612 (+748445us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b54003cfad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:14.981838 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6469213440}
I20260709 13:04:15.046785  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:14.935984  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:15.091488  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 155560us
I20260709 13:04:15.054421  8265 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:15.053946  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.093291  8273 raft_consensus.cc:2410] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:04:15.055675  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.058051 11472 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:15.101572 11548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.731s	user 0.025s	sys 0.048s
W20260709 13:04:15.058558  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 141282us
I20260709 13:04:15.059305 11644 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.059809 11645 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.053333 11515 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:15.072829  8165 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50494 dropped due to backpressure: service queue is full with 50 items
I20260709 13:04:15.074112 11539 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:15.075744  8022 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 8, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 8 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.264158  8122 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:04:15.080739  8020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 256) took 8996 ms. Trace:
I20260709 13:04:15.114717 11650 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:04:11.288085  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:15.085685  8121 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:15.101974  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:15.098629  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:15.269835  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 167968us
W20260709 13:04:15.105195  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 94540.6us
W20260709 13:04:15.106243  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 96144.4us
I20260709 13:04:15.107646  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:15.108422  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.060940 11474 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:15.110590 11454 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:15.109747 11396 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:15.101944 11548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.743s	user 0.025s	sys 0.048s
I20260709 13:04:15.112584 11586 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:15.114638 11639 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:15.081391 11506 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:15.115909  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.118083 11402 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.126010  8268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:04:15.273504 11454 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.264721  8020 rpcz_store.cc:276] 0709 13:04:06.084860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.284612 (+199752us) service_pool.cc:224] Handling call
0709 13:04:15.080616 (+8796004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:09.574995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:09.575565 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:09.575597 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:04:09.575618 (+    21us) tablet.cc:662] Decoding operations
0709 13:04:09.587162 (+ 11544us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:09.587236 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:09.587261 (+    25us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:04:09.588680 (+  1419us) tablet.cc:701] Row locks acquired
0709 13:04:09.588695 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:04:09.588849 (+   154us) write_op.cc:270] Start()
0709 13:04:09.588960 (+   111us) write_op.cc:276] Timestamp: P: 1783602249588801 usec, L: 0
0709 13:04:09.588976 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:04:09.605598 (+ 16622us) log.cc:844] Serialized 7980 byte log entry
0709 13:04:10.130645 (+525047us) op_driver.cc:464] REPLICATION: finished
0709 13:04:10.826253 (+695608us) write_op.cc:301] APPLY: starting
0709 13:04:10.833504 (+  7251us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:10.865263 (+ 31759us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:10.865423 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:10.902126 (+ 36703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:10.902415 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:04:10.902454 (+    39us) write_op.cc:312] APPLY: finished
0709 13:04:10.902882 (+   428us) log.cc:844] Serialized 139 byte log entry
0709 13:04:10.903048 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:10.903212 (+   164us) write_op.cc:454] Released schema lock
0709 13:04:10.903262 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:10.917896 (+ 14634us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:10.923404 (+  5508us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":208231,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":659977,"apply.run_cpu_time_us":5263,"apply.run_wall_time_us":104233,"num_ops":20,"prepare.queue_time_us":180172,"prepare.run_cpu_time_us":16461,"prepare.run_wall_time_us":197487,"raft.queue_time_us":85467,"raft.run_cpu_time_us":118897,"raft.run_wall_time_us":547042,"replication_time_us":530534,"thread_start_us":701922,"threads_started":4,"wal-append.queue_time_us":293727,"wal-append.run_cpu_time_us":13207,"wal-append.run_wall_time_us":1993812}]]}
I20260709 13:04:15.109683 11472 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.261880  8165 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50494 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1715)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1685)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1700)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50494 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1711)
I20260709 13:04:15.373373 11472 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:15.253935  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 143087us
I20260709 13:04:15.373558 11506 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.374186  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:15.375378 11584 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.254671 11374 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:15.053380 11450 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.375996 11413 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:15.270818 11596 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.255234  8123 raft_consensus.cc:606] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Received request to transfer leadership
I20260709 13:04:15.377202 11450 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:14.969044 11583 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.379379  8272 raft_consensus.cc:2410] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:15.053054 10876 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.379956  8266 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:15.381469 10876 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:15.116420 11644 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.375725 11584 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:15.382110 11584 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.383596 11644 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:15.322777 11639 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:15.384647 11639 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:15.269887  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 171331us
I20260709 13:04:15.104800  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:15.387471  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 282744us
I20260709 13:04:15.390216 11586 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:15.262917  8022 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.266577 11571 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:15.274416  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.375681 11620 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:04:15.371338  8268 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.437879  8268 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.376740 11596 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.106345 11567 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:15.125483 11645 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.272186  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:15.278008 11471 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:15.266933 11591 consensus_meta.cc:287] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.595s	user 0.017s	sys 0.023s
I20260709 13:04:15.391952  8022 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 8, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 8 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:15.398584  8808 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:15.436852  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.444566  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.371338 11454 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.287174 11548 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:15.603483  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:15.625298  8271 raft_consensus.cc:606] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.625716  8271 raft_consensus.cc:614] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:15.563730  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.626495  8022 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 8, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:15.627750  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1616) took 1002 ms. Trace:
I20260709 13:04:15.456982  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.531487 11583 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:15.460273  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.506458  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.390631 11586 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.628640  8022 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.634251  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1607) took 1135 ms. Trace:
I20260709 13:04:15.634759  8266 rpcz_store.cc:276] 0709 13:04:14.499155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.942099 (+442944us) service_pool.cc:224] Handling call
0709 13:04:14.942375 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.380285 (+437910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.634050 (+253765us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400075654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:15.634200 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005740800}
I20260709 13:04:15.636256  8022 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 8, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:15.637923 11471 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.638794 11471 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:15.639806  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 534427us
I20260709 13:04:15.639022  8022 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 2 to 5, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:15.642030  8022 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: leader changed from <none> to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 8 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.633767 11586 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.643740 11402 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.438572 11423 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.204s
W20260709 13:04:15.644681  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 388816us
I20260709 13:04:15.647678  8022 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.637135 11645 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:15.556181  8268 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.651401  8022 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.654574  8022 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 7, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:15.658349  8022 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:15.630869  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 415) took 3541 ms. Trace:
I20260709 13:04:15.660303  8268 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:15.662725  8122 rpcz_store.cc:276] 0709 13:04:12.089339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.105185 (+ 15846us) service_pool.cc:224] Handling call
0709 13:04:15.630697 (+3525512us) spinlock_profiling.cc:243] Waited 3.16 s on lock 0x7b54000b04d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:15.630817 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7263182592}
I20260709 13:04:15.632895  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.640554  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:15.660832  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 77) took 1213 ms. Trace:
I20260709 13:04:15.665858  8123 rpcz_store.cc:276] 0709 13:04:14.446961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.706202 (+259241us) service_pool.cc:224] Handling call
0709 13:04:15.660606 (+954404us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54000b09d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d22853 00007fbd29cf060a 00007fbd232767d4 00007fbd23276762 00007fbd23276691 00007fbd2327660c 00007fbd232758c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:15.660740 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {"spinlock_wait_cycles":883455744}
I20260709 13:04:15.451978 11413 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:15.674124 11413 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:15.674705  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 726608us
I20260709 13:04:15.676084  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.571354 11506 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:15.612614 11620 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:04:15.450619 11567 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.682775 11506 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:15.685581 11506 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.389799  8164 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50482 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2073)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1715)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1685)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1700)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50494 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1711)
I20260709 13:04:15.686975  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.687662 11506 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:15.688170 11506 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:15.688372  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.681365 11548 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.684716 11290 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.677306  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.678395 11450 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:15.451025 11571 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.691689  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 561) took 1232 ms. Trace:
I20260709 13:04:15.703881  8809 rpcz_store.cc:276] 0709 13:04:14.459154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.462234 (+  3080us) service_pool.cc:224] Handling call
0709 13:04:14.628223 (+165989us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:15.691523 (+1063300us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54005b1b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:15.691627 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670557952}
W20260709 13:04:15.692190  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.689169 11651 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:15.696388  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:15.705757  8271 raft_consensus.cc:606] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.702112  8164 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36640 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1685)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1700)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50494 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1717)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2082)
I20260709 13:04:15.706101  8271 raft_consensus.cc:614] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:15.697738  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:15.697727  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:15.656940 11596 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:15.611848 11434 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:15.676039 11413 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:15.705031 11396 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:15.709090  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.705260 11583 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:15.708963 11423 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:15.707942  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.708707  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:15.667666 11600 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:15.695019 11645 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.689812 11567 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.739671 11423 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:15.738780 11583 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:15.741212 11413 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:15.741830  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:15.742381 11651 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:15.706717  8164 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50482 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1685)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1700)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50494 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1717)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2082)
I20260709 13:04:15.745823  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:15.755828  8271 raft_consensus.cc:606] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.713011 10876 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:15.739210 11639 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.761850  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:15.739254 11515 consensus_meta.cc:287] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.000s
I20260709 13:04:15.696807 11474 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:15.756234  8271 raft_consensus.cc:614] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:15.770845  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.748953 11584 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.752521 11423 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.822937  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.757933  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.777597  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.770790  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.824710  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.824952  8124 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:15.758594  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.826522  8272 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:15.759312  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.826932  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.827586  8196 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:15.759486  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.759698  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.760835  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.751067  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:15.692952 11591 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.768940  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.836629  8193 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:15.769622  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.767004  8164 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50482 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1683)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1685)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1686)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1700)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50494 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1717)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2081)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2082)
I20260709 13:04:15.770615  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.770635  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.772181  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.835090  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.772454  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.838551  8811 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:15.773686  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.774333  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:15.705173 11290 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.826642  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.831770  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:15.840034  8194 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:15.840440  8124 raft_consensus.cc:2368] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10.
I20260709 13:04:15.832116  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.840883  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.841457  8116 raft_consensus.cc:2410] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:15.833623  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:15.834151  8265 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:15.757534 11472 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:15.835616  8809 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:15.695758 11650 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:15.842932  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.843052  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.843636  8122 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:15.844321  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.844924  8121 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:15.845177  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.846040  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.846378  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.838101  8274 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:15.847213  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.847615  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.847775  8193 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:15.848655  8803 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:15.849057  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.849653  8193 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:15.850311  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.850912  8267 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:15.851701  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.854449  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.855067  8192 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:15.855314  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:15.856108  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.856688  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:15.856844  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.857259  8121 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:15.857509  8199 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:15.858397  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.859328  8121 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:15.859716  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:15.708425 11571 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.757035 10876 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:15.862250  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:15.860312  8121 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.863549  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.870602  8119 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:15.864313  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.864823  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.870947  8121 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.768357 11413 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:15.866520  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.867532  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.874194  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.875275  8267 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:15.870324  8193 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.854063 11650 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.871955  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:15.756048 11645 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.872776  8116 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:15.873412  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.862875  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.876566  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.883311  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.872797 10876 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.885041  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.885761  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.886231  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.887224  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.819581 11515 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.891836  8193 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:15.893461  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:15.893520  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.894975  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.895680  8266 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:15.896795  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.897567  8193 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.897950  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.898168  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.834347 11644 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:04:15.898533  8267 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:15.856680  8192 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:15.862622 11472 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:15.899097  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.845002 11583 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:15.902175  8121 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:15.903553  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:15.903949  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.899814  8271 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 4.
I20260709 13:04:15.906454  8199 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:15.905843  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.907104  8195 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:15.907840  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.907984  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.907132  8271 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:15.909178  8191 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.908432  8196 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 4.
I20260709 13:04:15.908578  8195 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:15.910319  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:15.910969  8266 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:15.911136  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.916313  8193 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:15.917148  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:15.921238  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.921873  8195 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:15.922621  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:15.922678  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.924861  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.926031  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:15.926370 11506 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:15.926681  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 587) took 1013 ms. Trace:
I20260709 13:04:15.927047  8194 rpcz_store.cc:276] 0709 13:04:14.913212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.910045 (+996833us) service_pool.cc:224] Handling call
0709 13:04:15.926631 (+ 16586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.927217  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.928956  8197 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:15.930136  8197 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:15.929944 11472 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:15.930655  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 581) took 1019 ms. Trace:
I20260709 13:04:15.930984  8197 rpcz_store.cc:276] 0709 13:04:14.910956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.929653 (+1018697us) service_pool.cc:224] Handling call
0709 13:04:15.929887 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.930461 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.930611 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.932466  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 584) took 1020 ms. Trace:
I20260709 13:04:15.934152 11591 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:15.928391  8194 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:15.936420  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 580) took 1025 ms. Trace:
I20260709 13:04:15.936791  8194 rpcz_store.cc:276] 0709 13:04:14.910728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.927849 (+1017121us) service_pool.cc:224] Handling call
0709 13:04:15.928123 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.936219 (+  8096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.936376 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.926553  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.962726  8196 raft_consensus.cc:2410] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:15.932770  8197 rpcz_store.cc:276] 0709 13:04:14.911650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.931766 (+1020116us) service_pool.cc:224] Handling call
0709 13:04:15.932019 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.932175 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.932202 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.932243 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:15.932270 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.932318 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.932415 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.966792  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:15.967788  8198 raft_consensus.cc:2410] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:15.968711  8191 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:15.628123  8270 rpcz_store.cc:276] 0709 13:04:14.625173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.949882 (+324709us) service_pool.cc:224] Handling call
0709 13:04:14.950093 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.950232 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:15.281672 (+331440us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.627462 (+345790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.627506 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:15.627545 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.627612 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.627703 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":678775,"thread_start_us":676660,"threads_started":2}
I20260709 13:04:15.970384  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 586) took 1058 ms. Trace:
I20260709 13:04:16.048871  8197 rpcz_store.cc:276] 0709 13:04:14.912071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.969648 (+1057577us) service_pool.cc:224] Handling call
0709 13:04:15.969933 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.970081 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.970104 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.970142 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:15.970170 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.970219 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.970320 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.050388  8197 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:16.050989  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 599) took 1061 ms. Trace:
I20260709 13:04:16.051287  8197 rpcz_store.cc:276] 0709 13:04:14.989730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.049795 (+1060065us) service_pool.cc:224] Handling call
0709 13:04:16.050068 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.050744 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.050936 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.970398  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 585) took 1058 ms. Trace:
I20260709 13:04:16.052196  8194 rpcz_store.cc:276] 0709 13:04:14.911857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.937474 (+1025617us) service_pool.cc:224] Handling call
0709 13:04:15.969988 (+ 32514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.970114 (+   126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.970133 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.970166 (+    33us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:15.970194 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.970257 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.970339 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43776}
W20260709 13:04:15.974898  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52338.8us
I20260709 13:04:15.985419  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 598) took 1058 ms. Trace:
I20260709 13:04:16.054545  8192 rpcz_store.cc:276] 0709 13:04:14.926878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.984523 (+1057645us) service_pool.cc:224] Handling call
0709 13:04:15.984884 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.985080 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.985105 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.985147 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:15.985177 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.985234 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.985340 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.056028  8192 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:16.054806  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:15.986501  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:15.976893 11591 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.974109 11471 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.030736 11402 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:16.057868  8163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.054s
W20260709 13:04:16.058581  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 72156.9us
I20260709 13:04:16.058018  8192 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:16.063033  8192 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:16.064905  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1695) took 1001 ms. Trace:
I20260709 13:04:16.065299  8192 rpcz_store.cc:276] 0709 13:04:15.063941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.062613 (+998672us) service_pool.cc:224] Handling call
0709 13:04:16.062872 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.064667 (+  1795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.064852 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.066449 11471 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.029604  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 595) took 1103 ms. Trace:
I20260709 13:04:16.067174  8117 raft_consensus.cc:2368] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:16.064512 11402 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.067353  8198 rpcz_store.cc:276] 0709 13:04:14.925787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.970745 (+1044958us) service_pool.cc:224] Handling call
0709 13:04:16.029069 (+ 58324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.029255 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.029279 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:16.029322 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:16.029370 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.029422 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.029542 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.067179  8192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
W20260709 13:04:16.069336  8163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.054s
W20260709 13:04:16.069758  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 542725us
I20260709 13:04:16.063082  8197 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:16.070852  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1680) took 1011 ms. Trace:
I20260709 13:04:16.071174  8197 rpcz_store.cc:276] 0709 13:04:15.059645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.051946 (+992301us) service_pool.cc:224] Handling call
0709 13:04:16.062788 (+ 10842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.070520 (+  7732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.070791 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.072503  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.073565  8811 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:16.073724  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.074800  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.069108  8192 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.076500  8192 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.053938 11639 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.075578  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:16.069031  8198 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:16.079401  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1711) took 1008 ms. Trace:
I20260709 13:04:16.075875 11471 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:16.080883  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:16.079787  8198 rpcz_store.cc:276] 0709 13:04:15.071066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.068422 (+997356us) service_pool.cc:224] Handling call
0709 13:04:16.068704 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.079136 (+ 10432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.079348 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.061368 11506 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:16.060254 11591 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:16.061558 11651 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:16.093194  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.080760 11471 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:16.074647 11571 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.044178 11413 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.074406 11290 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.063339 11645 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.076165 11596 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:16.074558 11515 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.076538 11584 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.077991 11650 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.101188  8192 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.119231 10876 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.085250 11506 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.120898 11506 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.096161 11591 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.115908  8199 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:16.096892 11471 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.103148 11630 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:16.119778  8192 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.069073 11586 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.101271 11651 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:16.132431 11651 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.142714 11586 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:16.143395  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.137483  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50494 (request call id 1706) took 1061 ms. Trace:
I20260709 13:04:16.144218  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:16.144743  8192 rpcz_store.cc:276] 0709 13:04:15.069495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.067065 (+997570us) service_pool.cc:224] Handling call
0709 13:04:16.131255 (+ 64190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:16.145406  8274 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:04:16.150395  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.122300 11290 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.175700 10876 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.126134 11471 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.190073  8274 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:16.126047 11630 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:16.191804  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:16.194813  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1701) took 1126 ms. Trace:
I20260709 13:04:16.195220  8191 rpcz_store.cc:276] 0709 13:04:15.068295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.750800 (+682505us) service_pool.cc:224] Handling call
0709 13:04:16.194642 (+443842us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54000299d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:16.194754 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181904256}
I20260709 13:04:16.183734 11290 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:16.199033  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.012s
W20260709 13:04:16.199674  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.006s	sys 0.012s
I20260709 13:04:16.147710 11454 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:16.204664  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.011s
W20260709 13:04:16.204990  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.011s
W20260709 13:04:16.205528  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 565047us
I20260709 13:04:16.206362  8774 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:16.208362  8238 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.019s
W20260709 13:04:16.208796  8238 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.000s	sys 0.019s
W20260709 13:04:16.209052  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 518838us
I20260709 13:04:16.198278 11586 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:16.200747 11290 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:16.204303  8007 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.011s
W20260709 13:04:16.212707  8007 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.011s
W20260709 13:04:16.213037  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 545166us
W20260709 13:04:16.204432  8088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.015s
I20260709 13:04:16.200242 11650 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:16.215126  8088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.004s	sys 0.015s
W20260709 13:04:16.216604  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.220357  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 948201us
I20260709 13:04:16.221266  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:16.222640  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:04:16.230734  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.215713  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:16.231494  8238 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50482 dropped due to backpressure: service queue is full with 50 items [suppressed 20 similar messages]
I20260709 13:04:16.243388  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.244817  8238 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.245185  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.252803 10876 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.253697 10876 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:16.254168 10876 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:16.210892 11396 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:16.258549  8091 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.262493  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.201403 11567 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.266765  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.268703  8804 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.242038 11596 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:16.244068 11515 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.242967 11586 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:16.224684 11644 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:04:16.253877 11434 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:16.310338  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.210867 11630 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.317541  8809 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:16.298450 11515 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:16.317355 11434 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.265545 11600 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:16.244135 11543 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:16.241778 11650 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.298151 11396 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:04:16.328177  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:16.288317  8804 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:16.324982 11515 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:16.337734  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 92994.6us
I20260709 13:04:16.309652 11645 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:04:16.344818  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 442947us
I20260709 13:04:16.325407 11630 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:16.334714  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.324766 11397 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:16.347448  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.354197  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.341109 11434 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.343374 11600 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.326119 11402 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:16.355844  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.356488  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.357163  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.357856  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.377046  8193 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.352473  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:16.382846 11586 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.395218 11543 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:16.395604 11543 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.395903 11543 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.397900 11659 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.398608 11659 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:16.399238 11659 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.371963 11454 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.372219 11430 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:16.401278 11430 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:16.401911 11430 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.405539 11584 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:16.406008 11584 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:16.407589 11639 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:16.407985 11639 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:16.410138 11567 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:16.414063 11423 consensus_meta.cc:287] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.001s
I20260709 13:04:16.414534 11423 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.373705 11472 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.416275 11472 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:16.416759 11472 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:16.425484  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 69059us
I20260709 13:04:16.355021  8191 raft_consensus.cc:2410] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:16.425797 11567 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:16.427945  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.429162  8238 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.372593 10876 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.444898  8116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:16.445554  8193 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:16.445674  8116 raft_consensus.cc:606] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:04:16.446110  8116 raft_consensus.cc:614] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:16.449854  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.457593 11245 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:16.458073 11245 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:16.458421 11245 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.452387 11402 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:16.459321 11402 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:16.459659 11402 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:16.461480 11474 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:16.461863 11474 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:16.462219 11474 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:16.427480 11567 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:16.468058 11567 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.466542 11584 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.470772 11584 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.473052  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.475113 11650 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.408825 11639 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.488945 11506 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.495230 11651 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:16.517318  8022 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.033s	sys 0.061s
I20260709 13:04:16.518422 10876 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:16.497630 11591 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.499778 11245 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.503331 11471 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.506402 11423 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:16.515503  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61429.9us
W20260709 13:04:16.518356  8022 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.033s	sys 0.061s
I20260709 13:04:16.496716 11472 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:16.527848  8165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.016s
W20260709 13:04:16.552353  8165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.000s	sys 0.017s
W20260709 13:04:16.553054  8268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.011s	sys 0.007s
W20260709 13:04:16.553484  8268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.011s	sys 0.007s
W20260709 13:04:16.569252 11548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.010s	sys 0.005s
I20260709 13:04:16.579322  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1717) took 1048 ms. Trace:
I20260709 13:04:16.579747  8197 rpcz_store.cc:276] 0709 13:04:15.530932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.071826 (+540894us) service_pool.cc:224] Handling call
0709 13:04:16.089010 (+ 17184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.089186 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:16.102526 (+ 13340us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.579030 (+476504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:16.579074 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:16.579111 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.579172 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.579274 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4372,"prepare.queue_time_us":13521,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":471768,"threads_started":1}
W20260709 13:04:16.576632  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 477845us
I20260709 13:04:16.577222  8270 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:16.488996 11290 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:16.621601  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 374745us
W20260709 13:04:16.616441 11582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.019s	sys 0.004s
I20260709 13:04:16.622573  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.634953  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.636034  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:16.631948 11582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.019s	sys 0.004s
I20260709 13:04:16.638080 11423 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:16.706337  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.765241 11658 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:04:16.707715  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.766746 11454 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:16.767741 11471 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.707602  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 579) took 1798 ms. Trace:
I20260709 13:04:16.768545  8195 rpcz_store.cc:276] 0709 13:04:14.909318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.927340 (+1018022us) service_pool.cc:224] Handling call
0709 13:04:15.927697 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.325191 (+397494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.325222 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.328074 (+  2852us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.706557 (+378483us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:16.706693 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.706861 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.706974 (+   113us) raft_consensus.cc:1685] finished
0709 13:04:16.707008 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.707333 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6441,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":719333,"threads_started":2,"wal-append.queue_time_us":320028}
I20260709 13:04:16.770047 11245 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:16.710158  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 451518us
I20260709 13:04:16.771493 11413 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:16.715636  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.773137 11413 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:16.773691 11413 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:16.717034  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1686) took 1655 ms. Trace:
I20260709 13:04:16.775591 11413 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.775871  8194 rpcz_store.cc:276] 0709 13:04:15.061055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.057310 (+996255us) service_pool.cc:224] Handling call
0709 13:04:16.059535 (+  2225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.059837 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.059874 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.060298 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.528303 (+468005us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:16.528353 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.528416 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.716384 (+187968us) raft_consensus.cc:1685] finished
0709 13:04:16.716431 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.716785 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":669,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8815,"thread_start_us":461686,"threads_started":1,"wal-append.queue_time_us":585091}
W20260709 13:04:16.718415  8071 auto_rebalancer.cc:893] Removing replace marker failed: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:16.778653  8071 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:04:16.707640  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.729983  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 124175us
W20260709 13:04:16.731030  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 183085us
W20260709 13:04:16.748270  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 112194us
I20260709 13:04:16.656850 11596 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:16.800410  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 582) took 1011 ms. Trace:
I20260709 13:04:16.803853 11571 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:16.757669 11586 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:16.805722 11397 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:16.803587  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.805943 11586 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:16.807729 11586 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.808441  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.758750 11686 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:16.645179 11474 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.809379  8197 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:16.810384 11472 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:16.811452  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.811753 11474 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.679410 11651 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.812840  8271 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:16.813160  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.815109  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.764341 11290 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:16.773741  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.816774  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.818310 11506 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.819809  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:16.781653  8071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:04:16.650187 11515 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.824298  8191 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:16.787470 11591 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:16.788905  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.789922  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.792692  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:16.793421  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:16.794167  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.795104  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.795941  8811 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 10. Ops: []
I20260709 13:04:16.797187  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.797540  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.798082  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.800652  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1942) took 1038 ms. Trace:
I20260709 13:04:16.641480 11660 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:16.802140  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.799741  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.811211 11582 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:16.833812  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.834383  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.834617 11660 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:16.833585  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:16.838461  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45301.7us
I20260709 13:04:16.839234  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.827944 11397 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:16.828433  8267 rpcz_store.cc:276] 0709 13:04:15.761814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.906933 (+145119us) service_pool.cc:224] Handling call
0709 13:04:15.907204 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.907524 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.907550 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.919979 (+ 12429us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.349913 (+429934us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:16.349949 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.350016 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.800071 (+450055us) raft_consensus.cc:1685] finished
0709 13:04:16.800114 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.800489 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":736,"raft.queue_time_us":572,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":24361,"thread_start_us":429648,"threads_started":1,"wal-append.queue_time_us":738115}
I20260709 13:04:16.840945 11397 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.841862 11600 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.844056  8191 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:16.845477  8802 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:16.847271  8194 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:16.825075 11515 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.844619 11600 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:16.851356  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.852679  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.853399  8806 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.845664 11582 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.858851  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.860013 11506 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:16.860437 11506 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:16.860571  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.860869 11506 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.804260  8265 rpcz_store.cc:276] 0709 13:04:15.789191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.081799 (+292608us) service_pool.cc:224] Handling call
0709 13:04:16.082105 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:16.082448 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.082471 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:16.082993 (+   522us) log.cc:844] Serialized 52 byte log entry
0709 13:04:16.581549 (+498556us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:16.795043 (+213494us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.799673 (+  4630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.799968 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.800038 (+    70us) raft_consensus.cc:1685] finished
0709 13:04:16.800056 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.800253 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6310,"prepare.queue_time_us":98656,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":3967,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":10438,"spinlock_wait_cycles":32000,"thread_start_us":659225,"threads_started":2,"wal-append.queue_time_us":562403}
I20260709 13:04:16.863312  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.863096 11660 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.864080  8195 raft_consensus.cc:2376] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8. Re-sending same reply.
I20260709 13:04:16.835207 11596 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.866811 11582 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.868093 11685 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:16.868808  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.871348  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.842618 11397 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:16.877545  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 525060us
I20260709 13:04:16.899842  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.882133  8193 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:16.885416  8200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2064) took 2163 ms (client timeout 2036 ms). Trace:
I20260709 13:04:16.885550  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.792583 11402 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.887557  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.888366  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.897336  8806 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
W20260709 13:04:16.888932  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 96482.7us
I20260709 13:04:16.889531 11515 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:16.890035  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.891676  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.841914 11639 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.878836 11630 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:16.900775  8200 rpcz_store.cc:269] 0709 13:04:14.722242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.722387 (+   145us) service_pool.cc:224] Handling call
0709 13:04:16.884921 (+2162534us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540035c0d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:16.885147 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3948180224}
I20260709 13:04:16.911655  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.911990  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:16.877753 11245 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.913821  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.914228  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.913741  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.916963  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:16.916901  8192 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.919209  8197 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:04:16.921509  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.922580 11430 consensus_meta.cc:287] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.015s
I20260709 13:04:16.922879  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:16.912333  8808 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:16.919149  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47981.9us
I20260709 13:04:16.908259 11413 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.898049 11677 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:16.867515 11543 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.929288 11658 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:16.930102 11434 consensus_meta.cc:287] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.010s
I20260709 13:04:16.934592  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.923039 11430 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.898362 11423 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:04:16.932716 11396 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:16.940336  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.946805 11543 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:16.946843  8803 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:16.949728  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.941919 11434 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.950855  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.955034 11245 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:16.955492 11245 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.955711 11454 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:16.955881 11245 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.956132 11454 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:16.956700 11567 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:16.957787  8166 leader_election.cc:336] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.848s (SENT)
I20260709 13:04:16.958353  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.958673 11600 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:16.959192 11600 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:16.959702 11689 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:04:16.960338 11600 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.962419  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:16.963480  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.964767  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.967105  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 596) took 2041 ms. Trace:
I20260709 13:04:16.936626 11506 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.967478  8196 rpcz_store.cc:276] 0709 13:04:14.926026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.971415 (+1045389us) service_pool.cc:224] Handling call
0709 13:04:16.100923 (+129508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.101102 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:16.592534 (+491432us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.849400 (+256866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:16.908646 (+ 59246us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:16.916594 (+  7948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.922043 (+  5449us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.966807 (+ 44764us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540021be50. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:16.966922 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4111,"prepare.queue_time_us":18937,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":6518,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":210,"spinlock_wait_cycles":249149312,"thread_start_us":650108,"threads_started":2,"wal-append.queue_time_us":255338}
I20260709 13:04:16.969766 11582 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:16.970168 11582 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:16.971149 11582 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:16.972321 11582 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.976293 11515 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.976775 11515 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:16.977176 11515 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:16.977552  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.978425 11402 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.979329 11685 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.979152 11677 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.970296 11434 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:16.981026 11584 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.983042 11506 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:16.983876  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:16.984601  8803 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:16.979166  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.955232  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:16.957254 11454 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:16.992645  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:16.993690  8194 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:16.994797  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:16.998772 11543 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:16.999235 11543 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.004822  8199 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:17.005839  8198 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:17.006521  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48798.3us
I20260709 13:04:17.008639 11677 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:17.018934  8192 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:17.022126  8197 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:17.024986  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.009024 11454 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:17.028100  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 95131.4us
I20260709 13:04:17.029475 11591 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:17.030776 11430 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.031422 11685 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.031734  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:17.033448  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 95482.4us
I20260709 13:04:17.041816  8193 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:04:17.037804  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.044299  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.045222 11692 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.045869 11677 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:17.046401 11677 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:17.047456 11677 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:17.049312  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70341.4us
W20260709 13:04:17.043138 11703 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:04:17.057029  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:17.060555  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.061969  8088 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.064855  8088 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:17.065845 11658 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.068878 11658 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:17.068964  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:17.069547 11658 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:17.040838 11600 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.070612  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:17.075838 11696 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:04:17.086362 11584 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:17.109620 11584 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.110065 11584 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.098526  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:17.111119  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 52396.9us
I20260709 13:04:17.111905  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.099025  8806 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:17.100595  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.101089  8804 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:17.112838  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.060247 11543 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.101751  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.101920 11658 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.102329  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.080572 11402 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:17.103353  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 138020us
I20260709 13:04:17.109975  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.113644  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.092381 11515 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.122390  8810 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10.
I20260709 13:04:17.124716 11454 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.125954  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.128168 11596 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:17.128574 11596 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:17.129194 11596 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.129675  8802 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:17.136248 11591 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:04:17.137147 11591 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:17.137540 11591 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:17.138516  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.138860 11591 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.140372 11591 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.142288  8120 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:17.134739 11685 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:17.129403  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.137857  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.136127  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.135903 11402 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.146996  8119 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.140307  8195 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:17.148871 11402 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.151661  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.152422  8195 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:17.152856  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.153795  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:17.155339  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.156569  8122 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.140265  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.158039  8117 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:17.146155  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:17.162081  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 111796us
I20260709 13:04:17.163787  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.164021 11685 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:17.164783 11506 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:17.167068  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.167277  8120 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:17.167604 11685 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.163807  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.173509  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.176533  8122 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
W20260709 13:04:17.177136  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.179281  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 43853us
I20260709 13:04:17.134531 11582 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:17.194700  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 81953.1us
I20260709 13:04:17.197667  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.199923 11582 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:17.199381  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.203419  8166 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.204167 11582 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.192428 11506 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.204982 11698 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:17.207276  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.209877  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.210510 11543 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.221060 11515 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:17.226459 11600 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.227085 11600 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.227856 11584 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:17.229867  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.230567 11396 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:17.231122 11396 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.232012 11396 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.211419 11245 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.199985  8198 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:17.233781  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70068.5us
I20260709 13:04:17.175140 11402 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:04:17.238200 11582 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:17.238598 11582 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.238907 11582 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.237231  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.239509  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.229694 11600 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:17.239432 11245 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:17.240613  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.243161 11698 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.243062  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.244858  8807 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:17.245692  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.246840  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.247767  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:17.248188  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.243157  8806 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:17.183499 11660 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:04:17.249090  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.252064  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.260923 11582 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.261597 11506 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:17.261992  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.262840  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.263415  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.261637  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.264210 11450 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.265661  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.266877  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.267608  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.270167  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.275174  8200 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:17.270586  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.273475  8199 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:17.274858  8269 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.278237 11434 raft_consensus.cc:2764] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:17.278237 11685 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.279126  8197 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:17.270239  8806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:04:17.278308  8271 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:17.279589  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.286089  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.287245  8194 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:17.268507 11402 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:17.280306  8806 raft_consensus.cc:606] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.291712  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.291148  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.295197  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.296866  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.297380  8267 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.297883  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:17.296501 11651 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.291195 11454 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.299965 11686 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:17.295002 11506 consensus_queue.cc:1059] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:04:17.296806 11712 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:04:17.311408 11686 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:17.315302  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.303226 11584 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.306393 11600 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:17.319605  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.320329  8268 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:04:17.321069  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.317780  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.324674  8265 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:17.295981 11596 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.325896 11600 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.329241  8195 raft_consensus.cc:2368] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:17.330456  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.331219  8266 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:17.333577 11630 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:17.334024 11630 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:17.334396 11630 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.335460  8122 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:17.335846  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.336695  8120 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.337724  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.337890  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.338608  8116 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.339439  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.339772  8271 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:17.312458 11686 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.340534  8117 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:17.340866  8117 pending_rounds.cc:85] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 5
I20260709 13:04:17.341080  8117 pending_rounds.cc:107] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:17.341334  8117 raft_consensus.cc:2889] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.342835  8121 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:17.344390  8803 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:17.345587  8269 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:17.346016 11471 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:17.346851 11471 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.355643 11471 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:17.356501 11471 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.347240  8806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:04:17.357751  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.357646  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.348006  8267 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:17.359620  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.360898 11685 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:17.361647 11685 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:17.362329  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.339725  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.298928 11450 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.364295  8805 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 5.
I20260709 13:04:17.366499 11450 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:17.362653 11685 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:17.353488  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63894.4us
I20260709 13:04:17.337725  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.355206 11586 raft_consensus.cc:993] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:04:17.358103  8806 raft_consensus.cc:606] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.358654  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.333482 11600 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.359081  8089 leader_election.cc:400] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:17.359299  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.349485 11651 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:17.376169  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.370837  8193 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:17.374577  8089 leader_election.cc:403] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:17.376974  8267 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:17.378985  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.376827  8273 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:17.379523  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.382644  8119 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.382544  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.357694 11471 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:17.385589  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.379797 11658 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:17.311070 11402 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.376374 11586 raft_consensus.cc:1081] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
W20260709 13:04:17.397101  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.402565 11651 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:17.418287 11582 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:17.445269 11714 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:04:17.431041 11651 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.430518 11584 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:04:17.470292  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.468333  8195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:04:17.473366  8195 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.473768  8195 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.474201  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.477677  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.491319  8117 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:17.484732  8195 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.491969 11698 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.513123  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.543136  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.545997  8195 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.493112 11663 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:04:17.549623  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 43762.9us
I20260709 13:04:17.507921 11596 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.546262  8124 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:17.557425  8199 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:17.560572  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.562983  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.563736  8267 raft_consensus.cc:2410] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:17.549047 11586 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:17.566479  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.554821 11663 consensus_queue.cc:1243] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:04:17.572767 11720 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:17.564857 11543 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:04:17.573639  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.593258  8269 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.552619 11630 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:17.574153 11724 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:04:17.595564 11630 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.601066  8269 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:17.604075 11660 consensus_queue.cc:1059] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:17.605268 11660 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:17.606325  8120 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 8. Ops: []
I20260709 13:04:17.576447 11402 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:17.563647 11713 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:04:17.606899 11698 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:17.607573  8116 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.607425 11698 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.577641  8265 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:17.579175 11586 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.608616  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:17.557619 11651 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.606191 11660 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:17.608002 11639 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:17.576314  8237 leader_election.cc:400] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10.
I20260709 13:04:17.609910 11586 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:17.606772 11709 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:04:17.626609  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 66356us
I20260709 13:04:17.626870  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.618948  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.630293  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.631016  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.607787 11684 raft_consensus.cc:3055] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.613891  8122 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:17.618867  8119 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:04:17.635089  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.612603  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52653.2us
I20260709 13:04:17.633845  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.622093  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.609423 11698 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:17.609450 11659 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.641639  8123 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.642705 11582 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.651885 11582 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.642905  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.655797 11659 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.643502  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.657963  8119 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.644090  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:17.626118 11639 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.646095  8125 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:17.645614  8116 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.633635 11684 raft_consensus.cc:740] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.610831 11687 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.644693  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:17.665432  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 89287.3us
I20260709 13:04:17.665122  8805 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:17.667730  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:17.673046 11639 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.674273 11639 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.675729 11586 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.675253 11684 consensus_queue.cc:260] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.676093 11586 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.679764  8805 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:17.681083 11596 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:17.681640  8116 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:17.692546  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.693238  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.693696  8265 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.692597  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.647828 11600 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:17.695675  8271 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.697475  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.698452  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.698599  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.698907  8266 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:17.699219  8268 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:17.699936  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.700577  8125 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:17.701697 11582 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:17.701865  8269 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.673065 11732 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:04:17.706260  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.677018 11586 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.709551 11586 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.699992 11730 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.707597 11732 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:17.713102 11730 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.714109  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.714844  8268 raft_consensus.cc:2368] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:04:17.713690 11732 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.707818 11684 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.718248 11454 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:17.718629 11454 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:17.719575 11454 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.717759  8270 raft_consensus.cc:1240] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:17.720520  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.720943 11454 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.723431  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.724779  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.725455 11692 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.731040  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.732209  8270 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:17.733841  8193 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:17.737058  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.719599 11396 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:17.738032  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.737857 11396 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.718621 11730 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.735585  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:17.746918  8265 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:17.759665  8265 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:17.768097  8269 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:17.769840  8116 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.740145 11698 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:17.779173  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54467.5us
I20260709 13:04:17.785307  8271 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:17.787983  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.788810  8193 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:04:17.786772  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.770952 11402 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:17.798302  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 63613.2us
I20260709 13:04:17.797173  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.805671  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:17.810228  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47748.2us
I20260709 13:04:17.796892 11402 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:17.813311  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.816095  8193 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:17.817291  8123 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:17.819664  8120 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:17.816886  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:17.813598 11245 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:17.809927 11396 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:17.831624  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.817073 11402 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.837365  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.800227 11698 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.845631  8123 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:17.833516 11600 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:17.833853 11245 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:17.858680  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:17.859397 11737 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:04:17.861742 11659 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:17.862851 11738 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:17.863835 11698 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:17.830631 11471 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:04:17.867080  8125 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.869522  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.871178  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.874362  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.874861  8121 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:17.874056  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:17.876227  8809 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:17.877466  8193 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:04:17.878382  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.870244 11245 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.879724  8123 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:17.881505  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:17.886072  8122 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:17.886337 11741 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:04:17.886778  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.887478  8122 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:17.887599 11736 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:17.881984  8271 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:04:17.882429  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:17.877828  8193 pending_rounds.cc:85] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 6
I20260709 13:04:17.888147  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.969709  8271 pending_rounds.cc:85] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 9
I20260709 13:04:17.970715  8116 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:17.971254  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:17.972333 11423 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:17.972738 11423 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:17.970680  8271 pending_rounds.cc:107] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:04:17.973937  8271 raft_consensus.cc:2889] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.973557 11423 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:17.977200  8805 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:17.975544  8193 pending_rounds.cc:107] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:04:17.975840  8125 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:17.914862  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:17.976909  8803 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:17.935833  8269 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:17.978024  8193 raft_consensus.cc:2889] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.978336  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:17.977567  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 128294us
I20260709 13:04:17.985595  8117 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.987365  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:17.987852  8191 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.873919 11600 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:18.015061  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:18.016111  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 109876us
I20260709 13:04:18.016459  8121 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:17.914448 11639 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:04:18.037595  8191 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:17.987036 11684 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:04:17.979501 11402 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.045176  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.037045 11423 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.051587  8120 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:18.061944  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:18.065759  8271 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:18.065984  8265 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.066320  8265 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:18.070216  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.072467  8124 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:18.079068  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.073076  8265 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.083269  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.084975  8271 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:18.085059  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.085904  8267 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:04:18.087075  8265 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:18.089705  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:18.090888  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.095618  8267 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:18.097496  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:18.098359  8274 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:18.099157  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:18.083333 11600 raft_consensus.cc:2764] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:04:18.102171  8124 pending_rounds.cc:85] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 9
I20260709 13:04:18.102430  8124 pending_rounds.cc:107] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:04:18.102633  8124 raft_consensus.cc:2889] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:18.102867  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:18.106077  8271 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:18.108170  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.109100  8266 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:18.117424 11582 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:18.113334 11744 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:04:18.112473  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.116338 11430 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:18.111090  8117 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:18.115670 11434 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:18.116685  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.119879  8121 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:18.128363  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.135098  8265 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:18.136298  8116 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:18.127540 11582 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:18.128021 11736 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:18.085744 11748 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:04:18.143792  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 68987.3us
I20260709 13:04:18.151017  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:18.158006  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 115880us
I20260709 13:04:18.096778 11689 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:04:18.160017  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:18.156911 11430 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.159919 11752 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:04:18.142683 11746 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:04:18.152554 11454 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.142676 11582 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:18.169520  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.134258 11751 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:04:18.157106 11731 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:18.168869  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 120922us
I20260709 13:04:18.160954  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.162557  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:18.160126 11743 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:18.189960  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77571us
I20260709 13:04:18.164844 11730 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:18.192560  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.195583  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.182039 11732 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:18.209929 11732 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.210350 11732 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.193897 11730 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.214161 11730 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:18.183782 11731 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:18.218101 11731 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.219084 11731 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:18.219960  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.221482 11689 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:18.221969 11689 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:18.222851 11689 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.170053 11430 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.225975 11430 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:18.227371  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:18.203253  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.230073  8123 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:18.225901 11396 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.230914 11396 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.232858 11396 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:18.196971  8163 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.235631  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:18.236764  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:18.237504 11663 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:18.237880 11663 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.238204 11663 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.201771 11582 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.197645 11746 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.206934 11402 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:18.187201 11733 raft_consensus.cc:2764] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:18.207768 11755 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:18.208520 11245 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.197371  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:18.246517  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51018.6us
I20260709 13:04:18.249634  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:18.251466 11755 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:18.261117  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.267015  8193 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:18.267184  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:18.267867  8197 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:18.269477  8091 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.270123  8199 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:18.248224 11698 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:18.250916 11430 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.247833 11434 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.272737  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:18.289050  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 92751.6us
I20260709 13:04:18.271379 11402 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:18.307238  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.274200 11471 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.309520  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:18.313928  8274 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:18.286504 11596 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.316082  8270 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.273424 11454 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:04:18.323328 11725 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:18.323940 11725 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:18.324939 11725 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.325587 11245 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:18.326427 11745 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.326829 11745 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:18.323880  8237 leader_election.cc:400] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:18.331504  8237 leader_election.cc:403] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:18.274117 11685 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:04:18.336036  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.336647  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:18.310938 11740 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.311465 11402 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:18.351205  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:18.355557  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48405.2us
I20260709 13:04:18.356506  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.362306  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:18.364305  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.349572 11402 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.346906 11692 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8.
I20260709 13:04:18.353816 11733 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:18.349340 11687 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:04:18.349640 11740 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.368171 11698 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:18.378561 11757 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:04:18.378165 11596 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:18.378862 11677 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.378285 11760 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:04:18.386492 11732 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.400251 11745 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.401578  8192 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:18.402045  8193 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:18.403234  8270 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:18.404647  8271 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:18.405117  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:18.377744  8091 leader_election.cc:400] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:04:18.405709  8803 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:18.369410 11761 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:18.406673 11761 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.390807  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:18.405998  8091 leader_election.cc:403] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:18.407538  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.407898  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:18.407050 11761 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:18.409019 11758 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:18.409663 11760 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:18.410722 11692 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:18.411072 11692 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:18.413076  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.386711 11733 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:18.411859 11692 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.426054 11698 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:18.426601 11698 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:18.417949 11659 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7.
I20260709 13:04:18.427410 11698 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.428279 11454 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:18.428633 11454 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:18.429390 11454 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.429878 11761 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.430491 11454 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.403007 11732 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:18.436815  8166 leader_election.cc:336] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.547s (SENT)
W20260709 13:04:18.437651  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.440817  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.442011 11767 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.440442 11760 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.445993 11685 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:18.437099 11582 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.410722 11736 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:18.451967 11736 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:18.452860 11736 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.454066 11736 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.446375 11685 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:18.456205  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.353204 11755 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.436228 11761 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:18.456421  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.466645  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.466203  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.429418 11766 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:18.467582  8091 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.416939 11396 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:04:18.475740  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:18.478437  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.465330 11745 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:18.470387 11596 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:18.485572  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.447057 11730 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.475512 11600 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:18.488773 11397 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:18.477102 11766 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:18.495162  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.483418  8071 placement_policy_util.cc:248] tablet ccbf67588374458ebbd07bc5aeeb3b5a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:04:18.478451 11725 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.484575 11692 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.494012 11397 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:18.518850 11397 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.519702  8199 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:18.525760  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.526491  8124 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:18.521914 11760 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.529210  8807 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:18.520684 11733 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.485054 11687 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:04:18.498776 11600 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.525262 11413 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:18.556362 11397 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.557512  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:18.520118 11596 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:18.559823  8806 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:18.567255  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:18.572845  8125 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:18.570827  8166 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.678s (SENT)
I20260709 13:04:18.573400  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.580726  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:18.576675  8237 connection.cc:256] RPC call timeout handler was delayed by -1.3350677039999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 13:04:18.582366  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1397677040000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:04:18.583295  8237 connection.cc:256] RPC call timeout handler was delayed by -1.0254677039999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 13:04:18.529492 11772 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:04:18.586552 11397 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:18.588848 11430 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.584290 11659 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.591266 11659 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.593191  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:18.595050  8124 raft_consensus.cc:2410] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:18.596036  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.598953  8120 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:18.505468 11663 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.597119  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:18.645757  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 162527us
W20260709 13:04:18.646513  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 50411us
I20260709 13:04:18.645849  8123 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:18.650322  8119 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:18.544072 11725 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:04:18.658928  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.593326 11659 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:18.604316 11767 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.520666 11685 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.665218  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.651262 11770 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.652272 11766 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.689424 11685 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.684069  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:18.704030  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 44127.2us
I20260709 13:04:18.677614 11732 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:18.680953  8019 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:18.710753  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 56256.1us
I20260709 13:04:18.690418 11659 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:04:18.712808  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 60824.8us
I20260709 13:04:18.700282 11772 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.679351 11760 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:04:18.717780 11760 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.718132 11760 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:18.718528 11774 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:18.718941 11760 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.720228 11760 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:18.721825 11775 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:18.731611  8237 leader_election.cc:400] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10.
I20260709 13:04:18.732605  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.712651 11413 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.743328 11754 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.744656 11663 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:18.699146 11770 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.756213 11770 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:18.763661  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:18.764667  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85894.3us
I20260709 13:04:18.770756  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.774160  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.777410  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:18.778764  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:18.781503 11677 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:18.782410 11772 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:18.784296 11781 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:04:18.784562 11772 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:18.785382 11780 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.785910 11780 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.786332 11725 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.779610 11402 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.786860 11725 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.800318  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.762825 11730 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:18.770219 11740 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:18.806607  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.808809  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:18.801456 11582 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:18.810427  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.810786  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.813212  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 101166us
I20260709 13:04:18.797886 11245 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:18.795274 11596 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:18.823220  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.823683  8120 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:18.824568  8272 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:18.811928 11754 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:18.828142  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.829528  8117 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:18.811391 11755 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:18.834453  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.837168  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.838505  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.838605 11755 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.839129  8117 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:18.839370 11776 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:04:18.838491  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.839987  8166 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:18.842979  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:18.844422 11730 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:18.846267 11730 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:18.846828 11730 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.846040  8120 raft_consensus.cc:2955] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:18.846246  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.853642 11760 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:18.857924  8199 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:18.859313  8195 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:18.846459 11396 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:04:18.857160  8191 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:04:18.861799  8191 pending_rounds.cc:85] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 6
I20260709 13:04:18.862057  8191 pending_rounds.cc:107] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:04:18.824620 11663 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:18.862298  8191 raft_consensus.cc:2889] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:18.857956  8163 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.678s (SENT)
I20260709 13:04:18.819511 11780 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:18.846417  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.868767  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.870515  8119 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:18.869069  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.873366  8123 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:18.838454 11740 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:04:18.853292 11782 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:18.881659 11777 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.882198 11777 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.884151 11777 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:18.887779  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:18.891469  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:18.866019 11766 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.900731  8119 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:18.901980  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:18.870661 11402 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:18.836298 11245 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:04:18.906981  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49056.1us
I20260709 13:04:18.908001  8118 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:18.902554 11454 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:18.910105 11454 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:18.910882 11454 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.911644 11582 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.911939 11454 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.885965 11692 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:18.913409 11692 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:18.913765 11692 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:18.914554 11692 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:18.915736 11692 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:18.918638  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.898313 11782 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:04:18.922773 11732 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.923110  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:18.922793  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:18.923770  8806 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:18.924216  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:18.928555  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:18.923816  8803 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:18.939692  8197 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:04:18.941784  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.950378  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:18.950553  8266 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:18.903793 11755 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:18.886444 11600 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:04:18.951026  8197 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:18.961113  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:18.962754  8192 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.959765  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:18.964919  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 86369.2us
I20260709 13:04:18.960366  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.974028  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:18.940665 11732 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:18.983850  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:18.984557  8266 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:18.984647  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:18.985484  8265 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 5: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:18.985862  8267 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:18.966810 11471 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:18.987462  8265 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:18.987809  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.991211  8266 raft_consensus.cc:2393] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 6: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:18.969254 11767 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:18.998030  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.998101  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:18.974829 11745 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:19.000011  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet d6579e4214554536b3727b869a8aedfa: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:19.001838  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:19.002719  8274 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:19.003183  8273 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:19.004889  8192 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:18.969295 11751 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:04:19.012784  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:19.039510  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:18.986425 11600 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.987872 11793 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.048949  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:18.988337 11733 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.969241 11788 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:19.044687  8166 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.045921  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.057528  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:18.988530 11471 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:18.974875 11567 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:04:19.042557 11745 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.054272  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.054013  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:18.988080 11780 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:19.045212  8271 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:19.086097  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44155.1us
I20260709 13:04:19.053134  8019 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 3 to 4, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 4 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:19.041401 11663 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.003464 11725 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.088057  8019 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 3 to 5, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 5 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:19.067325 11471 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.092659 11770 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.069278  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:19.075081  8192 pending_rounds.cc:85] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 3
I20260709 13:04:19.093196 11770 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.093853  8192 pending_rounds.cc:107] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:04:19.094175  8192 raft_consensus.cc:2889] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:19.076320  8266 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:19.070813 11754 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:04:19.096161  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:19.097599  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.096751  8266 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:19.098161  8191 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:19.068629  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:19.095291 11770 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:19.099826  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 114771us
I20260709 13:04:19.066299 11434 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.101516  8271 raft_consensus.cc:2410] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:19.046527 11731 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:04:19.100720  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.092844  8019 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:19.102948  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:19.041703 11767 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.081754 11745 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.103892  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:19.123389  8119 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:19.106976  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:19.112839  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.113634  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:19.116017  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.116524  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:19.126245  8805 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:19.066145 11423 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:04:19.119158  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:19.131107  8125 raft_consensus.cc:2368] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:19.120244  8122 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:19.131500  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.122120  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:19.132588  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.132761  8117 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:19.088024 11567 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:19.099304 11663 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.124365  8271 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:19.129232  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.116219  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:19.056852 11793 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.134536  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.135252 11789 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.060940 11733 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:19.115458 11787 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:04:19.147248  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.147644  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.148181  8122 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.133126  8119 raft_consensus.cc:2376] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10. Re-sending same reply.
I20260709 13:04:19.114895 11582 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:19.125252 11770 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:19.151010  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:19.146404  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:19.227167  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 81475.2us
I20260709 13:04:19.096504 11471 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:19.231356  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 82749.5us
W20260709 13:04:19.231976  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 97508.1us
I20260709 13:04:19.232992  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:19.122876 11754 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:19.228524  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:19.229506  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 83214.5us
I20260709 13:04:19.135948 11567 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:19.257740  8191 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:04:19.230111  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 123206us
I20260709 13:04:19.259609  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:19.145216 11685 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:19.268478  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:19.230775 11731 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:19.230793 11760 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:19.152943 11742 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:19.234637 11748 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:19.234468 11413 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:19.227881 11770 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.284998  8122 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:19.263672 11725 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:19.264564 11685 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:19.288329 11770 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.297308  8022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 167) took 10995 ms. Trace:
I20260709 13:04:19.286900 11783 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.279042 11596 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.270985 11245 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.311697 11567 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.320015  8273 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:19.326274  8271 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:19.335866  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.346728  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 87229us
I20260709 13:04:19.347576  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:19.348311 11677 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:19.274999 11754 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:19.362190  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:19.363287  8265 raft_consensus.cc:2376] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10. Re-sending same reply.
W20260709 13:04:19.362973  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 320836us
I20260709 13:04:19.339371  8019 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 5 to 7, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:19.326635 11794 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:04:19.354979 11795 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:04:19.393282  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 122235us
I20260709 13:04:19.389902  8019 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:19.422693  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.390770  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:19.428411  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60452.5us
W20260709 13:04:19.368125 11796 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:04:19.439868  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 75014us
I20260709 13:04:19.363936 11396 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:19.342451 11732 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.287678 11742 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.354374 11782 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:19.328074 11746 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:04:19.362857 11783 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.367453 11245 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:19.482092 11791 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.510s	user 0.004s	sys 0.000s
I20260709 13:04:19.483011 11245 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:19.483189 11792 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:04:19.472754 11582 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:19.432796 11748 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.343137 11800 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:04:19.363570 11596 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.514130  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.475996 11567 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.518433 11823 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:19.518779 11801 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:04:19.518940 11454 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
W20260709 13:04:19.519763 11802 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:19.476553 11677 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:04:19.522822 11811 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.320799  8022 rpcz_store.cc:276] 0709 13:04:08.272349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.272800 (+   451us) service_pool.cc:224] Handling call
0709 13:04:19.259283 (+10986483us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:16.670948 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:16.671508 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:16.671539 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:04:16.671566 (+    27us) tablet.cc:662] Decoding operations
0709 13:04:16.672746 (+  1180us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:16.672801 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:16.672830 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:16.673716 (+   886us) tablet.cc:701] Row locks acquired
0709 13:04:16.673726 (+    10us) write_op.cc:260] PREPARE: finished
0709 13:04:16.673829 (+   103us) write_op.cc:270] Start()
0709 13:04:16.673903 (+    74us) write_op.cc:276] Timestamp: P: 1783602256673796 usec, L: 0
0709 13:04:16.673916 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 13:04:16.768049 (+ 94133us) log.cc:844] Serialized 4776 byte log entry
0709 13:04:16.965943 (+197894us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18002f6bc0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b522 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:17.183198 (+217255us) op_driver.cc:464] REPLICATION: finished
0709 13:04:17.330313 (+147115us) write_op.cc:301] APPLY: starting
0709 13:04:17.382279 (+ 51966us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:17.455338 (+ 73059us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:17.457338 (+  2000us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:17.577338 (+120000us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:17.577749 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:04:17.577797 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:17.578243 (+   446us) log.cc:844] Serialized 89 byte log entry
0709 13:04:17.578449 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:17.578618 (+   169us) write_op.cc:454] Released schema lock
0709 13:04:17.578679 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:17.579158 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:17.579185 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":3417,"mutex_wait_us":1025607,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":114210,"apply.run_cpu_time_us":5650,"apply.run_wall_time_us":265284,"num_ops":12,"prepare.queue_time_us":796750,"prepare.run_cpu_time_us":8871,"prepare.run_wall_time_us":168170,"raft.queue_time_us":127910,"raft.run_cpu_time_us":16561,"raft.run_wall_time_us":192687,"replication_time_us":456545,"spinlock_wait_cycles":2831616,"thread_start_us":834949,"threads_started":4,"wal-append.queue_time_us":146347,"wal-append.run_cpu_time_us":11905,"wal-append.run_wall_time_us":1678136}]]}
W20260709 13:04:19.548400  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 97995.3us
I20260709 13:04:19.541323 11731 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:19.576388 11733 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.490746 11782 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.512763 11582 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:19.588017 11730 consensus_meta.cc:287] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.000s
I20260709 13:04:19.517645 11748 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:19.598294  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 338691us
I20260709 13:04:19.585389 11788 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:19.606760 11808 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:04:19.678822  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 115837us
I20260709 13:04:19.596992 11800 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.575795 11811 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.689390 11793 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.601038 11730 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.700415 11430 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:19.679735  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63756.4us
I20260709 13:04:19.694103 11731 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.738394  8198 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:19.741302 11745 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.002s
I20260709 13:04:19.741721 11745 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.744201 11745 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.744777 11245 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.745260 11245 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:19.732966 11434 consensus_meta.cc:287] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.008s
I20260709 13:04:19.775924  8192 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:19.733969 11822 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.775321 11434 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:19.752269 11748 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.732868 11810 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.753698 11811 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:19.753850 11685 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.731360 11430 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:19.755529 11740 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:19.755931 11245 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.756335  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:19.733506 11800 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.748822  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.780104 11832 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:04:19.792963 11830 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:04:19.795218 11471 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.727941 11819 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:19.774545 11692 consensus_meta.cc:287] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.004s
I20260709 13:04:19.809894 11677 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:19.818389  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19747a1b37df480faebc96d93689cda5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:19.796535 11770 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.832024 11810 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.854354 11770 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.832162  8267 raft_consensus.cc:2376] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7. Re-sending same reply.
I20260709 13:04:19.741314 11663 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.832784  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.856462  8191 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:19.839198  8266 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:19.856953 11810 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.844085  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:19.846583  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 97835.7us
I20260709 13:04:19.843889  8192 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:19.859261  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.861672  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.861773  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:19.859221  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:19.861701  8193 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:19.862833  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:19.868202  8269 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:19.874861  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.875788  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.876514  8195 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:19.877362  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.877951  8200 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:19.879413 11782 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:19.881595 11755 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:19.882009 11755 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:19.883123 11755 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.950171 11755 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.886416  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:19.887118  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:19.887503  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:19.950937  8803 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:19.951063  8804 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.952503  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:19.888690 11767 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.953537 11471 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:19.953899 11471 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.954196 11471 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.889626 11817 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:19.890257  8163 leader_election.cc:400] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:19.955983  8163 leader_election.cc:403] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:19.956688  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 66562.7us
I20260709 13:04:19.890640 11824 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:19.957556 11824 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.957948 11824 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:19.890790 11827 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:04:19.891388 11800 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.891248 11812 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:19.963771 11812 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:19.964165 11812 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:19.892016 11834 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:19.892416 11746 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.944231 11777 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:19.965708 11746 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.966025 11777 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.968000 11746 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.967051 11471 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:19.893481 11816 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
W20260709 13:04:19.969393 11789 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.819s	user 0.005s	sys 0.005s
I20260709 13:04:19.899408 11742 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:19.895569 11730 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:19.900401 11837 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:19.968027 11777 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.970698 11837 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.972855 11837 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:19.849387 11819 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:19.973767 11819 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.974725 11819 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.970471  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:19.912098 11811 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:19.977448  8804 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:19.978969  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:19.913686 11430 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.914798 11807 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:19.977612 11811 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.979698 11777 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:19.980149 11807 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:19.980284 11777 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:19.980559 11807 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:19.981328 11807 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.845511 11434 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:19.850709 11685 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:19.920388  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 55917afdf34f4dd3985df6ff71c4d019: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:19.981379 11777 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.921103 11760 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:19.916508 11805 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:04:19.985559 11760 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.923041  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.987772  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 1973) took 1004 ms. Trace:
I20260709 13:04:19.921689  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.924510  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:19.988905  8193 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.988119  8272 rpcz_store.cc:276] 0709 13:04:18.983783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.983890 (+   107us) service_pool.cc:224] Handling call
0709 13:04:19.006160 (+ 22270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:19.045546 (+ 39386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:19.045586 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:19.062686 (+ 17100us) log.cc:844] Serialized 26 byte log entry
0709 13:04:19.151156 (+ 88470us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:19.151196 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.151262 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:19.987600 (+836338us) raft_consensus.cc:1685] finished
0709 13:04:19.987618 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.987721 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2779,"raft.queue_time_us":6850,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":8136,"thread_start_us":34546,"threads_started":1,"wal-append.queue_time_us":701160}
I20260709 13:04:19.923862  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.989930  8192 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:19.927292 11396 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:19.990710 11396 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.927455 11788 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.928045 11831 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:19.925477  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.993785  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.993667 11831 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.994525  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:19.927337  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.929744  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.997664 11776 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:19.998257 11776 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:19.930425  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:19.826748 11413 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:04:19.805981 11822 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:19.830654 11740 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:19.944113  8119 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:19.944350  8124 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:04:19.782756 11783 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:19.888131  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:19.887006  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:20.038228  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.038712  8807 raft_consensus.cc:2410] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:19.894908  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:19.961225  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 102095us
I20260709 13:04:19.961690 11810 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:19.962803  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:19.964996 11812 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.969815 11789 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:20.055732  8273 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:19.875794 11748 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.981386 11811 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:19.916638 11596 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:19.929872 11766 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.020s	user 0.013s	sys 0.002s
I20260709 13:04:20.001389  8194 raft_consensus.cc:2410] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:19.982358  8803 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:20.005086  8193 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:20.057616 11766 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:20.058236  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 97870.7us
I20260709 13:04:20.058553  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.059309  8193 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:20.014885  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.061440 11730 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:20.016569  8124 pending_rounds.cc:85] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 4
I20260709 13:04:20.062218  8124 pending_rounds.cc:107] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:04:20.062507  8124 raft_consensus.cc:2889] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:20.063431 11797 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.063895 11797 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:19.999512 11659 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:20.065510 11659 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:20.066298 11659 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.067536 11659 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.993170 11788 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.069329 11788 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.056929 11748 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.070920 11740 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.071905 11740 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.071980 11748 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.073849 11742 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:20.074404 11742 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.077167  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:19.975943 11824 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:20.041880  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 147049us
I20260709 13:04:20.044130  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.040884  8199 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:20.038451  8809 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:04:20.051613  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 55836us
I20260709 13:04:20.050624 11810 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.054247 11812 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.058367  8196 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:20.007812  8268 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:20.085058  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:20.096702  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.101261  8195 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:20.097795  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.103035  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.105801  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:20.114652  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.062052 11730 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:20.117002  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:20.122730  8198 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:20.122897  8091 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:20.111382 11811 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.146036 11811 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.146411 11811 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.146787 11824 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.146466 11600 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.147914 11600 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.149974  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1769) took 1227 ms. Trace:
I20260709 13:04:20.150645 11600 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.152362 11725 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:20.152853  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.153522  8270 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:20.154384  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:20.066321 11797 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.127388 11454 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:20.127285 11760 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.128471  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:20.156791  8273 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.157449 11733 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.158007 11760 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.099846 11810 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.159862  8267 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:20.132812  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.115219 11770 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:20.135581  8088 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.115967 11767 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:20.138546  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:20.139334 11838 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:04:20.101019 11807 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.119587 11788 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.141582 11730 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.142190  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.141626  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.175568 11810 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.175983 11793 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:20.143492  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 1989) took 1143 ms. Trace:
I20260709 13:04:20.154793 11822 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.118436 11789 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:20.060986 11396 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.184031  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.184712  8116 raft_consensus.cc:2393] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:20.121306  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.150313  8196 rpcz_store.cc:276] 0709 13:04:18.922361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.924667 (+  2306us) service_pool.cc:224] Handling call
0709 13:04:18.924909 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:20.112323 (+1187414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.149754 (+ 37431us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001ae5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:20.149899 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606468352}
I20260709 13:04:20.165783  8273 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:20.166322  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:20.166565  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.167541  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.112035 11837 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.170574 11471 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.187929 11783 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.170735  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.163028 11770 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:20.168043 11454 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.168098 11767 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:20.171885 11430 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.167958 11760 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.176774  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.180830  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.177047  8268 rpcz_store.cc:276] 0709 13:04:19.000091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.042833 (+ 42742us) service_pool.cc:224] Handling call
0709 13:04:20.143322 (+1100489us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54003b88d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:20.143410 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937546496}
I20260709 13:04:20.182292  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:20.183112  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77415.3us
I20260709 13:04:20.186147  8117 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.186610  8123 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
W20260709 13:04:20.186960  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65727.6us
I20260709 13:04:20.187577 11746 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:20.188014 11837 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.188571  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:20.189286  8272 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:20.125327 11766 raft_consensus.cc:2764] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:04:20.176394 11793 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.230355  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.230947  8195 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:20.198392  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.178917  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.170137 11797 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.206082  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.206979  8274 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:20.211767  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.212755  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.197430 11582 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:20.181561 11596 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:20.215142  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.239550  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.240139  8265 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 5.
I20260709 13:04:20.186784 11824 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:20.216338  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.242656  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.243147 11596 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.189088 11783 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.214239 11746 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.245329 11596 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.251909  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.245620  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:20.245820 11746 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.215811 11760 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.259449 11760 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.216069 11834 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:04:20.262640 11810 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.264007  8811 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:20.248792  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.218932  8809 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.183804 11800 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:20.223498  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.249996  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.193645 11454 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.223995  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.270632  8267 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:20.226768  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.265491  8199 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:20.271551  8123 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:20.189616 11789 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.203696 11767 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.233647  8266 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:20.232024  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.213529  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.236951  8117 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:20.240825  8806 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:20.246490  8272 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:20.193997 11770 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.268321  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.287328  8195 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:20.268782  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.269130  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.196851  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.266744  8196 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:20.272841 11454 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.289635  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.236197 11793 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.283155 11596 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.284240  8808 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:20.311180  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.312508  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:20.240384 11742 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.309862  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:20.310983  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.316556  8196 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.304028  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.247102 11783 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.315448  8808 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:20.311759  8810 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:20.321035  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:20.321585  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 108126us
I20260709 13:04:20.322707  8806 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 5.
I20260709 13:04:20.322381  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.323984  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.300742 11582 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:20.294486 11659 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:20.241709 11797 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.313264 11788 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.332607  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.339098  8272 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:20.344679  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:20.318481 11831 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.326998 11754 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:20.284468 11800 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.330103 11783 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:20.337883 11396 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.317616 11596 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.347644 11760 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:20.367913  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:20.384533  8166 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:20.351334 11843 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:20.389240  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:20.372740  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.373024  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:20.374300  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.343724 11788 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.392242  8122 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:20.398307  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:20.398764  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.399022  8122 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:20.413774  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:20.413925  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.414530  8267 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:20.414361  8774 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.364519 11783 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.338094 11659 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.431140  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.439450  8265 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:20.436065  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.414865  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.437669  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.415948 11788 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.414853 11402 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:20.446504 11801 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:20.370030 11818 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:04:20.452718  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.453986 11748 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.458738  8809 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:20.460026  8191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.028s	sys 0.020s
W20260709 13:04:20.491776  8191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.029s	sys 0.020s
I20260709 13:04:20.418919 11754 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.400168 11824 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:20.413556 11733 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:20.437669 11783 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:20.441233 11396 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.383397 11841 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:04:20.451000  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:20.526163  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 75227us
W20260709 13:04:20.530652  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 201038us
I20260709 13:04:20.493628 11817 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:20.458945 11659 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.493541 11748 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:20.501775 11754 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.527688 11751 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:20.486119 11402 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.522648 11733 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:20.527750 11725 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:20.447129 11582 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.393971  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.555787 11837 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.539775 11754 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.537571 11812 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:04:20.561910 11846 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:04:20.565840  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 171950us
I20260709 13:04:20.537952 11748 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:20.562840 11840 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 13:04:20.586874  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.589413  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:20.590479  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:20.592566  8271 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:20.574956 11845 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:04:20.567260 11789 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.568950 11600 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.634744  8809 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:20.638378  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:20.639210  8273 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:20.648186  8196 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:20.649262 11596 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.628002 11797 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.575285 11725 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.662662 11812 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:20.672026 11770 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.673689  8121 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:20.680711 11770 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.687753 11454 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.690590 11454 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.691406 11733 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:20.696702 11848 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:04:20.697970 11818 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:20.699096  8120 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:20.699967 11847 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 13:04:20.703429 11730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.028s	sys 0.051s
W20260709 13:04:20.717592 11730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.028s	sys 0.051s
I20260709 13:04:20.720983  8123 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:20.636703 11600 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:20.731290 11807 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 13:04:20.723919 11800 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:20.769964 11813 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:20.725917 11600 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.793767  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.772965 11818 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.717070 11746 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:20.822161  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19747a1b37df480faebc96d93689cda5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:20.823945  8807 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:20.837139  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.838446  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:20.806286 11818 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:20.843035  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 213741us
I20260709 13:04:20.844316 11423 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:20.828454 11863 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:20.831842 11402 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.854619 11423 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:20.824360 11788 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.862479 11751 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.865633 11751 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.847193 11863 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:20.866914  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:20.869475 11863 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.870501 11863 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.871119 11818 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:20.872452 11767 consensus_meta.cc:287] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.561s	user 0.003s	sys 0.004s
I20260709 13:04:20.873499 11751 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:20.874948 11850 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.408s	user 0.007s	sys 0.004s
I20260709 13:04:20.875223 11783 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.879475 11831 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:20.879865  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.868363  8777 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.873521 11837 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:20.881172 11837 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:20.881589  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 485010us
I20260709 13:04:20.889894  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:20.881997  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:20.872869 11767 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.877200 11783 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.925750 11659 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:20.893440 11810 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:20.933161  8123 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:20.927634  8193 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:20.917865 11725 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:20.935025  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44949.6us
W20260709 13:04:20.899844  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 446d688479d34112bfc4ab0afb09d6f5: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:20.889653 11800 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:20.940613 11659 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.910959 11879 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:20.915843 11748 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.898727 11402 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.944283 11879 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.941143 11810 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:20.899565 11396 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:20.934181  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.931766  8803 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:20.945827 11748 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.943665  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:20.937314 11869 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:04:20.914914 11793 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.000s
I20260709 13:04:20.946825 11793 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.879966 11831 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.944628 11402 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.948465  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.948740 11793 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.948886 11831 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:20.945282 11800 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.889636 11837 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.928413 11788 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:20.911906 11811 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.000s
I20260709 13:04:20.922456 11777 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:04:20.923967 11767 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:20.950112  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:20.951071  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.951727  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:20.924610  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:20.952463  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.952847  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.953490  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:20.940171 11740 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.003s
I20260709 13:04:20.970836 11770 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.956933 11659 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:20.957190  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.954542  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:20.959460 11862 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:20.981465  8807 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:20.981657 11862 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.957976 11783 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.984822 11783 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.984274  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:20.987470 11783 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:20.903959 11851 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 13:04:20.900799  8120 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:20.988341  8807 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:20.954257 11810 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.978425 11770 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.954708 11471 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:20.990335  8122 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:20.978094 11800 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.990450 11471 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:20.952379  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:20.865870 11423 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.991432 11841 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:20.991963 11841 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:20.991811 11471 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.992707  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.993412  8122 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:20.911114 11754 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.993898 11841 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.994479  8122 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:20.954560  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:20.956188 11725 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.955873  8121 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:20.951673  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.948997 11402 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.978397 11819 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:20.949472  8118 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:20.933642 11860 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 13:04:20.965713  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:20.979626  8123 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:20.979915 11811 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.967065 11776 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:20.963061 11797 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:20.976401 11857 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:21.064230  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:20.989732 11755 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:04:20.978168  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53625us
I20260709 13:04:20.911604  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:21.067669  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 156126us
I20260709 13:04:20.996109  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:20.996755  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:21.069742  8803 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:20.989322  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:21.070729  8120 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:20.953434 11879 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:20.999114  8125 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:21.002148  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47666.7us
I20260709 13:04:21.073071  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:21.003232  8116 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:21.003716  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:21.006484 11754 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:21.007660 11600 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:20.991328 11770 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.008493  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:20.904968 11746 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.009900  8272 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:21.010703  8268 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:21.050348  8193 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:21.052841  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:21.025311  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.056061  8123 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:21.001936 11767 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:21.066756  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:21.069703  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 73670.1us
I20260709 13:04:21.185267  8808 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.984246 11862 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:21.065119  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:21.192183  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 127134us
I20260709 13:04:21.152154  8807 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:21.087961  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.045011 11793 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.145663  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.082433  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.197511  8274 raft_consensus.cc:2393] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:21.090045  8121 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:21.115253  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47650.4us
I20260709 13:04:21.146066  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:21.156816  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 227910us
W20260709 13:04:21.157591 11860 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:04:21.159694  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:21.161559 11748 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:21.162606 11811 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:20.957082 11751 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.221318  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.222004  8192 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.165941 11831 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:21.166427 11788 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:21.166666  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 83415.3us
I20260709 13:04:21.115131 11819 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:21.168875  8123 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:21.172122 11800 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.173396  8266 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:21.173913  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:21.173276  8117 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:21.200824 11755 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:21.187016  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:21.174492  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.195655  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:21.196411  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:21.239774  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52840.4us
W20260709 13:04:21.239943  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 44386.6us
I20260709 13:04:21.196537  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:21.202225  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.241223  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:21.211447  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.242060  8195 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:21.067049 11776 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.213014  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.247778  8810 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:21.214504  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.207715  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.079527 11783 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:21.251368 11783 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:21.251976 11837 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.252554 11844 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.222409 11748 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.167408  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:21.253021 11844 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:21.254216  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 57750.4us
I20260709 13:04:21.079701 11740 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:21.255106 11740 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.255385  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:21.255503 11740 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:21.256467 11818 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.230306  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:21.257647  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.258229  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.260041  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.260511 11751 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.260702 11760 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.232349  8803 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:21.191730 11596 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:21.234692  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.258324  8271 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:21.257689  8123 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.263135  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.263722  8271 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:21.181511 11841 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:21.233418 11862 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:21.266891  8807 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:21.238138  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.238415  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.209640  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.212658  8265 raft_consensus.cc:2368] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:21.241425  8268 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:21.245698 11880 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:21.247674  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.072158 11797 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.244889  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:21.249617  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.250710 11733 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:21.278838  8192 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:21.224710  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:21.274348  8803 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:21.262205  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:21.261265  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:21.262123  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:21.195667 11767 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.284740  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.284932  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.285439  8194 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.203330 11812 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:04:21.274914  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.244865 11755 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.289120  8192 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:21.276154  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.290810  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.252202 11783 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.281461  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:21.281430  8272 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:21.243932 11811 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:21.272886 11880 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.146606 11857 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:21.287927  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63321.9us
I20260709 13:04:21.285913 11434 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.292558  8124 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.302326  8803 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:21.255065 11844 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:21.235685 11788 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.247412 11863 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.304080  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.363137  8199 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.304584  8191 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:21.307868  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:21.317660  8198 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:21.235811 11831 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.288432  8123 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:21.262041 11730 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:04:21.261850 11731 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:04:21.273234 11582 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:04:21.332742  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.289800 11396 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.292595 11810 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:21.348157  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 143845us
I20260709 13:04:21.291894 11755 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.275450 11862 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.315867 11733 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:21.271690 11596 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.495361  8199 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:21.498306 11837 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.468086 11402 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.460067 11807 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:21.456763  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:21.444649  8124 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:21.502599 11841 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.484696  8088 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:21.509843  8194 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:21.428042  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 120263us
I20260709 13:04:21.525933  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:21.406170  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:21.398977  8808 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:21.423983  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1983) took 1029 ms. Trace:
I20260709 13:04:21.424674  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:21.519727  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 302369us
I20260709 13:04:21.520539  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.331477 11880 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:21.532572 11882 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:04:21.517802  8272 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:21.505614 11776 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.582844 11831 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.325327 11817 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.529417 11471 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.531186 11879 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.585052 11800 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.585783 11767 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.586166 11879 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.526774 11841 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.532701 11760 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.406684 11819 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.590435 11818 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:21.505834 11430 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.591089 11430 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.524796 11402 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.593029 11430 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.524693 11807 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.602602 11746 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:21.602982 11746 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:21.603551 11807 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:21.536732 11748 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.537912 11857 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.538591 11434 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:21.514286  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 258962us
W20260709 13:04:21.524350  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.574265 11770 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:21.575219  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49349.5us
I20260709 13:04:21.593886 11402 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:21.594491 11862 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:21.534386 11596 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.597136 11797 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.597712  8191 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:21.598042 11788 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:21.598728 11891 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:04:21.600939 11396 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.354054 11777 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.219s
I20260709 13:04:21.892443  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:21.604522  8267 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:21.813035  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58253.2us
W20260709 13:04:21.895002  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 393706us
I20260709 13:04:21.610795  8808 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:21.895881  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:21.601828 11663 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:21.901069 11894 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:21.901427 11663 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:21.901795 11894 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.902344 11663 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.903452 11663 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.905797 11877 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.906306 11877 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:21.408385 11659 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:21.477849 11567 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.363523 11732 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.896301  8119 rpcz_store.cc:276] 0709 13:04:20.394661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.726025 (+331364us) service_pool.cc:224] Handling call
0709 13:04:20.726345 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:20.929957 (+203612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:20.929990 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:20.930458 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.272631 (+342173us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:21.326948 (+ 54317us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.327141 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.327207 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.423764 (+ 96557us) raft_consensus.cc:1685] finished
0709 13:04:21.423784 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.423921 (+   137us) inbound_call.cc:177] Queueing success response
0709 13:04:21.594192 (+170271us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800073840. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
Metrics: {"mutex_wait_us":239468,"prepare.queue_time_us":56560,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":8941,"raft.queue_time_us":206246,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"spinlock_wait_cycles":6736640,"thread_start_us":341808,"threads_started":1,"wal-append.queue_time_us":491278}
I20260709 13:04:21.909550  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:21.709322  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:21.908735  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:21.755537 11793 consensus_meta.cc:287] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.001s
I20260709 13:04:21.932415  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.933024  8197 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.933907  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.934898  8199 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:21.929172  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 504537us
I20260709 13:04:21.930358  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:21.939088  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.939654  8194 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:21.942020  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.945261  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:21.851931 11776 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.586313 11600 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:21.981221  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:21.852144 11733 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.930496 11430 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:04:21.983019 11877 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:21.981808  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:21.984833  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 411491us
I20260709 13:04:21.985322  8196 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:21.753646 11471 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:21.990401  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.930970 11748 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:21.954432  8194 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:21.953648 11844 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:21.989584  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:21.994851  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:21.905929 11755 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.993781  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2081) took 1066 ms. Trace:
I20260709 13:04:21.962088  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:22.008273  8166 leader_election.cc:400] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:22.008625  8166 leader_election.cc:403] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:21.945358 11793 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.958511  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:21.999131  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:22.010684  8193 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:21.946411 11788 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.950385 11862 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:21.949177 11822 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:21.950224 11797 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:21.948493 11582 consensus_queue.cc:1059] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:04:22.004647 11471 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.004833  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:21.948755 11402 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:22.034472  8122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.025s	sys 0.037s
I20260709 13:04:22.009843  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:22.012336  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:22.012506  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.931370 11567 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:21.948657 11731 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:04:21.994887 11885 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:04:22.035254  8119 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:22.034978  8271 raft_consensus.cc:606] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.037652  8193 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:22.046551  8271 raft_consensus.cc:614] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:21.954782 11751 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:21.943908 11732 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.007157  8125 rpcz_store.cc:276] 0709 13:04:20.927085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.169795 (+242710us) service_pool.cc:224] Handling call
0709 13:04:21.170089 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.187563 (+ 17474us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:21.202126 (+ 14563us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.370472 (+168346us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.370937 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.371060 (+   123us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:21.371091 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.371153 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.993582 (+622429us) raft_consensus.cc:1685] finished
0709 13:04:21.993602 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.993726 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10644,"prepare.queue_time_us":14970,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2022,"raft.queue_time_us":16681,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":56919,"thread_start_us":166444,"threads_started":1,"wal-append.queue_time_us":326241}
I20260709 13:04:21.976586 11892 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:04:22.023403  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64986.6us
I20260709 13:04:22.029933  8120 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:21.603730 11746 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.005846  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:22.031617 11843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.014s
I20260709 13:04:21.988154 11817 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:04:21.993141 11600 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:04:22.034860 11899 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:22.040640  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.035384  8122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.025s	sys 0.037s
I20260709 13:04:22.042219  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:22.036551  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.004002 11748 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.075932  8802 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:22.043906 11793 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:22.054435  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.056588  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:22.058897  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:22.002317 11844 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.051882  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:21.985455 11776 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.103235  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:22.104084 11776 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.020740 11862 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:22.001889 11430 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:04:22.104692 11862 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.038048 11767 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:04:22.036041 11760 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:22.049831 11740 consensus_meta.cc:287] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.794s	user 0.008s	sys 0.002s
I20260709 13:04:22.109946 11740 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.112031 11740 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:22.115504 11841 consensus_meta.cc:287] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.528s	user 0.000s	sys 0.007s
I20260709 13:04:22.115931 11841 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.066411 11894 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.118196 11659 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.118623 11659 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.118927 11659 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.122702  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:22.122926  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.123611  8272 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:22.124094 11890 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:22.124604 11890 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:22.125412 11890 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.126637  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.127329 11471 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.127592  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.128309  8273 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:22.128948  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.129318  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.129557  8268 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:22.030676 11797 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.131567  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.034698 11402 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.034050 11770 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.132340 11402 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.131584 11797 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.132328  8272 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:22.133395 11732 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.017889  8197 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
W20260709 13:04:22.134646 11878 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.627s	user 0.016s	sys 0.024s
W20260709 13:04:22.085949  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49473.7us
I20260709 13:04:22.136207  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:22.064786 11843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.013s	sys 0.014s
I20260709 13:04:22.048431 11777 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.137534 11797 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:22.137890 11777 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.140025 11777 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:22.098227  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43882.5us
I20260709 13:04:22.098937 11897 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:22.141050 11897 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:22.142052 11897 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.143307 11897 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:22.143573 11810 consensus_meta.cc:287] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.001s
I20260709 13:04:22.092372 11857 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.062784 11751 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.065127 11898 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
W20260709 13:04:22.101404 11886 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 13:04:22.051007 11893 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:22.101681 11844 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.152041  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:22.153967  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 258171us
I20260709 13:04:22.154512  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.155041  8269 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:22.154333  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:22.173000  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:22.075721 11746 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.173632  8191 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.176566  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.172225  8271 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:22.128849 11755 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.177393  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:22.180331  8120 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:22.181947  8119 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.182197  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.186748  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.071983 11899 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:22.181201  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.192121  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.193859  8120 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:22.192466  8194 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:22.194720  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:22.186650  8091 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:22.174994 11893 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.205626  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:22.202811  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:22.210237  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.202185  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.203115  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:22.200449  8271 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:22.210091  8268 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.171063 11725 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.148145 11896 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.221330  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.184291 11740 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:22.151516 11770 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.205044  8120 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:22.227632  8268 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:22.228232  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.228857  8120 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:22.229633  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:22.229771  8268 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:22.230130  8120 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.210613  8273 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:22.218209  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:22.230901  8274 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.219209  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.232383  8125 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:22.233634  8125 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:22.236368  8266 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:22.192175 11777 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:22.223089 11893 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.151891 11793 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.219578  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.178712 11471 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:22.196835 11904 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:22.196460 11423 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.194151 11831 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:22.170087 11837 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:04:22.250046 11413 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.246054  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 649) took 1176 ms. Trace:
I20260709 13:04:22.246943  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:22.205662 11877 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.279482  8269 rpcz_store.cc:276] 0709 13:04:21.070067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.072035 (+  1968us) service_pool.cc:224] Handling call
0709 13:04:22.245898 (+1173863us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400346554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:22.246002 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092147456}
I20260709 13:04:22.256469  8120 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:22.249418 11600 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.211117 11788 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.298310 11788 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:22.298774 11788 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:22.299891 11788 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.303843  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1991) took 1155 ms. Trace:
I20260709 13:04:22.304265  8117 rpcz_store.cc:276] 0709 13:04:21.147940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.235016 (+ 87076us) service_pool.cc:224] Handling call
0709 13:04:21.235290 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.043367 (+808077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.043405 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:22.043458 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:22.043491 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.303579 (+260088us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b540011d5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:22.303629 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.303758 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9988,"raft.queue_time_us":14435,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":15840,"spinlock_wait_cycles":1834593152}
W20260709 13:04:22.305804  8124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2076) took 1380 ms (client timeout 1713 ms). Trace:
W20260709 13:04:22.306210  8124 rpcz_store.cc:269] 0709 13:04:20.925181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.949888 (+ 24707us) service_pool.cc:224] Handling call
0709 13:04:22.305633 (+1355745us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400393354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:22.305730 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722210048}
W20260709 13:04:22.307581  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 652) took 1236 ms (client timeout 1603 ms). Trace:
W20260709 13:04:22.307960  8270 rpcz_store.cc:269] 0709 13:04:21.070957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.145849 (+ 74892us) service_pool.cc:224] Handling call
0709 13:04:22.307378 (+1161529us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400346a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:22.307514 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810537344}
I20260709 13:04:22.308902  8121 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:22.309998 11812 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:22.310388 11812 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:22.311298  8199 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:22.315032  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1990) took 1167 ms. Trace:
I20260709 13:04:22.315420  8121 rpcz_store.cc:276] 0709 13:04:21.147724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.211821 (+ 64097us) service_pool.cc:224] Handling call
0709 13:04:22.308748 (+1096927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.309308 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.314843 (+  5535us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400393350. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:22.314968 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522188672}
I20260709 13:04:22.271711 11841 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.239758 11725 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.261937  8273 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:22.206032 11819 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:22.271452  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:22.249774 11898 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.273957  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:22.325733 11755 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:22.276852  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:22.277453  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 57863.8us
I20260709 13:04:22.280527 11900 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:22.306646 11751 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.283097  8120 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:22.284929 11600 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.290282  8274 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:22.292761  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:22.293849  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:22.342592  8804 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:22.295009  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:22.295681  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:22.338083 11898 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.343837  8808 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:22.345185 11898 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.278503 11904 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:22.326292  8200 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.273092 11740 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:22.205729 11596 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:04:22.329391  8266 raft_consensus.cc:606] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.355033  8266 raft_consensus.cc:614] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:22.330955  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:22.243196 11770 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.334815  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.279873 11423 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.259326 11777 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.328896 11819 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.272075 11471 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.219182  8191 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:22.312772 11413 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.315246 11899 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.362084  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:22.384526  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:22.385636  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.363152 11877 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:22.366055 11909 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:22.311256 11812 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.378364  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:22.355633 11567 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.359342 11811 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:22.394989  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.424985  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.421975 11904 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.427534  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:22.338452 11755 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.430358 11755 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.431638 11471 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.431639 11730 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:22.434587 11434 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:22.436627 11844 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.441823 11812 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:22.446280 11663 consensus_meta.cc:287] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.003s
I20260709 13:04:22.447023 11834 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.447520 11834 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.409891  8265 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:22.382495 11748 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.420795  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:22.452950  8119 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:22.391876 11879 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:22.392059 11751 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:22.462990  8265 raft_consensus.cc:2410] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:04:22.464428  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 43732.1us
I20260709 13:04:22.467877  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.411000 11900 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:22.414361 11899 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:22.469273  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 263171us
I20260709 13:04:22.451738 11818 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.472663  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.434533 11777 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.475785  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:22.487886  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.488469  8124 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:22.441092 11770 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.478111  8269 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:22.491583  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.491678  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.492240  8124 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:22.492373  8269 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:22.480424  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.482308  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:22.483803  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:22.493793  8120 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.485312  8274 raft_consensus.cc:2368] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:22.475414  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.494829  8267 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:22.484663  8271 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:22.486228  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.454445 11797 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.463896 11908 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:22.476064  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.454808 11471 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:22.497656  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.501854  8120 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:22.463565 11811 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:22.503018  8118 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:22.464362 11751 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:22.504262  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.499158  8237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.713s (SENT) [suppressed 35 similar messages]
W20260709 13:04:22.505666  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 319070us
I20260709 13:04:22.507501  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.469509 11755 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:22.511404  8269 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:22.512130  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:22.471885 11879 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:22.512717  8125 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:22.488785 11841 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:22.607842  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.609576  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 133847us
I20260709 13:04:22.629019  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.510426 11751 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.465958 11740 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.518923 11776 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:22.490203 11818 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:22.610512  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 221685us
I20260709 13:04:22.514379 11908 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:22.517820 11755 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:22.640825  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 141683us
I20260709 13:04:22.608852 11733 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:22.644939  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.512871 11471 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:22.638367 11862 consensus_meta.cc:287] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.002s
I20260709 13:04:22.653374  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:22.658108  8273 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:04:22.653501  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19747a1b37df480faebc96d93689cda5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:22.639199 11776 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:22.639058 11909 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:22.652267 11402 consensus_meta.cc:287] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.008s
I20260709 13:04:22.657634 11890 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.673797 11890 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.691278  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:22.703226  8200 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:22.721505 11810 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:22.658739 11733 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:22.721266  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 76492.1us
I20260709 13:04:22.668494 11776 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.729668 11733 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.677551 11423 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.731390  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.719660 11793 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.720641  8195 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:22.734354 11733 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:22.734833 11733 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.735056  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:22.737599 11733 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.733754 11902 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:22.738358 11902 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.738709 11902 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.825001 11413 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:22.825539  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 90567.8us
W20260709 13:04:22.825326  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 74169us
I20260709 13:04:22.840759  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:22.843834  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 320441us
I20260709 13:04:22.666289 11725 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:22.825515 11918 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:04:22.758203 11897 consensus_meta.cc:287] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
W20260709 13:04:22.890712  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50020.1us
I20260709 13:04:22.668654 11909 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:22.676465 11911 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:22.920867  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:22.931754  8120 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:22.920967  8117 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:22.921936  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:22.838202 11921 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:04:22.923854  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:22.841759 11931 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.003s
I20260709 13:04:22.927487  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:22.824944 11916 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
W20260709 13:04:22.864346 11659 consensus_meta.cc:287] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.004s
W20260709 13:04:22.859334 11746 consensus_meta.cc:287] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.002s
I20260709 13:04:22.827240 11767 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:22.960615  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.964735  8124 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:22.754352 11471 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:22.836369 11913 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:22.761907 11770 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.967533  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.991139  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:22.665587 11862 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.991954  8807 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:22.850133 11822 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:22.864199 11600 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:22.930020 11915 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:04:22.676664 11402 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.930197 11909 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:22.762405 11811 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.929481 11692 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:22.996776 11843 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:22.846122 11430 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:22.855479 11596 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:22.919901 11777 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:22.966253 11733 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:22.666262 11879 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.957530 11911 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:22.995276  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:22.759950 11819 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:23.002393  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 315859us
W20260709 13:04:23.010398  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.971021 11413 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:22.754355 11755 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.012485 11413 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.012770 11843 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:23.013149 11413 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.014022 11911 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.014954 11911 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.016456 11776 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.998140 11692 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.017565 11692 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:23.018067 11890 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:23.005187 11733 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.999614 11913 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.020470 11733 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.020607 11913 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.867856 11902 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.022503 11902 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:23.024297 11899 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.000s
I20260709 13:04:23.023548 11413 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.754529 11908 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.002921 11596 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:22.893172 11751 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:22.998946 11917 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:23.027721 11413 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:23.028106 11917 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.029268 11402 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:22.995432 11920 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:23.030185 11917 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:22.993394 11767 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.025045  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.031716  8199 raft_consensus.cc:2410] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:23.031993 11767 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.002991 11430 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.033493 11402 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.034202 11430 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.033988 11402 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.035791 11862 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.009299  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:22.994333 11822 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:22.987393 11659 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:23.067556  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.145928  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.146867  8270 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:23.139204 11751 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.140923  8266 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:23.141229  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:23.001406 11600 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:23.039130  8272 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:23.137987 11817 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:23.009016  8119 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:23.150789  8123 raft_consensus.cc:2376] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8. Re-sending same reply.
W20260709 13:04:23.149013  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 520052us
I20260709 13:04:23.152673  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.152777  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:23.153275  8123 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
W20260709 13:04:23.154618  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 145383us
I20260709 13:04:23.154317  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:23.155323  8166 leader_election.cc:400] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:23.155778  8166 leader_election.cc:403] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:23.155313  8123 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.155715  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:23.159008  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:23.156635  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:23.027959 11596 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:23.071009 11880 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.490s	user 0.008s	sys 0.003s
I20260709 13:04:23.160631  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.165733  8116 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:23.161296  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:23.161664  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:23.161039  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.145035 11909 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.035902 11402 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:23.160229 11430 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:23.013334 11843 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:23.149152 11822 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:23.172186  8089 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:23.168205  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:23.168747  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.162762 11767 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.167133 11913 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:04:23.006551 11777 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.164084 11776 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.151479 11817 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:23.182497  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 22c63c7039644c089bf014466158ac6b: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:23.161942  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:23.174335  8123 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:23.175217  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.183394  8199 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:23.183672 11934 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.184201 11934 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.185601  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.186271 11934 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.175662 11430 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.188289 11430 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.170579 11733 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:23.190145 11733 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:23.190505 11733 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.190814 11733 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.178462 11857 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:23.192654 11857 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:23.193003 11857 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.193491  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.193951  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.188079 11834 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:23.174526  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.194578  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:23.195477  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:23.196697  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2001) took 1015 ms. Trace:
I20260709 13:04:23.164968 11413 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:23.162817 11923 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:23.197739 11413 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:23.198661 11413 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.204670 11822 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.205736 11818 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:23.206096  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.199204 11817 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.206961 11817 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:23.184145  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:23.208020 11844 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:23.209826 11402 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:23.210240 11402 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.210584 11402 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.210722  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2079) took 2284 ms. Trace:
I20260709 13:04:23.211107  8122 rpcz_store.cc:276] 0709 13:04:20.926625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.073928 (+147303us) service_pool.cc:224] Handling call
0709 13:04:21.074152 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.370297 (+296145us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:22.073447 (+703150us) log.cc:844] Serialized 14 byte log entry
0709 13:04:22.994227 (+920780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:22.994297 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:22.994377 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.210490 (+216113us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400298e54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:23.210533 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.210646 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4170,"prepare.queue_time_us":107321,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":139324,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9554,"spinlock_wait_cycles":680604032,"thread_start_us":1526109,"threads_started":3,"wal-append.queue_time_us":791427}
I20260709 13:04:23.207131  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.197178  8125 rpcz_store.cc:276] 0709 13:04:22.180908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.234320 (+ 53412us) service_pool.cc:224] Handling call
0709 13:04:22.234796 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.516542 (+281746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.196247 (+679705us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540011dfd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:23.196608 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638641536}
I20260709 13:04:23.213131  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.214819  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.216040  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:23.177454  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.177619  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.178165  8195 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:04:23.220211  8195 pending_rounds.cc:85] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:04:23.220461  8195 pending_rounds.cc:107] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:04:23.162976 11917 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:23.166267 11899 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:23.220588  8125 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.220978  8195 raft_consensus.cc:2889] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:23.074361 11862 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.179383  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:23.179476  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.179971  8194 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:04:23.160409 11936 raft_consensus.cc:2764] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:23.181372  8777 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:23.195658  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:23.173331 11596 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:23.219380  8191 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:23.245983  8124 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:23.246012  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64755.1us
I20260709 13:04:23.252375  8124 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:23.013438 11897 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:04:23.254415 11938 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:23.255388  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:23.256428  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:23.224478  8195 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:23.246733  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:23.247251  8197 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:23.203789 11692 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.169644 11880 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.245638  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:23.247627  8194 pending_rounds.cc:85] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 8
I20260709 13:04:23.208913 11733 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.230885 11822 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:23.269173  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1993) took 2120 ms. Trace:
I20260709 13:04:23.261332  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:23.229359  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:23.270244  8808 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 5.
I20260709 13:04:23.263940  8125 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:23.264187  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.264963  8194 pending_rounds.cc:107] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:04:23.271310  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.271670  8194 raft_consensus.cc:2889] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:23.257185  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 89048.2us
I20260709 13:04:23.265280  8123 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:23.265753  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.274935  8273 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:23.223688 11899 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.266290  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.275403  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:23.267118  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:23.276134  8269 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.278191  8123 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:23.279036  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:23.269579  8118 rpcz_store.cc:276] 0709 13:04:21.148366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.427085 (+278719us) service_pool.cc:224] Handling call
0709 13:04:21.482651 (+ 55566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.510790 (+1028139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.268978 (+758188us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000e38d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:23.269121 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344956288}
I20260709 13:04:23.258435  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:23.267822  8122 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:23.268324  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:23.260744  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 86319.4us
W20260709 13:04:23.311790  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53426.5us
I20260709 13:04:23.324096  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.257907 11862 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:23.281080  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:23.327356  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46364.9us
W20260709 13:04:23.329025  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.334847  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:23.332260 11841 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:23.338351 11841 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.338696 11841 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.273584 11934 raft_consensus.cc:2764] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:04:23.333451 11818 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:23.342929 11818 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:23.344254 11818 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.333295 11596 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:23.345932 11596 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:23.346336 11596 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.347416 11843 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.326131 11899 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:23.263656 11925 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:23.395612  8199 raft_consensus.cc:2368] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11.
I20260709 13:04:23.398908  8088 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:23.349416 11413 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:23.249277 11917 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.324937 11692 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:23.544696  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 270144us
W20260709 13:04:23.341991 11944 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:04:23.332708 11936 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.340s
I20260709 13:04:23.811599  8271 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:23.791435  8270 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:23.671782  8193 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:23.956259  8088 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:23.741856  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.745178  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.664173  8269 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
W20260709 13:04:23.955775  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 644295us
I20260709 13:04:23.736753  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:23.953383  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:23.970472  8274 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:23.813305 11430 consensus_meta.cc:287] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.001s
W20260709 13:04:23.830029 11767 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.000s
W20260709 13:04:23.864498 11899 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.003s
I20260709 13:04:23.623025 11947 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:23.958351 11402 consensus_meta.cc:287] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.000s
W20260709 13:04:23.850725 11596 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:04:23.670781 11817 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:23.976214 11857 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.002s
I20260709 13:04:23.346935 11841 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:23.681874 11692 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:23.946146 11911 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.931s	user 0.006s	sys 0.004s
I20260709 13:04:23.596131 11941 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:23.668170 11844 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:24.099822  8274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:23.813809 11733 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:23.631788 11413 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:23.958455 11725 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:24.103368  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 128068us
I20260709 13:04:24.105527  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2004) took 1183 ms. Trace:
I20260709 13:04:23.977450 11938 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:23.640143 11946 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.526s
I20260709 13:04:24.091835 11917 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.091523 11767 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:24.127748  8274 raft_consensus.cc:606] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:24.191462  8274 raft_consensus.cc:614] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:24.132099  8119 rpcz_store.cc:276] 0709 13:04:22.921612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.921718 (+   106us) service_pool.cc:224] Handling call
0709 13:04:24.105298 (+1183580us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400149954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:24.105457 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174222080}
W20260709 13:04:24.161566  8807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 623) took 1835 ms (client timeout 2108 ms). Trace:
I20260709 13:04:24.055588 11430 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:24.186992 11843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.043s	sys 0.029s
I20260709 13:04:24.132105 11844 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.103520 11899 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.106328 11402 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.201947  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2106) took 1189 ms. Trace:
I20260709 13:04:24.108700 11596 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.185097 11941 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:24.196507 11843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.043s	sys 0.030s
W20260709 13:04:24.207317  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 253829us
I20260709 13:04:24.110628 11817 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.110507 11857 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.195108 11831 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:24.103768 11947 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.186151 11733 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.202411  8121 rpcz_store.cc:276] 0709 13:04:23.024546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.248218 (+223672us) service_pool.cc:224] Handling call
0709 13:04:23.248501 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.248702 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:23.700083 (+451381us) log.cc:844] Serialized 14 byte log entry
0709 13:04:24.201611 (+501528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.201655 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:24.201684 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.201742 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.201830 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":709176,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":104376,"thread_start_us":951756,"threads_started":3}
W20260709 13:04:24.216187  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:24.197252  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 241063us
W20260709 13:04:24.216790  8807 rpcz_store.cc:269] 0709 13:04:22.292940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.295466 (+  2526us) service_pool.cc:224] Handling call
0709 13:04:24.127777 (+1832311us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540058f2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:24.127904 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491103104}
I20260709 13:04:24.128269 11692 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.239166  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 620) took 1947 ms. Trace:
I20260709 13:04:24.207463  8196 raft_consensus.cc:2368] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:24.228670  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:24.194079 11917 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.199684 11880 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.187147 11725 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.191571 11938 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.269099  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:24.230060 11396 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:24.269362  8119 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:24.249814  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2102) took 1239 ms. Trace:
I20260709 13:04:24.294545  8117 rpcz_store.cc:276] 0709 13:04:23.010115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.010271 (+   156us) service_pool.cc:224] Handling call
0709 13:04:23.010553 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.026933 (+ 16380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.026973 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:23.027010 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:23.027037 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.249590 (+1222553us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b5400299354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:24.249637 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.249762 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37271936}
I20260709 13:04:24.273200  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:24.285521 11898 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.314783 11898 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.315861 11880 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:24.316304 11880 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.316648 11880 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.316834 11898 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.319918 11725 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.321507 11396 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.323976 11396 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.324489 11396 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.314081 11692 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.239711  8810 rpcz_store.cc:276] 0709 13:04:22.292115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.292230 (+   115us) service_pool.cc:224] Handling call
0709 13:04:22.292557 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:22.604600 (+312043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.604630 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:22.639065 (+ 34435us) log.cc:844] Serialized 52 byte log entry
0709 13:04:22.845581 (+206516us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:22.845617 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.235991 (+1390374us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54005834d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:24.236036 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.236078 (+    42us) raft_consensus.cc:1685] finished
0709 13:04:24.236088 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.239060 (+  2972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":886,"raft.queue_time_us":61314,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11571,"spinlock_wait_cycles":226391936,"thread_start_us":404731,"threads_started":2,"wal-append.queue_time_us":206812,"wal-append.run_cpu_time_us":6076,"wal-append.run_wall_time_us":1014873}
I20260709 13:04:24.327755 11947 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.329573 11917 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:24.331502 11956 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:04:24.332774  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1821) took 1156 ms. Trace:
I20260709 13:04:24.333130  8200 rpcz_store.cc:276] 0709 13:04:23.176436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.178008 (+  1572us) service_pool.cc:224] Handling call
0709 13:04:23.186455 (+  8447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:23.261681 (+ 75226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.261703 (+    22us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:23.333689 (+ 71986us) log.cc:844] Serialized 52 byte log entry
0709 13:04:24.091953 (+758264us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:24.091987 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.092051 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.332518 (+240467us) raft_consensus.cc:1685] finished
0709 13:04:24.332546 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.332716 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8017,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":493742,"threads_started":2,"wal-append.queue_time_us":616941}
I20260709 13:04:24.334262 11430 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.337551 11966 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:24.338896 11966 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:24.339237 11596 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.340941 11938 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.236294 11936 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.227198 11941 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.237778 11964 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.353313 11898 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.359891 11898 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.363372  8119 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
W20260709 13:04:24.391481  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 422053us
W20260709 13:04:24.392501  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 259294us
W20260709 13:04:24.394335  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.396795  8117 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:24.400527  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:24.402922  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:24.405579  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:24.324920 11396 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.410995  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:24.406921  8117 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.411828  8121 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:24.249773 11733 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.402428 11692 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:24.240969 11413 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.393747 11844 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.427480 11692 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.393206 11964 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.460704 11692 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.461257 11964 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.405797 11897 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.434294 11898 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.434546 11965 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.436152 11960 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:24.437544 11941 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.440209 11880 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.441908 11751 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.402300 11430 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:24.450208 11841 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.451221 11857 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.451438 11909 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.451575  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2114) took 1284 ms. Trace:
I20260709 13:04:24.487793  8122 rpcz_store.cc:276] 0709 13:04:23.166848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.212914 (+ 46066us) service_pool.cc:224] Handling call
0709 13:04:24.451398 (+1238484us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54000e33d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:24.451521 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121765120}
I20260709 13:04:24.451999 11817 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.452286  8117 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:24.477846 11960 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.490648  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2103) took 1479 ms. Trace:
I20260709 13:04:24.491016  8120 rpcz_store.cc:276] 0709 13:04:23.011136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.011284 (+   148us) service_pool.cc:224] Handling call
0709 13:04:23.011509 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.248390 (+236881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.248420 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:23.248457 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:23.248486 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.490430 (+1241944us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540029ac54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:24.490480 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.490595 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544416128}
I20260709 13:04:24.456554 11733 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.492337 11960 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.492224 11733 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:24.493605 11817 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.494060 11817 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.495880 11817 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.496330 11817 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.496740 11817 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.497418 11961 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:04:24.456979 11402 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.477648 11965 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.502615  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.503187  8192 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:24.458078 11917 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.410883 11899 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.504182 11965 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.504633 11899 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.501992 11947 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:24.505122 11899 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.458501 11945 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:24.505739 11947 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:24.506021 11945 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:24.506572 11947 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.506824 11945 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.507514  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2006) took 1352 ms. Trace:
I20260709 13:04:24.507696 11947 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:24.462023  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 230598us
I20260709 13:04:24.475853  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1829) took 1282 ms. Trace:
I20260709 13:04:24.508415  8193 rpcz_store.cc:276] 0709 13:04:23.180578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.180688 (+   110us) service_pool.cc:224] Handling call
0709 13:04:24.463013 (+1282325us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400363b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:24.463121 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116813184}
I20260709 13:04:24.390141 11936 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.499347  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.505750  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.510527  8194 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:24.511085  8200 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:24.511405  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:24.509563  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:24.511798  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:24.512046  8194 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:24.512331  8200 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:24.500010  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.508517  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.509649  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:24.513659  8195 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:24.509014  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.519304  8197 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:24.504014  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:24.507879  8124 rpcz_store.cc:276] 0709 13:04:23.154741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.253483 (+ 98742us) service_pool.cc:224] Handling call
0709 13:04:23.253779 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.273301 (+ 19522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.273332 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:23.273394 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:23.273420 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.507312 (+1233892us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b540029a254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:24.507355 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.507465 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44449024}
I20260709 13:04:24.530480  8191 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:24.533305 11899 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.534724 11880 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.488368 11966 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:24.538597 11396 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:24.542436  8121 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:24.545732  8200 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:24.581140  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:24.476881 11897 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.507959 11945 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.623756 11968 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.624396 11968 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.626436 11817 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.482081 11751 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.626916 11733 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.627431 11733 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.628578 11751 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.511801 11936 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:24.671314  8193 raft_consensus.cc:2410] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:04:24.672062  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 238959us
I20260709 13:04:24.658751 11898 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.666706 11917 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.671160 11751 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.666543 11899 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:24.783171  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 78875.2us
I20260709 13:04:24.965994  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:24.970799  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:24.812711  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 543669us
I20260709 13:04:24.889719  8195 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:24.687176 11893 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.976223  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:24.669193 11965 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.686825 11402 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.973457  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:24.888625 11879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.047s	sys 0.062s
W20260709 13:04:24.979895  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19747a1b37df480faebc96d93689cda5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:24.980543  8810 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:24.942406 11692 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.994925  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:24.882227 11843 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:24.881649 11841 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:24.730589 11413 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.251s
I20260709 13:04:24.730105 11970 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.981838  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.053790  8808 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:24.983402  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.054755  8809 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:24.983713  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:24.731227 11898 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.704056 11971 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.984269  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:24.787482 11936 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:24.986176  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:24.728341 11947 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:25.001674 11879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.863s	user 0.048s	sys 0.087s
I20260709 13:04:25.003901  8802 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:25.002837  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:24.728705 11817 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.985150 11965 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.813841 11788 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:24.804966 11880 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:25.071588 11953 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.114s	user 0.000s	sys 0.018s
I20260709 13:04:25.002305 11968 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:24.987074 11893 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:24.993849 11899 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:24.994194 11751 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:25.165630  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.026135 11985 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:25.220314  8807 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 6: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:25.221499  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:25.225167  8806 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:25.225759  8810 raft_consensus.cc:2368] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:25.227185  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.227824  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:25.228200  8806 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:25.228328  8807 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:24.979584 11917 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.232234  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.234239 11897 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.235085  8804 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:25.235888 11751 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.221632 11862 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.218262 11733 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.237625  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.238400 11893 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:25.238302 11413 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:25.238929 11893 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:25.239264 11413 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.240954 11733 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:25.178252 11984 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:04:25.242666  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.243341  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 240584us
I20260709 13:04:25.241485 11733 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.229316  8806 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:25.229696 11947 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.246140 11897 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:25.033357 11843 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.254518  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2005) took 2773 ms. Trace:
W20260709 13:04:25.257642  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 230944us
I20260709 13:04:25.254199  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.257910  8266 rpcz_store.cc:276] 0709 13:04:22.470989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.471910 (+   921us) service_pool.cc:224] Handling call
0709 13:04:23.140739 (+668829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.149819 (+  9080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.244323 (+2094504us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54002ec2d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:25.244448 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458965376}
I20260709 13:04:25.241181 11413 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:25.255456  8807 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:25.025774 11692 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.265769 11972 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.277547 11972 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.259784 11897 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.278851 11692 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.252368 11893 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.266103 11742 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:25.230141 11880 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.266563 11986 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:25.026525 11402 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.259061  8803 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:25.158931 11898 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.065840 11841 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.285499 11692 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.286060 11692 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.286571 11841 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.241536 11899 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.287706 11742 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.289849 11742 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.290831 11972 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.254040 11968 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.291549 11968 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.292598 11880 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.293110 11880 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:25.257604 11982 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:25.294075 11982 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.295097 11947 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.226843 11788 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.296216 11982 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.297573 11788 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.297756 11917 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.083808 11970 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.299396 11692 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.293573 11968 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.227164 11817 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.243641 11936 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.282084 11985 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:25.243779 11971 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.313014 11817 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.314015  8121 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:25.301513 11788 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.314558  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.315493  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.328605  8120 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:25.315690  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2011) took 2839 ms. Trace:
I20260709 13:04:25.329435  8272 rpcz_store.cc:276] 0709 13:04:22.476693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.476816 (+   123us) service_pool.cc:224] Handling call
0709 13:04:22.477090 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:23.151061 (+673971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.315442 (+2164381us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400342954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:25.315629 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292108032}
I20260709 13:04:25.302878 11986 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:25.314213  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:25.317276  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.349992  8117 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:25.317689 11402 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.318892  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.319000 11893 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.319761 11897 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.320933  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.293545 11880 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.307184 11692 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:25.322050  8199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1830) took 2140 ms (client timeout 1579 ms). Trace:
I20260709 13:04:25.322381 11987 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.340314 11788 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.352461 11987 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.322949  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.323535  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:25.325270  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.314303 11733 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.351845 11692 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.363276 11986 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.368256 11880 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.369375 11692 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.357940 11990 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:25.362680 11843 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:25.366340 11985 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.356810  8195 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:25.373636  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.374693  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.375239  8124 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:25.375765  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:25.361968  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1716) took 1647 ms. Trace:
I20260709 13:04:25.362715  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2116) took 1145 ms. Trace:
I20260709 13:04:25.383141  8119 rpcz_store.cc:276] 0709 13:04:24.217301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.228399 (+ 11098us) service_pool.cc:224] Handling call
0709 13:04:25.362560 (+1134161us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54004097d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:25.362661 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66247040}
I20260709 13:04:25.386163  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:25.386845  8191 raft_consensus.cc:2368] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12.
I20260709 13:04:25.354710  8123 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:25.354189  8200 raft_consensus.cc:2410] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:25.326360  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.399770  8197 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:04:25.400590  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 142341us
I20260709 13:04:25.402143  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.402758  8807 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:25.403450  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.403990  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.406703  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.408083  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.408787  8807 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:25.351887  8199 rpcz_store.cc:269] 0709 13:04:23.181298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.183923 (+  2625us) service_pool.cc:224] Handling call
0709 13:04:25.321873 (+2137950us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001ec3d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:25.321986 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431584640}
I20260709 13:04:25.357771  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:25.417757  8810 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:25.379535  8273 rpcz_store.cc:276] 0709 13:04:23.714325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.715246 (+   921us) service_pool.cc:224] Handling call
0709 13:04:23.959050 (+243804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.227871 (+268821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.227900 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.227941 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:24.227974 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.361717 (+1133743us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54003b83d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:25.361765 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.361888 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617784064}
W20260709 13:04:25.479512  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 121816us
I20260709 13:04:25.480341  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:25.481089 11692 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:25.481514 11843 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:25.482090 11843 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:25.482468 11843 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:25.481561 11692 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.488829  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.489564  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.489838  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.497674  8266 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:25.490644  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.489048  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.498180  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.498479  8268 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.499390  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.499569  8272 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:25.500025  8802 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:25.499516  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.490612  8269 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:04:25.497721  8270 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:25.498770  8191 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:25.498672  8273 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.501547 11692 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:25.354182 11965 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.365024 11971 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.365854 11970 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.357611 11788 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.519830  8268 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
W20260709 13:04:25.510398 11993 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:04:25.531903  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.532526  8268 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.370438 11990 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.511641  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.558465  8199 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:25.513289  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.537792  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.545722  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.560171  8200 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:25.511277  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:25.559865  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 245882us
I20260709 13:04:25.562188  8088 leader_election.cc:400] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:25.562593  8088 leader_election.cc:403] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:25.504839 11600 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:04:25.566893  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:25.571396  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.574031  8199 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:25.574407  8195 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:25.572826  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.575799  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.576393  8200 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:25.577250  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.577798  8200 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:25.578495  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.579011  8200 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:25.580060  8200 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:25.582056  8119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:04:25.582613  8119 raft_consensus.cc:606] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:25.582944  8119 raft_consensus.cc:614] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:25.584074  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.584713  8199 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:25.536551 11998 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.590812  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.591513  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.591581  8273 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:25.565688 11788 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:25.565599 11880 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.600993  8199 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:25.602401  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.592291  8200 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:25.605430  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.571303 11988 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.571362 11991 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:25.609882  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.610447  8199 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:25.606334  8200 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:25.612272  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.612871  8273 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.573182 11934 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:04:25.616844  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.622779  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.623160 11986 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.623581  8199 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:25.624550  8238 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:25.608593 11991 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:25.631830  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65031.9us
I20260709 13:04:25.634178  8088 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:25.602838 11998 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.637187  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:25.623287 11934 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:25.638908  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 55291.2us
I20260709 13:04:25.608187 11880 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.606441 11788 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.637375  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:25.640695  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.629513 11987 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.632867 11995 raft_consensus.cc:2764] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:25.623695 11986 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.644850 11990 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.645252 11989 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:25.646365  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.634687 11991 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:25.650377  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.656908  8805 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:25.635421 11936 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.651108  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:25.662246  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:25.652230  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.652150  8807 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:25.658160  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.670405  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.671048  8273 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.677397  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.678262  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.679466 11934 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:25.680392 11934 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.654978 11989 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:25.684844  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.667661 11893 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:25.653302 11987 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:04:25.654058 11413 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:04:25.667796 11402 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:25.676867 11936 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:25.695679  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56026.8us
I20260709 13:04:25.675345 12003 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:25.697134  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:25.684031 11989 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.675117 11990 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:04:25.699117  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.702869  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 1997) took 3523 ms. Trace:
I20260709 13:04:25.703053  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2211) took 1199 ms. Trace:
I20260709 13:04:25.674759 11995 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:04:25.696842 11936 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:25.703658  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.703245  8116 rpcz_store.cc:276] 0709 13:04:22.179924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.194297 (+ 14373us) service_pool.cc:224] Handling call
0709 13:04:22.226026 (+ 31729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:23.169007 (+942981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.702648 (+2533641us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54003cf5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:25.702814 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155996544}
I20260709 13:04:25.707424  8273 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:25.703532  8193 rpcz_store.cc:276] 0709 13:04:24.503647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.509309 (+  5662us) service_pool.cc:224] Handling call
0709 13:04:25.702893 (+1193584us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540022cc54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:25.703005 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365265152}
I20260709 13:04:25.704262  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:25.708534 12006 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:25.708818 11880 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.709239  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:25.709367 11880 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:25.709929 11999 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:25.701829 11797 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:25.710584 11797 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:25.710959 11797 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.713742  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.717681  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.718791  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.719842  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.722927  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.723501  8273 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:25.724220  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.749239  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.750033  8274 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:25.750531  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.752054  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.759332  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.760017  8274 raft_consensus.cc:2368] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12.
I20260709 13:04:25.760680  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.761130  8274 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.761421  8272 raft_consensus.cc:2368] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:25.762162  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.711977 11936 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:25.766551  8273 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:25.769830  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.772861  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:25.774463  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 65287.3us
I20260709 13:04:25.775885  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:25.778162  8196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1822) took 2601 ms (client timeout 2106 ms). Trace:
I20260709 13:04:25.778535 11788 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:25.778555  8196 rpcz_store.cc:269] 0709 13:04:23.176715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.177421 (+   706us) service_pool.cc:224] Handling call
0709 13:04:25.777986 (+2600565us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400364f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:25.778099 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270577408}
I20260709 13:04:25.781170  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.714664 11904 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.775775  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.784432  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.784883  8273 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 6.
I20260709 13:04:25.788100  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.790894  8273 raft_consensus.cc:2410] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:25.787743  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.791457  8268 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
W20260709 13:04:25.798463 12009 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:04:25.798616 11692 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.800516  8196 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:25.803063  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.788818 11788 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.785003 12012 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:25.804674  8266 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:25.787231 11900 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.807966  8274 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:25.816951  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.817589  8268 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:25.819963  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.821973  8200 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:25.822454 11777 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.823050  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.827622 11989 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.830750 11989 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:25.835457  8267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1715) took 2158 ms (client timeout 1896 ms). Trace:
W20260709 13:04:25.835873  8267 rpcz_store.cc:269] 0709 13:04:23.677144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.677276 (+   132us) service_pool.cc:224] Handling call
0709 13:04:25.835215 (+2157939us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400075b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:25.835356 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699165056}
I20260709 13:04:25.806953 12012 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:25.841872 12012 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.805745 11998 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.845762  8163 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:25.846854  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:25.850692  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.851559  8091 connection.cc:256] RPC call timeout handler was delayed by -1.2543948769999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:04:25.852178  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.853176  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.853739  8191 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:25.854532  8091 connection.cc:256] RPC call timeout handler was delayed by -1.1230213200000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:04:25.856024  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.856359  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.856804  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.857007  8268 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.857388  8808 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:25.816217 11986 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.858773  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:25.859400  8119 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.860885  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.861771  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.862277  8191 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:25.863983  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.864524  8802 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.865410  8268 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:25.868907  8119 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.863935 11402 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.869799 11402 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.871970  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.872582  8804 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
W20260709 13:04:25.876224  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 100208us
I20260709 13:04:25.877781  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.879451  8191 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:25.880228 11402 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.879480  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:25.880735 11818 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.881366  8118 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:25.881212 11818 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.882644  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.883437 11818 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:25.813915 11900 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.889670  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.889842 11986 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.890322 11986 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.890709  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.890908  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.891115 11900 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:25.891399  8807 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:25.891445  8806 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.884336  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.888084  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:25.851817 11946 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:25.892300  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.893466  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.892350  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.895748 11998 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:25.896266 11998 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:25.897835  8118 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:25.812239 11788 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:25.853070 11430 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:25.900040  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.899273  8117 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.881599  8089 leader_election.cc:400] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11.
I20260709 13:04:25.906533  8089 leader_election.cc:403] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:04:25.899394  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.908861  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.899857  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.909492  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.910181  8123 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:25.911356  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.911986  8123 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:25.913226  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.913846  8123 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.908694  8089 leader_election.cc:400] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12.
I20260709 13:04:25.914842  8089 leader_election.cc:403] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:25.907693  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.856474 11990 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.909716  8268 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:25.915835  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.924476  8123 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:25.920607  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:25.868839  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.919099  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:25.924515  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.918651  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.926991  8271 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
W20260709 13:04:25.927320  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.923096 11777 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12.
I20260709 13:04:25.928311  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.926517  8802 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.887998 11692 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.917201 11783 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11.
I20260709 13:04:25.939352  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.939950  8273 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.892253 11986 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.933792 11659 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:25.931468  8118 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:25.934652  8120 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.936918  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.937577  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.932524  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:25.929059  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.944796  8117 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:25.946007  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.944643  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.945019  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:25.946779  8117 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.941370  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.922842 11946 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.904865 11430 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:25.948488  8804 raft_consensus.cc:2410] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:25.951974  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:25.965631  8273 raft_consensus.cc:2376] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9. Re-sending same reply.
I20260709 13:04:25.957393  8271 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:25.933923 11987 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:25.957617  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:25.967010  8191 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:25.946708  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.964938  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.963714  8274 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:25.968376  8117 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:25.934387 11971 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.965570  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.969231  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.970816  8117 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:25.970039  8268 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:25.986860  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:25.968389  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:25.994407  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:25.995379  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:25.970407 11987 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.969635 11430 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:25.986742 12008 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:26.009754 12008 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:26.011565 12008 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.998796 11880 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:26.011026  8124 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:26.009151 11987 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.022555  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.026082  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.028103  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.989593 11971 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.030123  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.030584  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.031699 11971 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.990329 11998 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:26.030187  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.032397 11998 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.031903  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:25.943584 11900 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:04:25.975761  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.039433  8118 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:26.040344  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:26.040563 12002 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.382s	user 0.002s	sys 0.004s
W20260709 13:04:26.040902  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44901.9us
I20260709 13:04:25.931970 11990 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.042905 11990 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:25.942915 11962 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:04:26.044648 11788 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.049552 11940 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:25.969460 11946 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.051533  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:26.052249  8811 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:26.052461 11946 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:26.052640  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 634) took 1048 ms. Trace:
W20260709 13:04:26.053866 12013 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:04:26.054595  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2214) took 1550 ms. Trace:
I20260709 13:04:26.054949  8194 rpcz_store.cc:276] 0709 13:04:24.504368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.537188 (+ 32820us) service_pool.cc:224] Handling call
0709 13:04:24.537484 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.600570 (+ 63086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.600602 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.600645 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:24.600679 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.054391 (+1453712us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b540021af54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:26.054439 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.054546 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144595840}
W20260709 13:04:26.056414 11843 consensus_meta.cc:287] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.001s
I20260709 13:04:26.056788 11843 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.057915  8270 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:26.058354  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.058853 11843 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.059522  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.060101  8120 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:26.060856  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.061585  8121 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:25.999294 11991 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:26.061632  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52752.8us
I20260709 13:04:26.064652 11991 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.065623  8088 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:26.019516  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:25.999758  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.053016  8811 rpcz_store.cc:276] 0709 13:04:25.004431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.065276 (+ 60845us) service_pool.cc:224] Handling call
0709 13:04:26.051382 (+986106us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:26.052556 (+  1174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7592832}
I20260709 13:04:26.076061  8120 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:26.077078  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:26.108971  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 89508.6us
I20260709 13:04:26.110204  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:26.110899  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 142588us
I20260709 13:04:26.112809  8268 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:26.116053  8089 leader_election.cc:400] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:26.116401  8089 leader_election.cc:403] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.128703  8265 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:26.085214 12010 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.135011  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.137614  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.138378  8808 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:26.142239  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.151901  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.153308  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:26.143975  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.144388  8118 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:26.043955  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:26.147295  8810 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:26.121824 12007 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:26.129629 11659 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:26.121706 12004 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:26.159745  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.160657  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.161275  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.129561 11965 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.164938  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:26.189590  8802 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:26.189916  8803 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:26.185810  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 322260us
I20260709 13:04:26.192175  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.192741  8197 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:26.195171  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.195218  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.196587  8195 raft_consensus.cc:2410] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:26.196031  8192 raft_consensus.cc:2410] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:26.197922  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.198539  8195 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:26.199357  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.199872  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.200316  8195 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:26.201042  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.201318  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.201925  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.202603  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.203387  8200 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
W20260709 13:04:26.158584  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 114712us
I20260709 13:04:26.186401  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:26.189339  8118 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:26.207327  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:26.206795  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:26.207901  8807 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.208290  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.206741  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:26.206561  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:26.203374  8195 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:26.208839  8121 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:26.146076 12015 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.219832  8118 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:04:26.220198  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 287657us
I20260709 13:04:26.224926  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:26.150908 12010 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:26.228451  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:26.227391  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 209691us
I20260709 13:04:26.184096 11900 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:26.234400  8272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
W20260709 13:04:26.261693  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 44703.2us
I20260709 13:04:26.184942 11862 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:26.206648 11988 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:04:26.268949  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.287727  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.286660  8272 raft_consensus.cc:606] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.269060  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:26.289510  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61123.6us
I20260709 13:04:26.290779  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:26.291369  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45446.3us
I20260709 13:04:26.289386  8272 raft_consensus.cc:614] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:26.293901  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.158669 11936 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.294626  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.295584  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.227072 12015 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:26.298029  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 303065us
I20260709 13:04:26.304028  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:26.262626 12010 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.308282  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:26.263129 11912 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.165031 11788 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:04:26.326201  8117 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:26.292413 11988 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:26.227458 11925 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:04:26.188278 12008 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.311137  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:26.159271 11797 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.311892  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.296980 11818 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:26.308861  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 155614us
I20260709 13:04:26.338654  8120 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:26.260224 11989 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.319737  8807 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:26.329572  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:26.340174  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.289248  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.209249 11904 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:04:26.294976 11970 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.226873 11965 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.310014  8238 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.340312  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.311367 11946 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.357098 11946 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.360298 11837 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:26.360587 11946 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.311122 11971 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.314698 11975 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:26.361511 11971 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:26.233422 11974 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:04:26.362038 11971 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.315456 11912 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.363288 11912 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.306998 12015 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:26.366642  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 206504us
W20260709 13:04:26.367265  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52667.1us
I20260709 13:04:26.314257 11862 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:26.369563 11862 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:26.369972 11862 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:26.372382  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62430us
I20260709 13:04:26.315166 11911 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.320618 11843 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.361615 11975 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:26.373255 11946 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.374017 11975 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:26.371821  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:26.375203 11946 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:26.374995  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:26.288569 11934 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:26.379110 11946 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.374445 11911 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.390017 11911 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.392665  8122 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:26.399570 11971 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.402751 12015 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.405915  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.403410 11971 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:26.347565 11777 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.338969 11818 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.327893 11960 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:04:26.351116 11970 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.418143 11783 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.396337 11692 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.349979 12022 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:04:26.420446 11991 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:26.432705 11783 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.442368 11783 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.423755 11812 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.444764 11812 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.445124 11812 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.450443  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.450742 11960 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:26.451193 11960 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.451540 11960 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.432557 12004 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:26.458655 12004 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.461710 12015 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:26.424486  8265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1708) took 3158 ms (client timeout 2807 ms). Trace:
W20260709 13:04:26.462954  8265 rpcz_store.cc:269] 0709 13:04:23.265967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.266091 (+   124us) service_pool.cc:224] Handling call
0709 13:04:26.424328 (+3158237us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b5400076554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:26.424420 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6560772992}
I20260709 13:04:26.348538 11989 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:26.409125 11971 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:26.424027 11777 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.433916 11692 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.439679 11797 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:26.431738 11818 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.428233 11988 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.422624 11965 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.432969 11970 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.466131 11989 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.500815 11777 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.504576 11692 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.555920  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.505031 11988 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.507031 11971 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:26.579438  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 239323us
W20260709 13:04:26.576969  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 205268us
I20260709 13:04:26.516431 11965 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.580745  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:04:26.582952  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 242717us
I20260709 13:04:26.584785  8091 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.586090  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.586817  8121 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:26.588318  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 214493us
I20260709 13:04:26.590903  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:26.593364  8118 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:26.594408  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:26.594506  8121 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:26.594592  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:26.595468  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.596196  8121 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:26.600389  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:26.600723  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.600966  8091 leader_election.cc:400] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12.
I20260709 13:04:26.601967  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:26.602198  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:26.603016  8265 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:26.604074  8091 leader_election.cc:400] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:26.604943  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.594950  8118 raft_consensus.cc:2376] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12. Re-sending same reply.
I20260709 13:04:26.606849  8118 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:26.607277  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:26.612605  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:26.628611  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:26.580687 11988 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.634927  8125 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:26.632179  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:26.632508  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 327782us
I20260709 13:04:26.632876  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:26.636125  8811 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:26.637790  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:26.597638 12012 consensus_meta.cc:287] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 13:04:26.641539  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.582314 11965 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.637240  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.606055 12029 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:26.634333 11987 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.001s
I20260709 13:04:26.629528 11904 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:26.665859  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.638487 12039 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:26.630759 11900 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:26.639030 12015 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:26.630095 11995 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:04:26.640479 11936 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.699658  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:26.711803  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 103707us
W20260709 13:04:26.712517  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 112194us
I20260709 13:04:26.657469 11965 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:26.690702 11999 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:26.653630 12003 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.652048 12036 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:26.697790 12008 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:26.704490 12029 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.727877  8238 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:26.652474 12012 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.698418 11904 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:26.732053  8091 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:26.732846 11936 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:26.716073 12040 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.702980 12042 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.652621 11844 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:04:26.766078 12030 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:04:26.699232 12039 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:26.767226 12039 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.768455 12039 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:26.735704 12021 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:04:26.703697 11987 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:26.734931 12020 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:04:26.771505 11987 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.762868  8021 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.774416  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.774981  8194 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.753257 11936 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:26.776376 11936 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:26.776859 12046 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.777268 12046 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.777631 12046 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.778560  8119 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:26.778748 12012 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:26.724869 11971 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.756774  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:26.760123  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:26.757462 12023 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:04:26.762324 12027 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:04:26.754601 11904 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:26.836406  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 200632us
W20260709 13:04:26.834549  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77827.1us
I20260709 13:04:26.837430  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:26.838507  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43621.5us
I20260709 13:04:26.838605  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.781880 12042 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.735159 11900 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.835469 12012 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:26.844412 12042 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:26.835692 12032 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.202s	user 0.002s	sys 0.000s
I20260709 13:04:26.850150 11995 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:26.855001 11995 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.855355 11995 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.856002 11862 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.858039 11862 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:26.852258 12059 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.859594 12059 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:26.862006  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.886945 12059 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.795212 11844 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.889663 11844 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.890019 11844 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.893528 12040 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:26.893998 12040 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.894337 12040 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.895159 11998 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:26.895510  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:26.896087  8192 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.896677 12012 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:26.895689 11998 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.897555 12052 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:26.898733 12052 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:26.899088 12052 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:26.787444 12033 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:26.905845  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 43900.8us
I20260709 13:04:26.906742  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.907630  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.910194  8166 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.913645  8194 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:26.757642 11911 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:26.906585 12010 consensus_meta.cc:287] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.579s	user 0.004s	sys 0.004s
W20260709 13:04:26.919340  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.007s	sys 0.006s
W20260709 13:04:26.924837  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.006s
I20260709 13:04:26.912554 12022 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:26.925109  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 635908us
I20260709 13:04:26.837069 11989 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.928622  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:26.905104 12052 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.834169 11975 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.905198 11904 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.837491 11960 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.912391 11983 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.953856  8192 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:26.912781 12045 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:26.917603 11912 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.554s	user 0.029s	sys 0.016s
I20260709 13:04:26.980199 12052 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:26.985875 12056 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:04:26.987983 12059 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:26.991365 11783 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.004s
I20260709 13:04:26.991793 11783 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:26.941030 11946 consensus_meta.cc:287] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.002s
W20260709 13:04:26.948834 11430 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.874s	user 0.006s	sys 0.002s
I20260709 13:04:26.949406 12022 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:26.918227 11812 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.953500 11983 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:27.012672 11983 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.979380 11818 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.013132 11998 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.013934 11971 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:27.014402 11911 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.014621 11971 consensus_queue.cc:1243] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:27.015231 11783 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.015944 11971 raft_consensus.cc:2764] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:27.014525 12059 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.017056 11989 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.005723 11946 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.016958 11818 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:26.946483 11936 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.948776 11777 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:26.926112 12010 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.945585 11692 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.956418 12012 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:26.994386  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 266055us
I20260709 13:04:27.553449 11818 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.554659 11843 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.554514 11818 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.464459  8266 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:27.555542 11843 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.557915 11818 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.558477 11843 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.483911  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:27.560002  8265 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:27.560709 11818 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:27.561715  8272 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:27.422461  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2028) took 1487 ms. Trace:
I20260709 13:04:27.563114  8123 rpcz_store.cc:276] 0709 13:04:25.935138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.935242 (+   104us) service_pool.cc:224] Handling call
0709 13:04:25.935517 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:25.935722 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:25.935741 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:25.936279 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:04:26.291920 (+355641us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:26.297786 (+  5866us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.309302 (+ 11516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.309384 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:27.286610 (+977226us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b18001d40a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:27.421438 (+134828us) raft_consensus.cc:1685] finished
0709 13:04:27.421684 (+   246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.422023 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11235,"prepare.queue_time_us":5723,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":49526,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":37792,"spinlock_wait_cycles":8786304,"thread_start_us":318432,"threads_started":1,"wal-append.queue_time_us":447640}
I20260709 13:04:27.565133 11692 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:27.435464  8122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2015) took 1579 ms (client timeout 1644 ms). Trace:
W20260709 13:04:27.420281  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.438109  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.436431  8124 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:27.458288  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.019s	sys 0.009s
I20260709 13:04:27.567495  8116 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:27.428100  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:27.433099  8119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2017) took 1555 ms (client timeout 1907 ms). Trace:
W20260709 13:04:27.077672  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 155060us
I20260709 13:04:27.472836  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:27.438510  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2033) took 1500 ms. Trace:
I20260709 13:04:27.182449 11844 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:27.278681  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 641472us
I20260709 13:04:27.432039  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1858) took 1235 ms. Trace:
I20260709 13:04:27.533843 11413 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:27.593400  8122 rpcz_store.cc:269] 0709 13:04:25.855694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.855820 (+   126us) service_pool.cc:224] Handling call
0709 13:04:27.434977 (+1579157us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400299354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:27.435292 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232593664}
I20260709 13:04:27.027776 11812 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:27.613536  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.024s	sys 0.018s
W20260709 13:04:27.593994  8119 rpcz_store.cc:269] 0709 13:04:25.877087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.877550 (+   463us) service_pool.cc:224] Handling call
0709 13:04:27.432570 (+1555020us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400393854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:27.432860 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068892544}
I20260709 13:04:27.594583  8117 rpcz_store.cc:276] 0709 13:04:25.937853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.989938 (+ 52085us) service_pool.cc:224] Handling call
0709 13:04:27.438073 (+1448135us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54000e42d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:27.438296 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591315200}
I20260709 13:04:27.594859  8200 rpcz_store.cc:276] 0709 13:04:26.196066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.204082 (+  8016us) service_pool.cc:224] Handling call
0709 13:04:26.204439 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:26.205077 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:26.205106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:26.205530 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:04:26.588703 (+383173us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18001c3480. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:04:26.703463 (+114760us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:26.703554 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.703649 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:27.431284 (+727635us) raft_consensus.cc:1685] finished
0709 13:04:27.431325 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.431751 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":18965,"spinlock_wait_cycles":12369280,"thread_start_us":109470,"threads_started":1,"wal-append.queue_time_us":789481}
I20260709 13:04:27.616323  8118 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:27.622422  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:27.278585  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 631436us
I20260709 13:04:27.622370  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.308282 11746 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:27.625253  8117 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:27.631482  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.286381 11659 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:27.632937  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:27.631932  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:27.633524  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:26.937296 12003 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.961863 12045 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:27.307561 12028 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.894s	user 0.002s	sys 0.000s
W20260709 13:04:27.306074 12039 consensus_meta.cc:287] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.000s
I20260709 13:04:27.631956  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 687) took 1813 ms. Trace:
W20260709 13:04:27.251845 12017 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.834s	user 0.001s	sys 0.000s
I20260709 13:04:27.638368  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.279304 11925 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:27.640769  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.030535 12022 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.021689 12064 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:27.024864 11960 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.029896 12065 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:27.650372  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.651717  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:27.651378 11746 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:27.654458 11659 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:27.024928 11983 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.655892 11659 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.195626 11904 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:27.651335  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.006s	sys 0.022s
I20260709 13:04:27.194199 12040 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:26.961678 11912 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.666577 11844 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.666961 11912 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.667837 11975 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.669735 12051 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.669855 11837 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:27.670704 12051 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.670856 11837 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.077610 11430 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:27.674638  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.006s	sys 0.023s
I20260709 13:04:27.652004 12052 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.657473 12045 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.651850 11908 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:27.675083  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2133) took 1653 ms. Trace:
I20260709 13:04:27.676676  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:27.678100  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:27.673154 12051 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.680066  8124 rpcz_store.cc:276] 0709 13:04:26.021320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.024558 (+  3238us) service_pool.cc:224] Handling call
0709 13:04:27.435834 (+1411276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:27.615392 (+179558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.650145 (+ 34753us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400299350. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:27.675017 (+ 24872us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3244547456}
I20260709 13:04:27.683575  8117 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:27.685560  8118 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:27.686013  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2157) took 1082 ms. Trace:
I20260709 13:04:27.687417  8191 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:27.687625  8124 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:27.687883 11659 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:27.688841  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2242) took 1548 ms. Trace:
I20260709 13:04:27.659165 12004 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:27.657414 11413 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.108366 11970 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.019305 12042 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.691736  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:27.692728 11946 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.695740 12010 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.686365  8116 rpcz_store.cc:276] 0709 13:04:26.597759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.690671 (+ 92912us) service_pool.cc:224] Handling call
0709 13:04:26.714349 (+ 23678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:27.625104 (+910755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.658693 (+ 33589us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540033bb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:27.680073 (+ 21380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960877824}
I20260709 13:04:27.696388 12040 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.696578 11925 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.023687 11995 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.705837 12065 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:27.702641  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2240) took 1945 ms. Trace:
I20260709 13:04:27.707787 11413 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.703831 11746 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.705956 11925 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:27.690900  8191 rpcz_store.cc:276] 0709 13:04:26.140031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.140162 (+   131us) service_pool.cc:224] Handling call
0709 13:04:26.140433 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:27.687939 (+1547506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.688596 (+   657us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400363654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:27.688768 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3525423360}
I20260709 13:04:27.713608  8122 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:27.704010 12042 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.707100 12065 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.714882  8195 raft_consensus.cc:2368] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
W20260709 13:04:27.689086 11965 consensus_meta.cc:287] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.955s	user 0.032s	sys 0.045s
I20260709 13:04:27.707168  8198 rpcz_store.cc:276] 0709 13:04:25.757624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.767006 (+  9382us) service_pool.cc:224] Handling call
0709 13:04:25.767327 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:25.782899 (+ 15572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:25.782931 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:25.783503 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 13:04:26.186072 (+402569us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:26.399313 (+213241us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.714767 (+315454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.714846 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:27.251204 (+536358us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:27.700196 (+448992us) raft_consensus.cc:1685] finished
0709 13:04:27.700334 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.702476 (+  2142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27582,"prepare.queue_time_us":260468,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":175717,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":14666,"spinlock_wait_cycles":23796480,"thread_start_us":871305,"threads_started":3,"wal-append.queue_time_us":553593}
I20260709 13:04:27.715435  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:27.720155 11837 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.721038 11746 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:27.721640  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 993826us
I20260709 13:04:27.721931  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 1869) took 1166 ms. Trace:
I20260709 13:04:27.722287  8195 rpcz_store.cc:276] 0709 13:04:26.555442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.555633 (+   191us) service_pool.cc:224] Handling call
0709 13:04:27.721724 (+1166091us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002071d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:27.721863 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2615022336}
I20260709 13:04:27.717916  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:27.725445 11777 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.725752 12003 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:27.726337 12003 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:27.727442 11995 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.185310 12046 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.727627 12003 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.729597 12046 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.718011 12004 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.719048 12064 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.731186 12064 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.732685 12004 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.720300  8200 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:27.021427 11988 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.735782 11965 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.737490 11908 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.688856 11936 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.641456  8196 rpcz_store.cc:276] 0709 13:04:25.818861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.819119 (+   258us) service_pool.cc:224] Handling call
0709 13:04:25.819377 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:25.819570 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:26.196454 (+376884us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.365784 (+169330us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.646193 (+280409us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.769023 (+122830us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:27.443483 (+674460us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b18000ceaa0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:04:27.631232 (+187749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:27.631319 (+    87us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:27.631387 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.631502 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.631737 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34026,"prepare.queue_time_us":717977,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":390321,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":32672,"spinlock_wait_cycles":26304128,"thread_start_us":895864,"threads_started":4,"wal-append.queue_time_us":378415}
W20260709 13:04:27.716460  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 95642us
I20260709 13:04:27.697995 11983 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:27.715425  8164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.019s	sys 0.014s
I20260709 13:04:27.743875  8123 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:04:27.746541  8164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.019s	sys 0.014s
I20260709 13:04:27.738179 11965 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:27.738704 11900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.012s	sys 0.039s
I20260709 13:04:27.748932  8120 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:27.678996 12052 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.755647  8125 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:27.757318 12065 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:27.757862  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 97932.4us
I20260709 13:04:27.759258  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:27.759553 11837 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:27.759943 11970 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.759820  8195 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:27.759213 11974 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.760974 12055 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:27.762392 11974 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.762823 11974 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:27.749557  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 820999us
I20260709 13:04:27.768463  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:04:27.769869  8774 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 3.565s (SENT) [suppressed 17 similar messages]
I20260709 13:04:27.771072 12072 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:27.771523 12072 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:27.771880 12072 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.773480  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:27.755048 11900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.012s	sys 0.040s
I20260709 13:04:27.777714  8200 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.769076  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:27.752187 11413 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:27.779654  8118 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:27.808797  8117 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:04:27.812573  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43637.9us
I20260709 13:04:27.816457  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2152) took 1224 ms. Trace:
W20260709 13:04:27.819077  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52528.7us
I20260709 13:04:27.819375  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:27.820494  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:27.822947  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:27.823074  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:27.824347 12055 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:27.825419 12055 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.825605 12042 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.825860 12055 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.826066 12042 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.826331 12055 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.829630  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:27.831405  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:27.835700 12070 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:04:27.818326  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.816983  8120 rpcz_store.cc:276] 0709 13:04:26.592382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.593543 (+  1161us) service_pool.cc:224] Handling call
0709 13:04:26.593797 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:27.757180 (+1163383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.816163 (+ 58983us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400393d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:27.816395 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625668992}
I20260709 13:04:27.852001 12055 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.857949 11908 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.785411 11413 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:27.844038 12042 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.872154 11659 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:27.874118 11659 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:27.874965 12055 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:27.875106 11659 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:27.876523 12077 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:04:27.814424 12010 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:27.877482 11988 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.878949  8089 leader_election.cc:400] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:27.879277  8089 leader_election.cc:403] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:27.879981 11777 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:27.881649  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 71504.2us
I20260709 13:04:27.884153 11908 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.881505 12004 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:27.884701 11908 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.885468 11936 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:27.886034 11936 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:27.886158 11430 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:27.886977 11936 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:27.887779 12017 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:04:27.824445 12076 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:04:27.888269 11936 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:27.889504 12046 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.889971 12046 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:27.889806  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 79582.6us
I20260709 13:04:27.891515 12046 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.892642  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:27.885496 11995 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:27.894038 11995 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.891309 12010 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:27.898819 12010 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:27.900157 11777 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9.
I20260709 13:04:27.908937  8802 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:27.918423  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:27.876920 11925 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:27.904245 11413 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.936023  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:27.939728  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:27.940012 11960 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:27.890908 11904 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:04:27.940492  8199 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:04:27.943868  8019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 281) took 28572 ms (client timeout 15000 ms). Trace:
I20260709 13:04:27.966209 12045 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:27.963259  8019 rpcz_store.cc:269] 0709 13:03:59.371620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.371777 (+   157us) service_pool.cc:224] Handling call
0709 13:04:27.943608 (+28571831us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:19.941665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:19.944659 (+  2994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:19.944709 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:04:19.944727 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:19.945615 (+   888us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:19.945682 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:19.945715 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:04:19.976901 (+ 31186us) tablet.cc:701] Row locks acquired
0709 13:04:19.976948 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:04:19.977111 (+   163us) write_op.cc:270] Start()
0709 13:04:19.977249 (+   138us) write_op.cc:276] Timestamp: P: 1783602259977050 usec, L: 0
0709 13:04:19.977269 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:04:19.981813 (+  4544us) log.cc:844] Serialized 2450 byte log entry
0709 13:04:20.904051 (+922238us) op_driver.cc:464] REPLICATION: finished
0709 13:04:21.246265 (+342214us) write_op.cc:301] APPLY: starting
0709 13:04:21.246339 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:21.246503 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:21.246599 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:21.250928 (+  4329us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:21.251112 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:04:21.251150 (+    38us) write_op.cc:312] APPLY: finished
0709 13:04:21.251361 (+   211us) log.cc:844] Serialized 53 byte log entry
0709 13:04:21.251538 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:21.251634 (+    96us) write_op.cc:454] Released schema lock
0709 13:04:21.251674 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:21.252015 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:21.252050 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":270395,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":341960,"apply.run_cpu_time_us":2370,"apply.run_wall_time_us":5721,"num_ops":6,"prepare.queue_time_us":99427,"prepare.run_cpu_time_us":16947,"prepare.run_wall_time_us":367080,"raft.queue_time_us":150096,"raft.run_cpu_time_us":28896,"raft.run_wall_time_us":368451,"replication_time_us":889865,"thread_start_us":716744,"threads_started":4,"wal-append.queue_time_us":365001,"wal-append.run_cpu_time_us":14981,"wal-append.run_wall_time_us":1912056}]]}
I20260709 13:04:27.905280 12004 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.946373 11975 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:27.949874  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:27.913507 11837 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:04:27.986630  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:27.987753  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54169.6us
I20260709 13:04:27.912464 12071 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:04:27.990348  8121 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:27.993016  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.000078  8193 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:28.000653 12004 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.003037 12004 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.004444 12072 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.005482  8199 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:27.970079 12052 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.000378 12051 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:28.016016 12051 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:27.998420  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:27.997473  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.020558  8194 raft_consensus.cc:2410] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:27.964915 12022 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.036748  8200 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:28.030553  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:28.062276  8774 leader_election.cc:336] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.581s (SENT)
I20260709 13:04:28.051366  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:28.076387  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 251264us
I20260709 13:04:28.027443  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 487) took 1064 ms. Trace:
I20260709 13:04:28.078284  8121 rpcz_store.cc:276] 0709 13:04:26.954431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.429855 (+475424us) service_pool.cc:224] Handling call
0709 13:04:28.018331 (+588476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:28.041973 12012 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:28.064352 12064 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.087373 11844 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.084918 12012 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:28.087937 12012 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.091241  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:28.021080 11925 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:28.029052  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.044108 12072 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.094300  8196 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.043445 12045 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.079733 12052 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:28.045548 11975 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:28.062093 12046 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.115335  8199 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:28.117947  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 214719us
I20260709 13:04:28.118270  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.120132  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.120282  8805 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.087973 11844 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:28.122170  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.106570 11818 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:28.043727 11974 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.105741 12052 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:28.093946 11904 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:04:28.126672  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:28.129493 12052 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:28.133162  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 109184us
I20260709 13:04:28.133561 11975 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.135107  8807 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:28.135820  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.136545 12051 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.137266 11974 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.138015 11908 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.139029  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.139741  8265 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:28.139935 12046 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.141747 11912 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:28.142164 11912 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:28.145949  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.146731  8806 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:28.147346  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.148099  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:28.122952 11746 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:28.128198 12045 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:28.165179  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.164530  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:28.150370 12072 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:04:28.176108  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.157553 12042 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:28.180621  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 133814us
I20260709 13:04:28.181048  8272 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:28.197665 12082 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:04:28.203044  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:28.172276 11777 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:28.178936 12051 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.206178  8198 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.231417  8194 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:04:28.231732  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 103548us
I20260709 13:04:28.233165  8810 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.233397  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.233587  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:28.234129  8804 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:28.235321  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.235633  8266 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.236812  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.237578 12022 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.177770 12071 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:04:28.250181 12072 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:28.250617 12072 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:28.251595 12072 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.230393  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.226418 11777 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:28.227969 11988 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:28.234026 11844 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.185046 12045 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.272333  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.273018  8268 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.229671 11904 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:28.266568  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.275825  8269 raft_consensus.cc:2393] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.276969  8196 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:28.284193  8774 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.855s (SENT)
W20260709 13:04:28.283821  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 59124.5us
I20260709 13:04:28.287456 11844 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.287897 11844 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.289415 11844 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:28.291093  8194 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:28.285591  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.277493 11904 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:28.286936 12072 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.285246 11988 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:28.314239  8267 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:28.292632 12004 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.314522  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:28.304111 12093 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:04:28.294664 12071 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:28.320259  8266 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:28.304337 12090 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:28.321586  8194 raft_consensus.cc:2393] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 6: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:28.307814 11904 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.240310 12061 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:04:28.328006  8270 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.328245 12061 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:28.328601 12061 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:28.329555 12061 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.330814 12061 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:28.331369  8805 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:28.334590  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.334857 12045 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:28.335366  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 123985us
I20260709 13:04:28.337425  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:28.337846 11777 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.338691  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:28.339083 11912 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.340453 11912 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.341003 11995 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:28.237473 12007 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:04:28.322906 12004 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.341929 12007 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:28.342329 12007 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:28.342465  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:28.343197 12007 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:28.343576  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65223.9us
I20260709 13:04:28.340663 12042 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.344913  8192 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:28.345065 11818 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:28.345818 12046 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:28.346381 11843 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:28.346778 11843 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:28.347746 12004 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.343446  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.348850 12064 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.350406  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.351025  8198 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:28.344307  8774 leader_election.cc:336] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.912s (SENT)
I20260709 13:04:28.352715  8265 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:28.347569 11843 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.350685  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.308897 12065 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.356516  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:28.357570  8269 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.358336  8196 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:28.358394  8272 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:28.346189 12046 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:28.358937  8774 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.344338 12007 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.375419  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.387991  8268 raft_consensus.cc:2410] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:28.359853 12003 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:28.392150  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:28.395121  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 109596us
I20260709 13:04:28.368245 11843 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.411978 12010 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:28.412348 12012 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.367995 12046 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.412843  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.361860 11995 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:28.415372 12102 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:28.415846  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.417337  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.417588  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:28.418005  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 73732.8us
I20260709 13:04:28.418206  8121 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:28.418812  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.072s (SENT)
I20260709 13:04:28.419255  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.420004 11746 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:28.424386  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.430641  8198 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.431046  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.431748  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.432274  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.432647  8195 raft_consensus.cc:2410] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:28.433001  8192 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:28.433306 11746 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:28.433629 11940 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:28.434689  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.435464  8191 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:28.435966 11746 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:28.436350 11746 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:28.437219 11746 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.438169  8194 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:04:28.434634 11940 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:28.438421 11746 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.438942 11940 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:28.435585  8198 raft_consensus.cc:2410] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:28.439937 11940 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.441066 11940 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:28.438745 11413 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.424957 12055 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:28.390645 12065 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.431810  8193 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:28.442878 11413 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.360126 11936 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:04:28.438534  8194 pending_rounds.cc:85] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:04:28.443940 11988 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.433763  8200 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.448288  8267 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:28.448745  8265 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.449127  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.450117  8274 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.451486  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.460366  8270 raft_consensus.cc:2410] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:28.449528  8266 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:28.455065  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 94459.2us
I20260709 13:04:28.449682  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:28.452091  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.366315 11900 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:28.393146 12004 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:28.467099  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.467350  8191 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:28.469130  8121 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:28.443969  8194 pending_rounds.cc:107] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:04:28.470186  8194 raft_consensus.cc:2889] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:28.369729 12052 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.415182 12046 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.472183  8272 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.471369  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:28.478322  8200 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:28.476711  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.481747 12012 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.485677  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.486214  8123 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.486619  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.487267  8804 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:28.487522 11837 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:28.489197 11925 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:04:28.490159  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.490801  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.443430 12065 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.493688  8806 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
W20260709 13:04:28.494801  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.498353  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.499125  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.466521 12102 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:28.471426 12042 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:28.507503  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.474761 12054 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:28.472944 12004 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.509702  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.510143  8088 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:28.490088 11925 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:04:28.512789  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:28.521327  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 46522.9us
I20260709 13:04:28.513136  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.524004  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.474967 12055 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:04:28.524816  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.525517  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.525826  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.526341 11925 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:28.495642 11908 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:28.526752 11925 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:28.527031  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:28.522048  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.527698 11925 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.528332  8200 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.447675 11904 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.529475  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:28.530138  8805 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:28.521133 11900 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.529102 11925 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.524735  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.536433  8272 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:28.527060  8266 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.527192  8119 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.533653 11908 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:28.538568 12055 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:28.538834  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:28.539481  8117 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:28.540596 11904 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.538595 11908 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.541334  8269 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:28.541746 11908 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.521464 12071 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.523406 12054 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.525408 12065 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:04:28.543538 12065 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:28.543892 12065 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:28.545588  8166 leader_election.cc:336] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.503s (SENT)
I20260709 13:04:28.546025  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:28.547164  8166 leader_election.cc:336] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.595s (SENT)
I20260709 13:04:28.547513  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:28.548170 12064 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:28.548849 12064 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:28.542403 12054 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.550426  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.552461  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.558310  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.558959  8265 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:28.542414 12071 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.559847  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.560582  8265 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.560724 12071 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:28.561746  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.562974  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.564018  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.567298 11900 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.567880 12055 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:28.568742 12055 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.569587 11777 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:28.525398  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.570009 11777 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:28.570426 11777 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.570942  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.571681  8273 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.572357  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.573001  8273 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.545825  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:28.573554  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 108934us
I20260709 13:04:28.574483 12108 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:28.575816  8088 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:28.577056  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.579375  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.589934  8804 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:28.579905  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.580821  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.580847  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.581511  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.581169  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:28.591517  8805 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:28.565133  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.594488  8266 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.533161  8121 raft_consensus.cc:2393] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:28.582217  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.595382  8803 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.582551  8808 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.583519  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.544798 12065 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.588603 11837 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:28.617560  8192 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.563819  8123 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:28.623045  8269 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:28.615839  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:28.615671 12054 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.625542  8809 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:28.626353 12003 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:28.626813 12003 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:28.627905 12054 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.627808 12003 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.521102 12004 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.630580 12010 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:28.631758 12010 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:28.632324 12010 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:28.602104  8272 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.603063  8807 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.635843 12010 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.602293  8200 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:28.603302  8270 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 6.
I20260709 13:04:28.608079  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.648006  8802 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:28.609910  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.610553 11659 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:28.610998  8274 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.611241  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.651021  8805 raft_consensus.cc:2410] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:28.611662  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:28.611999  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.613178  8265 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:28.614121 12065 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:28.614743  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.658735  8273 raft_consensus.cc:2393] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:28.615505  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.569839 12055 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:28.633564  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.633774  8120 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:28.629273 12003 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.599987  8810 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:28.581445 11777 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:28.557205  8163 connection.cc:256] RPC call timeout handler was delayed by -2.2279843149999579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 13:04:28.649634  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.656905  8119 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:28.661439  8266 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:28.665856  8166 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.644s (SENT)
I20260709 13:04:28.669636  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:28.669972  8166 leader_election.cc:336] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.644s (SENT)
I20260709 13:04:28.671031  8191 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:28.671614  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.672135  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.672469 11837 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:28.667541 11659 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:28.673485  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.673969 11659 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:28.674780  8123 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:28.672734  8266 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:28.675640  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:28.676203  8117 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:28.818607 12052 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:28.795732  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:28.819968  8121 raft_consensus.cc:2410] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:28.677306  8803 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:28.796097  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:28.820560  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 112022us
I20260709 13:04:28.806766  8273 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.676362  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:28.799568  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.815641  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.824039  8200 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:28.824242  8266 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:28.830144  8118 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:28.794078  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.832453  8191 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:28.802316  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.836745  8124 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.766995  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:28.767318  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:28.838179  8274 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.801450  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.697665  8119 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.676784  8122 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.843382  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:28.800273 12100 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:04:28.661710 11746 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.190s
I20260709 13:04:28.852911  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.853076  8116 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.853718  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.856142  8192 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.861506  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:28.862082  8806 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:28.862809  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.829479 12010 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.673326 11837 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:28.871762  8195 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.676591 11988 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.881798  8123 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:28.883965  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:28.861665  8071 placement_policy_util.cc:248] tablet ccbf67588374458ebbd07bc5aeeb3b5a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:04:28.667375 12054 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.203s
I20260709 13:04:28.671797 11908 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.201s
W20260709 13:04:28.895349 12114 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:28.895715  8198 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:28.896309 12109 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:04:28.871410 11837 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:28.897950 11988 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:28.908681  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.909549  8124 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:28.709059 12012 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.174s
W20260709 13:04:28.913725  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.889245  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:28.917819  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.901595  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:28.917204  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:28.928586  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.929425  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:28.931388  8200 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:28.934834  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:28.939852  8809 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
W20260709 13:04:28.963617  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:28.970171  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:28.973166  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 71742.9us
I20260709 13:04:28.975752  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:28.914698 12064 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:04:28.975979 11983 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:29.001438  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:28.998348  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.999454  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:29.006101  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.006990  8270 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:28.976809 11777 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.010016  8265 raft_consensus.cc:2410] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:29.018023  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:29.003593 12099 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.580s	user 0.011s	sys 0.012s
I20260709 13:04:29.026098  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.033950  8273 raft_consensus.cc:2393] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:29.039451  8163 connection.cc:256] RPC call timeout handler was delayed by -1.4674843149999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2959s for a response
W20260709 13:04:29.040184  8163 connection.cc:256] RPC call timeout handler was delayed by -1.3429468150000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:04:29.040731  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2916468149999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:04:29.041215  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2826468149999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:04:29.041652  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2232468149999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:04:28.996723 12042 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:04:29.015045 11983 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:29.046608  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 72703.5us
W20260709 13:04:29.047314  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2106468149999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 13:04:29.048840  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0594468150000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:04:29.049260  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0342468149999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:04:29.052142 11746 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:29.052532 11746 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.054354  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:29.054491  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.055387  8123 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:29.040601 11900 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:04:29.055797 12106 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:04:29.056906  8116 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:29.054239 12004 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:28.976639 11837 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.046566 11988 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.092550 12042 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:29.107774  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:29.108557  8200 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 6.
I20260709 13:04:29.109695  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:29.111140  8195 raft_consensus.cc:2410] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:29.101275  8121 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:29.108440  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:29.111289  8200 raft_consensus.cc:2393] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:29.086323 11777 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:29.126117  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.149629  8199 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:29.129681 11940 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:29.126904  8775 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.158794  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.159019  8268 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:29.145406  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:29.152374  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:29.158648  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.144831  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:29.156136  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 104412us
I20260709 13:04:29.165091  8811 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:29.126042  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:29.169471  8197 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:04:29.170321  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.169133  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.171690  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.170943  8266 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:29.174198  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.086670 11925 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:04:29.172247  8118 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:29.176896  8273 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:29.128716 12054 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:29.159715 11904 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:04:29.177490  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:29.131202 12119 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:04:29.178489  8120 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:29.179299  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.150918 12126 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:29.130333 12120 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:04:29.181041  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:29.195804 12003 consensus_meta.cc:287] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.533s	user 0.003s	sys 0.004s
I20260709 13:04:29.178900  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.197482  8192 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:29.198225  8193 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:29.195760  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:29.202306  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:29.196293 11912 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:29.183058  8123 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:29.127022 11837 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.127288 12087 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:29.111974 12042 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:29.183485  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:29.175473  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.053304 11746 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.150717 12064 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.126573 12004 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.157966 11940 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.189051  8199 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:29.124293 12125 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:04:29.191249  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 48563.8us
I20260709 13:04:29.232997 11940 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.234017 11940 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.235917  8238 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.196332  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.222465  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:29.204718  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:29.238795  8200 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.226598 12042 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.237897  8271 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
W20260709 13:04:29.223784  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19747a1b37df480faebc96d93689cda5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:29.182673 12046 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:29.128113 11900 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:04:29.247903  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53854.8us
I20260709 13:04:29.248178 12138 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:29.228910  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.187454 11965 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:29.158600 11777 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.182156 12054 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.230958  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:29.260368  8123 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:29.233458 12129 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.193498 12055 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:29.241103  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 62844.3us
I20260709 13:04:29.241886  8192 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:29.242404  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:29.268620  8116 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:29.223042 11912 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.220865 12087 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.253509 11904 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.225674  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:29.251724  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:29.229315 11975 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:29.273072  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.280565 11975 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.229069 11413 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:29.280812  8120 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:29.281082 11413 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.281518 11413 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.261968 11965 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.255878  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:29.262928  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 195096us
I20260709 13:04:29.309298 11965 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:29.266266  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 212055us
I20260709 13:04:29.310987  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.312104  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.246165 12064 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:29.205024 12126 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.268271  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.320324  8125 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:29.279775  8118 raft_consensus.cc:2410] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:04:29.281630  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 76f64012d7a146ddb8774cc4299a38e8: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:04:29.249181 12138 consensus_queue.cc:1175] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:04:29.283952  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.341881  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.344213  8116 raft_consensus.cc:2410] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:29.260573 11960 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:29.345754 11960 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.292999 12134 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:29.293890 11975 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.294679 11988 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:29.293819 12139 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:29.296314 12004 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:29.299039 12042 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.300561  8274 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:29.295428  8191 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:29.351433  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:29.302206 12087 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.303633 11413 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.261322 11746 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.307076  8200 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:29.237932 11983 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:29.308375 12132 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:04:29.267165  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 93020.3us
I20260709 13:04:29.269551 11912 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:29.301433 12124 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:04:29.327527  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 94819.6us
I20260709 13:04:29.250834 11844 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:04:29.343426  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.346720  8267 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:29.348862  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.281750 11777 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:29.350514  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 112826us
I20260709 13:04:29.366452  8775 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.351104  8802 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.285425 11925 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:29.353492  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 131090us
I20260709 13:04:29.353404  8272 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.369364  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.320082 12064 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.319171 12130 raft_consensus.cc:2764] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:29.352542  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:29.353088  8191 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:29.356087  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:29.357882  8198 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:29.350224 12046 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:29.349390 12139 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.271189 12129 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.375093  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.386996  8238 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.386838 12003 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:29.389119 12140 raft_consensus.cc:2764] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:29.389981  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.390769  8121 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:29.391199  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.385488 11659 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:29.393508  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:29.391814 12102 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:29.395244  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:29.397055  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.397657 12144 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.398072 11904 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:29.398377 12144 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.399747 12071 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:29.399402 12139 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.400192  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.400811 12139 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.401566 12012 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:29.402308 12012 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:29.403739  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 91708.7us
I20260709 13:04:29.373791 12064 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.360072 11988 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.370111 11940 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.410322  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:29.412698  8193 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:29.365376 12004 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.409036  8191 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.391480 11908 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:29.400240 12071 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.398599 11904 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:29.421128  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 65118.4us
I20260709 13:04:29.403474 11659 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:29.401263 12102 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.419552  8191 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.386469 12125 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:29.407379 12003 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:29.369566 11925 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.427660 11659 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.429498  8163 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.368058 12054 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:29.441938 12138 consensus_queue.cc:1175] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 13:04:29.442281 12071 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:29.443833  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.444516 12130 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:29.444947 12130 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:29.445295 12130 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.443892  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:29.432303 11988 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.433692  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:29.433831 11413 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.433511 11904 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.423125  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.453476 12102 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:29.453890 12102 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.454216 12102 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.458218  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:29.458791 11925 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.460557 11925 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.413841 12144 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:29.449107  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.461966 12140 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:29.462626 12140 raft_consensus.cc:2764] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:04:29.463862  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:29.464730 12140 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:29.465091 12140 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:29.465430 12140 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.410002 12046 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.467344 12046 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.449456 12003 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:29.483459  8802 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:29.487623  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:29.492767  8807 raft_consensus.cc:2410] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:29.469869  8267 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:29.504186  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 79208.2us
I20260709 13:04:29.415169 11844 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:04:29.469319 12010 consensus_meta.cc:287] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.000s
I20260709 13:04:29.425140 11908 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:29.426385 12125 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:29.511029  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 109511us
I20260709 13:04:29.520161  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.511576  8191 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:04:29.512878  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 125942us
I20260709 13:04:29.485074 12004 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.510948  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.474370 12129 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.525111  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.470660 12102 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.528183 12130 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.407420 11960 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.479809 12012 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:04:29.523039 12125 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.552048  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.470690 12003 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.530651 11844 consensus_queue.cc:1243] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:29.544124 12004 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.529569 11777 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:04:29.566386  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 102592us
W20260709 13:04:29.569036  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 22c63c7039644c089bf014466158ac6b: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:29.571178 12151 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:04:29.572783 12131 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:29.573437  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.576052 12126 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:29.576243 12065 consensus_meta.cc:287] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.913s	user 0.009s	sys 0.001s
I20260709 13:04:29.577504 11908 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.585747  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.587549 12102 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.588220 12065 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:29.588644 12065 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:29.588989 12065 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.589274  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:29.589819  8198 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.594115 11988 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:29.594530 11988 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:29.587641  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:29.597811  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 72783.2us
I20260709 13:04:29.599562  8198 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:29.601027  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.602576  8194 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:29.604398  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.563529 12071 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.573163 12131 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:29.609011  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet d4d62387bcf94eaaaf201aeca2c2a48f: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:29.563403 11975 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:29.605546 12146 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:04:29.613657 12130 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.577453 12087 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.612226  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:29.614342 12129 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.619095 12147 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:29.622948  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.565461 11659 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:04:29.630088  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.630616  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 113665us
W20260709 13:04:29.631916  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.632834  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45278.4us
I20260709 13:04:29.603745 12150 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.611896 11975 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:29.635571  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.916s (SENT)
I20260709 13:04:29.616930 12004 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:29.616966 11844 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.638830  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.645026  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.646036 11413 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:29.611812 12046 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:04:29.647677  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.622489 12147 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:29.646669 12145 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.003s
I20260709 13:04:29.650876  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.638230 12151 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:29.640436 11975 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.649462 11413 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.665287  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:29.678135  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45664.8us
I20260709 13:04:29.681676 12065 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:29.681696  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69204.4us
W20260709 13:04:29.685442  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.685854 12065 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.685477  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.634161 12140 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.691512  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.655535 12139 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.655808 12007 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.647828 11912 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:29.700691  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 57249.8us
I20260709 13:04:29.666419 12151 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.653673 12004 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:29.720567 12004 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.714458 12165 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:04:29.721786 11413 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:29.723383 12165 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:29.702576  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2260) took 1169 ms. Trace:
I20260709 13:04:29.699684 11659 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.703915 12046 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:29.704363 12129 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.705281 12012 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:29.693936 11965 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:29.706022 12003 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:29.709789 12102 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:29.863834 12144 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:29.864252 12144 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.865010 12144 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.866196 12144 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:29.711032  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:29.712937  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.712697 12064 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.667164 12150 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:29.713423 11912 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.668231 12042 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:29.873744 12042 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:29.873916  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 8339f0f377ff4af7947c4a11b4aea010: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:29.874202 12042 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.875291 11908 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:29.875188 12064 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.875833 11908 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.876206 12071 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:29.728334  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.726217  8194 rpcz_store.cc:276] 0709 13:04:28.532779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.545540 (+ 12761us) service_pool.cc:224] Handling call
0709 13:04:29.702395 (+1156855us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540021c354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:29.702512 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306595712}
W20260709 13:04:29.799124  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 84714.1us
W20260709 13:04:29.858598  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.665401 12131 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.686322 12147 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.873636  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:29.883445 12129 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:29.883857 12129 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:29.884068 12140 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:29.884194 12129 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.760970 12151 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:29.700506 11988 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:29.869292  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 158321us
I20260709 13:04:29.891357  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.871146 12012 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:29.698251  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53298.5us
I20260709 13:04:29.892625  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.724604 12165 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.862991 12046 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.898715  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.898964  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.900388  8268 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:29.882520 12147 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.900312  8265 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.903858  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.907790  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.909092  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.909770  8272 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:29.910213  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.910394  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.912210  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.912720  8266 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.913575 12010 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:29.914011 12010 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:29.914961  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:29.915503  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.639267  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.921640  8269 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:29.921278 12010 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.923759 12010 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:29.924026 12054 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.923888 12165 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.925094  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.925529 12071 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:29.926937  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.927126 12139 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:29.928313 12139 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:29.928692 12139 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:29.930994  8266 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:29.932962  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:29.927476 12065 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:29.933609 12065 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:29.934002 12065 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.935303 11908 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:29.924170 11960 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:29.938586  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.940521 12055 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.941015 12140 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:29.941442 12140 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:29.941804 12140 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.943177  8116 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:29.943969  8122 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:29.944301  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.945495  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:29.945740 11904 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:29.946365  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:29.946817 12055 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.947705 12126 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:29.948122 12126 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:29.948475 12126 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.949662  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:29.953004  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.958395  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.901032 11659 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:29.962719  8811 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:29.925235 12165 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.964092  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:29.965323  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:29.966993  8265 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:29.968547  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:29.969120  8807 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.969595 11983 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.946159 11904 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:29.970127  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:29.970630  8810 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:29.973547  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.974529  8802 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:29.979609  8809 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:29.984139  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.985479  8810 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 7.
I20260709 13:04:29.964340 11908 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.962952 11659 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.980962  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:29.961153 12144 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:29.990401  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:29.993166  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.966873 12150 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:29.974086 12130 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:29.995486  8272 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:29.996153  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:29.997069  8271 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 7.
I20260709 13:04:29.958232 12042 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:29.995837  8272 pending_rounds.cc:85] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 6
I20260709 13:04:29.979892 11936 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.999915  8272 pending_rounds.cc:107] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:29.987165 11983 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:30.000402  8272 raft_consensus.cc:2889] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:29.990442 12055 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.992317 11659 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:30.002609  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 87978.9us
I20260709 13:04:30.019512  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:30.002173  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:30.021235  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:30.015955 12164 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.177s	user 0.007s	sys 0.004s
I20260709 13:04:29.990006 11413 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:04:30.027290  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:29.999794 12144 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.031729  8270 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:30.033183 12144 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:29.999230 12150 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.001919 12151 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:04:30.035117 12150 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.037456  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:30.038504  8273 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:30.035035  8274 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:29.998505 11908 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:30.045969  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.028350 12173 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:30.016696 11936 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.056792  8271 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:04:30.057416  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 76527.8us
W20260709 13:04:30.040767 12158 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:04:30.019258 12007 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:30.000802 12046 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.022914 12055 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:30.062033  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 104862us
W20260709 13:04:30.064144  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 98891.9us
I20260709 13:04:30.067871  8163 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:30.049705 12064 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:30.062016 12125 consensus_meta.cc:287] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.004s
I20260709 13:04:30.052495 12118 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.153s
I20260709 13:04:30.066390 11777 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.070591 12130 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:30.026683 11904 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.071102 12064 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.058575 11975 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:30.083890  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.076578 12125 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:30.085296  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58089.9us
I20260709 13:04:30.073971 12173 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:30.089315  8807 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:30.069952 12007 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.079929 11413 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:30.095985  8194 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:30.097932  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:30.096422  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.081503 11983 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:30.098857  8195 raft_consensus.cc:2368] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13.
W20260709 13:04:30.099640 12171 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:04:30.099529 12042 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:30.090152 12161 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:04:30.103144  8267 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:04:30.089960 12064 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:30.090591 12181 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:30.109400  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:30.138785  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:30.109616  8238 leader_election.cc:400] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13.
I20260709 13:04:30.110395  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:30.132728  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.110250  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:30.110312 12183 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.142702 11936 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:30.107960  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.109563  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:30.085951 11912 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:04:30.120363  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.117991  8122 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:30.140005  8265 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:30.140799  8238 leader_election.cc:403] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:30.110594  8200 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:30.110517 12174 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:30.096959 12151 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.082506 11777 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.177073  8194 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:30.182106  8273 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:04:30.184273  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 81419.1us
I20260709 13:04:30.193248 11777 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.195230  8269 raft_consensus.cc:2410] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:30.195752 12125 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.196352 12055 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.194985 12165 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:30.112713 12054 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.146032 12042 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:30.110800 12150 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.205665  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:30.112927 11908 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.137410 11413 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:30.146183 12177 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.198246 11844 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:30.233484  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:30.234138  8265 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.145642 12130 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.110700 12139 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.202888 12174 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:30.223102 12181 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:30.145829 12183 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.185859 12151 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:30.245843  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 178032us
I20260709 13:04:30.232245 12055 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:30.254057  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 68050us
W20260709 13:04:30.249449 12175 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:04:30.257249  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:30.225279 12054 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.223210 12126 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.228389 12150 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.266127  8265 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
W20260709 13:04:30.303259  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 234518us
I20260709 13:04:30.306269  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.297585  8163 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:30.306914  8192 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:30.253602 12055 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.314484  8163 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:30.231376 12177 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.321275  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.327020  8200 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
W20260709 13:04:30.309043 12145 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:30.308188 12125 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.310356 11908 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.223721 12173 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.259758 12144 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:04:30.319913 12055 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:30.362560  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 106448us
I20260709 13:04:30.257637 11983 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.367862  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:30.328754 12187 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:30.333271 12102 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:30.341876 12004 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:30.336813 12184 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:30.380910  8195 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:30.347450 12007 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:30.389420 12188 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:04:30.386304  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:30.392441 12139 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.394116 12150 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:30.388978 12129 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 13:04:30.310545 11413 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.379993 12102 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:30.376536 12042 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.391458 12126 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:30.376600 12174 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:30.414374  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46587.8us
I20260709 13:04:30.399899  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:30.439976  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.445490  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 78578.7us
I20260709 13:04:30.369323 11975 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.386137 12065 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.381911 11925 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:30.359700 11908 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.459532  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:30.461788  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:30.448699 12177 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:30.468752  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.470405  8807 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:30.446587 12187 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:30.471413  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.475342  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.476861  8200 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:30.474509  8088 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:30.475718  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:30.478523  8803 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:30.384264 12140 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.480209  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:30.485091  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:30.487675  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:30.430248 12004 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.454919 12165 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:04:30.577981  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 103549us
I20260709 13:04:30.484907 12126 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:30.449211 12181 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.454382 12129 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.570847  8198 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:30.484362 12055 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.569020 12183 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.570354 12186 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:30.471516 12144 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:30.535643  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 48043.4us
I20260709 13:04:30.587715  8088 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:30.587954  8200 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:30.476425 11925 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:30.594576  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.470608 12042 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.571487 11988 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:30.609284  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.609643  8200 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:30.589956 12139 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:30.621650  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.593668 12054 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.591166 12151 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.599263 12126 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:30.568814 12102 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.638051 12186 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:30.641148 12151 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:30.641016 12150 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:30.641542 12126 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.642127 12150 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.642465 12150 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:30.640947 12180 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:30.612311 12144 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.721453 12211 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.722445 12199 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:30.725603 12178 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:30.726131  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:30.727082 12192 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:30.727720 12208 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.750943 11908 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.730621 12004 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.732645  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:30.752146  8274 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:30.733284  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:30.753100 11965 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:30.753509 11965 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:30.754089  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.754277 11965 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.745302 12192 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.755602 12192 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:30.756548 12147 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.836s	user 0.005s	sys 0.001s
I20260709 13:04:30.757885 12055 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.753122  8267 raft_consensus.cc:2393] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:30.759405  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:30.759918  8192 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:30.675557  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 87917.8us
W20260709 13:04:30.761025  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.727964 12200 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 13:04:30.738200  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 112881us
W20260709 13:04:30.765121  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 284986us
I20260709 13:04:30.740200 12199 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:30.748239 12010 consensus_meta.cc:287] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.787s	user 0.006s	sys 0.003s
I20260709 13:04:30.749107 12178 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.750650 12208 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.762494  8810 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:30.629936 12139 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.767676  8200 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:30.679634 11659 consensus_meta.cc:287] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.003s
I20260709 13:04:30.692457 12165 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:04:30.759827 12042 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:30.671435 12202 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:30.819217  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 45302.1us
W20260709 13:04:30.819150  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49552.4us
I20260709 13:04:30.834991  8192 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:30.639147 12003 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:30.671304 12131 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:30.790534 12199 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.790746 12055 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.710127 12151 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.638872 12054 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.205s
W20260709 13:04:30.845789  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 231335us
I20260709 13:04:30.641662 12186 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.848879  8200 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:30.837723  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:30.742475 12211 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.854766 12139 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.857774 12140 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:30.858623 11925 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.809548 11659 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.860167 12144 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:30.899312  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:30.860282 11844 consensus_meta.cc:287] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.002s
I20260709 13:04:30.837750 12065 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.861490 12213 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.863791 12151 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:30.864543  8810 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:30.865625  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.846120 12202 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.842350 12003 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.877835  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.820572 12147 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:04:30.888736  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:30.892402  8122 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:30.893298  8119 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:30.913841  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:30.913981  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:30.911381  8810 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:30.918707  8120 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:30.881903 11908 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:30.920244  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:30.920347  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.923002  8124 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:30.924890  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.924223  8123 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:30.926565  8119 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:04:30.869436 12055 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.920962  8196 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:30.925534  8200 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:30.931169  8199 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:30.884754 12126 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:30.932710  8125 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:30.912317 11844 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13.
I20260709 13:04:30.885597 11936 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:04:30.913311 12003 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:30.920722 11925 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.935609  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:30.947182  8803 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:30.922415 12130 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:30.940757  8122 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:30.933456 11908 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:30.922562 12140 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:04:30.933758 12208 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:30.951500  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:30.953842  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:30.928936 12010 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:04:30.962497  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.954253 12139 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.932179 12192 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:30.955863 12130 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:30.985159  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:30.987493  8196 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:30.921278 12213 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.937582 12126 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:30.949680 11925 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.003196 12176 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.003324  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:31.003551 12218 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.004232 12213 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.004094 12218 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.004835  8196 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:31.006014  8267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:31.006683  8267 raft_consensus.cc:606] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
W20260709 13:04:31.007038 12216 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:04:31.008093 12220 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:31.011978  8118 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:31.013931 12054 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.014437 12054 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.008464 12220 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:31.018776 12055 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.019291 12055 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.019860 12055 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:31.020923 12203 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.437s	user 0.007s	sys 0.003s
I20260709 13:04:31.006238 12218 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:30.977043 12195 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:04:30.989989 12178 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.031759  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:31.031847  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 109101us
I20260709 13:04:31.038129  8091 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:31.032207  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:31.003860 12176 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.032790  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:31.041267  8803 raft_consensus.cc:2410] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:04:31.008498 11908 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.033248 12182 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:04:31.033777 12183 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.988034 12139 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.036383  8274 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:31.041216  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.047380 12147 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:31.013943 12129 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.039366  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:31.047413  8273 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:31.137953  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:31.133215  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.149187 12071 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:31.148918  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 109722us
I20260709 13:04:31.145538 12012 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:31.067813  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:31.174271  8197 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:31.149832 12176 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.588102  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.168321  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.588867  8271 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:31.589740  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.228508  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.451037  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.227633  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:31.360833  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.376086  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.229272  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.488216  8268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:31.383387  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.147746  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2287) took 1052 ms. Trace:
I20260709 13:04:31.284619  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:31.064858 12125 consensus_meta.cc:287] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.000s
W20260709 13:04:31.589998  8192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.020s	sys 0.049s
W20260709 13:04:31.147415  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 109363us
I20260709 13:04:31.282936  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.168002  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:31.218600  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:31.594017  8119 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:31.654731  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:31.590716  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2296) took 1127 ms. Trace:
I20260709 13:04:31.595055  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:31.594409  8125 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
W20260709 13:04:31.656920  8192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.024s	sys 0.049s
I20260709 13:04:31.594730  8268 raft_consensus.cc:606] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:31.656561  8198 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
W20260709 13:04:31.138243 12230 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:04:31.672060  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.674643  8120 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:31.213735 12064 consensus_meta.cc:287] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.031s	user 0.005s	sys 0.005s
I20260709 13:04:31.660956  8116 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:31.667348  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.655944  8121 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:31.149861 12055 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.589391 11936 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.665850  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:31.677268  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:31.140450 12228 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:04:31.615806  8197 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:31.653772 12010 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:31.228470  8021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 246) took 24492 ms (client timeout 15000 ms). Trace:
I20260709 13:04:31.215691  8272 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:31.057806  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:31.594543  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:31.061972 12223 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:31.138098 12186 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.658175  8268 raft_consensus.cc:614] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:31.658277  8195 rpcz_store.cc:276] 0709 13:04:30.463133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.463247 (+   114us) service_pool.cc:224] Handling call
0709 13:04:30.463511 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.475107 (+ 11596us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:30.845094 (+369987us) log.cc:844] Serialized 14 byte log entry
0709 13:04:31.025174 (+180080us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.029118 (+  3944us) log.cc:844] Serialized 26 byte log entry
0709 13:04:31.029307 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:31.029392 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.029500 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.590528 (+561028us) raft_consensus.cc:1685] finished
0709 13:04:31.590547 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.590666 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10001,"prepare.queue_time_us":482960,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1882,"raft.queue_time_us":581,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":17879,"thread_start_us":420906,"threads_started":2,"wal-append.queue_time_us":293242}
I20260709 13:04:31.221493  8023 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 11, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.059274 12185 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:31.247608 12187 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:31.740334  8023 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.676007 12125 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:31.740316  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.558760 11975 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:31.741211  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 75451.6us
I20260709 13:04:31.595551 12139 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.687305 12118 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.687602 12151 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.267053 12003 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.719224  8125 raft_consensus.cc:2368] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:31.689811  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:31.797327  8198 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:31.688074  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.685539  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:31.799871  8199 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:31.460775 12131 consensus_meta.cc:287] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.002s
I20260709 13:04:31.240248 11960 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:31.723253  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:31.724220  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:31.727039  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.686067  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.738371 12185 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:31.147537 12054 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.813514  8199 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:31.686071 12182 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:04:31.069482 12102 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.186133 12192 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.173970 12229 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:31.407678 11988 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.000s
I20260709 13:04:31.798069 12166 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.821441  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.822137  8268 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:31.068128 11659 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.734212  8119 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:31.174777  8265 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:31.219415 12126 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.216081 12241 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.175288 12012 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.589589 12177 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.217814 11983 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:31.737313  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.836611  8116 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.737789  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.738744  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:31.793643 11975 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.216646 12202 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.686451 12211 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.815598 12147 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:31.589432 12173 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:31.151155 11904 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.247570 11965 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.742605  8023 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 8, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:31.857805  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:31.173305 12150 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.003s
I20260709 13:04:31.186398 12183 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.858510 12150 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.858939  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.784834  8197 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:31.860023  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.069464 12130 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.794168  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:31.804425  8120 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.220275 12165 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.803891  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.871333  8125 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:31.804051  8118 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:31.806905  8071 placement_policy_util.cc:248] tablet ccbf67588374458ebbd07bc5aeeb3b5a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 13:04:31.785087 12174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.009s	sys 0.019s
I20260709 13:04:31.808238  8194 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:31.812057  8198 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:31.737684 12042 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:31.173792 12071 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:31.222576 12199 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.815105  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.721380 12064 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.742655 11925 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.139555 11912 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:31.817730  8122 raft_consensus.cc:2368] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:31.071074 12220 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.828032  8121 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:31.740998 12010 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.804126 12139 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.798622 12151 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.802505 11960 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:31.832908  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.834132  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.888635  8119 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:31.825635 12229 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.835314  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.835188 12177 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.816478 12181 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.817010 12054 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:31.837517  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 98854.1us
I20260709 13:04:31.655855  8193 rpcz_store.cc:276] 0709 13:04:30.095623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.095741 (+   118us) service_pool.cc:224] Handling call
0709 13:04:30.107594 (+ 11853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.197984 (+ 90390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:30.198012 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:30.223514 (+ 25502us) log.cc:844] Serialized 26 byte log entry
0709 13:04:30.356576 (+133062us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:30.356627 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.356703 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.020264 (+663561us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:31.133971 (+113707us) raft_consensus.cc:1685] finished
0709 13:04:31.133994 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.147682 (+ 13688us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18652,"raft.queue_time_us":100108,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":16824,"spinlock_wait_cycles":4023040,"thread_start_us":106751,"threads_started":1,"wal-append.queue_time_us":213490}
I20260709 13:04:31.842662  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:31.794865 12187 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.685456 12218 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.826740 12195 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:31.739609  8021 rpcz_store.cc:269] 0709 13:04:06.735862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.736020 (+   158us) service_pool.cc:224] Handling call
0709 13:04:31.228280 (+24492260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:28.199013 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:28.348293 (+149280us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:28.348346 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:04:28.348363 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:28.348747 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:28.348813 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:28.348839 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:28.349103 (+   264us) tablet.cc:701] Row locks acquired
0709 13:04:28.349146 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:04:28.349313 (+   167us) write_op.cc:270] Start()
0709 13:04:28.349462 (+   149us) write_op.cc:276] Timestamp: P: 1783602268349247 usec, L: 0
0709 13:04:28.349484 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:28.350126 (+   642us) log.cc:844] Serialized 538 byte log entry
0709 13:04:28.866733 (+516607us) op_driver.cc:464] REPLICATION: finished
0709 13:04:29.118818 (+252085us) write_op.cc:301] APPLY: starting
0709 13:04:29.118912 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:29.119039 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:29.119156 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:29.119437 (+   281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:29.119713 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:29.119754 (+    41us) write_op.cc:312] APPLY: finished
0709 13:04:29.119991 (+   237us) log.cc:844] Serialized 23 byte log entry
0709 13:04:29.120145 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:29.120219 (+    74us) write_op.cc:454] Released schema lock
0709 13:04:29.120266 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:29.120608 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:29.120637 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":794967,"reported_tablets":49,"spinlock_wait_cycles":366848,"child_traces":[["op",{"apply.queue_time_us":218571,"apply.run_cpu_time_us":1805,"apply.run_wall_time_us":1805,"num_ops":1,"prepare.queue_time_us":328682,"prepare.run_cpu_time_us":15045,"prepare.run_wall_time_us":302899,"raft.queue_time_us":260153,"raft.run_cpu_time_us":78292,"raft.run_wall_time_us":229746,"replication_time_us":472026,"thread_start_us":586194,"threads_started":4,"wal-append.queue_time_us":179495,"wal-append.run_cpu_time_us":9733,"wal-append.run_wall_time_us":1607790}]]}
I20260709 13:04:31.845487 12144 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:31.851163 12173 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.862143  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:31.862821  8274 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:31.941968  8273 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:31.864287 12150 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:31.864745  8266 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:31.865208 12183 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.865499 12126 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.834074 12012 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.949965 12126 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.858139  8023 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 9, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:31.874439  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.836383 11983 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:31.955264  8272 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:31.884800 11925 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:31.887224  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.961871  8118 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
W20260709 13:04:31.872750 12174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.010s	sys 0.020s
I20260709 13:04:31.740953 11936 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.969619  8123 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:31.970243 11936 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.889452  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.971150  8119 raft_consensus.cc:2410] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:31.971875  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.972384  8119 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:31.881549 12165 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.973845  8269 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:31.974375 12010 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.975276 12165 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.975780 12165 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.975973 12173 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:31.976181 12165 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.976820 12003 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:31.890606  8163 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.644s (SENT)
I20260709 13:04:31.891201  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.977713  8122 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:31.977531 11960 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.978798 11960 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.883409  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.895100  8268 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:31.980036 11983 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.902843  8191 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:31.875461 12071 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:31.977553  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:31.981519 12140 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:31.982745  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.983263  8121 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.917740  8116 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:31.836616 12241 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.883117 12176 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.985193  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.944864  8125 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:31.945902  8120 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:31.985796  8116 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:31.986537  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.986665  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.987073  8120 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.951653 12190 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:31.985693 12176 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:31.954990  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:31.990654  8803 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:31.990892  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 100319us
I20260709 13:04:31.882705 11912 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:31.991895 11912 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:31.992450  8163 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.869s (SENT)
I20260709 13:04:31.992877  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:31.894721 12151 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:31.880945 12042 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.995151 12042 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:31.990243 12190 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.996357 12190 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:31.997918  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.998471  8125 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.999349 12220 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:32.001145 12174 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:32.001567 12174 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:31.967900 12177 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:32.002338 12174 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.003542 12174 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:31.967087  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.964154 11925 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:31.967288  8023 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 11, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.993054 11912 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.939823 12144 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.005452  8118 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:31.973122  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:32.009500  8119 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:32.010465  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:32.011101  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2066) took 1010 ms. Trace:
I20260709 13:04:32.011404  8119 rpcz_store.cc:276] 0709 13:04:31.000756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.010225 (+1009469us) service_pool.cc:224] Handling call
0709 13:04:32.011054 (+   829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.012305  8122 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:32.012874  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2070) took 1011 ms. Trace:
I20260709 13:04:32.013211  8122 rpcz_store.cc:276] 0709 13:04:31.009451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.890971 (+881520us) service_pool.cc:224] Handling call
0709 13:04:32.012819 (+121848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.014109  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:32.007625  8120 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:31.946583 12166 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.014773  8121 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:32.015142  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2062) took 1017 ms. Trace:
I20260709 13:04:32.017377  8120 rpcz_store.cc:276] 0709 13:04:30.997671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.986303 (+988632us) service_pool.cc:224] Handling call
0709 13:04:32.015085 (+ 28782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.016301  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2058) took 1036 ms. Trace:
I20260709 13:04:32.013981 11925 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.018275  8118 rpcz_store.cc:276] 0709 13:04:30.979490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.966789 (+987299us) service_pool.cc:224] Handling call
0709 13:04:32.016246 (+ 49457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.017031  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2063) took 1019 ms. Trace:
I20260709 13:04:32.094219  8121 rpcz_store.cc:276] 0709 13:04:30.997893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.982513 (+984620us) service_pool.cc:224] Handling call
0709 13:04:32.016978 (+ 34465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.006493  8125 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:32.014714  8122 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:31.962564 12242 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.101855  8121 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:31.965031 12150 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.977767 12229 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:32.017906  8023 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.095280  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2064) took 1097 ms. Trace:
I20260709 13:04:31.944075 12218 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:32.095415  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 528) took 1067 ms. Trace:
I20260709 13:04:31.948170 12195 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:32.096623  8191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2285) took 2001 ms (client timeout 1697 ms). Trace:
I20260709 13:04:32.009832 12144 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:32.098287  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2047) took 1155 ms. Trace:
I20260709 13:04:32.008162 12042 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:32.100916  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:31.867782 12185 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.102484  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2045) took 1160 ms. Trace:
I20260709 13:04:32.136610  8121 rpcz_store.cc:276] 0709 13:04:30.942315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.101329 (+1159014us) service_pool.cc:224] Handling call
0709 13:04:32.101701 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.102257 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.102418 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.102481  8196 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:32.103942  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:31.940055 12054 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.137936  8023 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.902076 12139 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.105888  8125 rpcz_store.cc:276] 0709 13:04:30.998123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.997680 (+999557us) service_pool.cc:224] Handling call
0709 13:04:32.095225 (+ 97545us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:32.158707  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.939508 12181 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:31.956883  8774 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.508s (SENT)
I20260709 13:04:32.108608  8122 rpcz_store.cc:276] 0709 13:04:31.027835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.013884 (+986049us) service_pool.cc:224] Handling call
0709 13:04:32.095353 (+ 81469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.111649  8123 rpcz_store.cc:276] 0709 13:04:30.942876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.284387 (+341511us) service_pool.cc:224] Handling call
0709 13:04:32.098095 (+813708us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54003cfad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:32.098229 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860365696}
I20260709 13:04:32.159143  8125 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:04:32.159615  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:32.111231  8191 rpcz_store.cc:269] 0709 13:04:30.095114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.095277 (+   163us) service_pool.cc:224] Handling call
0709 13:04:32.096391 (+2001114us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400028fd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:32.096549 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4053088000}
W20260709 13:04:32.130617  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 535621us
I20260709 13:04:32.161963  8775 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:32.100274  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.135949  8120 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:32.163249  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2048) took 1220 ms. Trace:
I20260709 13:04:32.163555  8120 rpcz_store.cc:276] 0709 13:04:30.943099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.100673 (+1157574us) service_pool.cc:224] Handling call
0709 13:04:32.163196 (+ 62523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.104898  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:32.164180  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:32.164376  8118 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:32.164741  8193 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:32.165050  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2068) took 1163 ms. Trace:
I20260709 13:04:32.165465  8118 rpcz_store.cc:276] 0709 13:04:31.001218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.104679 (+1103461us) service_pool.cc:224] Handling call
0709 13:04:32.164999 (+ 60320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.165526  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 517) took 1150 ms. Trace:
I20260709 13:04:32.138145  8119 raft_consensus.cc:2376] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13. Re-sending same reply.
I20260709 13:04:32.166152  8125 rpcz_store.cc:276] 0709 13:04:31.009733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.158588 (+1148855us) service_pool.cc:224] Handling call
0709 13:04:32.158925 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:32.160020 (+  1095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.160208 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.166591  8198 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:32.142385  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 398571us
I20260709 13:04:32.101105 12183 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:32.166927  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 210089us
I20260709 13:04:32.167410 12183 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:32.102843 11983 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:32.183408  8088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.013s
W20260709 13:04:32.183903  8088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.001s	sys 0.013s
I20260709 13:04:32.162810  8116 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:32.168114  8198 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:32.166442  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 520) took 1156 ms. Trace:
I20260709 13:04:32.184845  8119 rpcz_store.cc:276] 0709 13:04:31.010436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.103701 (+1093265us) service_pool.cc:224] Handling call
0709 13:04:32.166393 (+ 62692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.168790  8121 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:32.185994  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2051) took 1242 ms. Trace:
I20260709 13:04:32.186319  8121 rpcz_store.cc:276] 0709 13:04:30.943792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.141714 (+1197922us) service_pool.cc:224] Handling call
0709 13:04:32.168622 (+ 26908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.185751 (+ 17129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.185941 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:32.095296 12166 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:32.186095  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 531421us
I20260709 13:04:32.191479  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:32.188658  8023 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 4 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 5 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:32.192883  8194 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:32.192832  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:32.195251  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:32.195899  8191 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:32.159585 12151 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.159785 12055 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.197299  8199 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:04:32.198760  8192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.068s	sys 0.054s
W20260709 13:04:32.204301  8192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.068s	sys 0.054s
I20260709 13:04:32.204934  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1922) took 1360 ms. Trace:
I20260709 13:04:32.197858  8023 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 9, leader changed from <none> to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.205370  8192 rpcz_store.cc:276] 0709 13:04:30.844210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.844334 (+   124us) service_pool.cc:224] Handling call
0709 13:04:30.844647 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:30.844841 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:30.995253 (+150412us) log.cc:844] Serialized 14 byte log entry
0709 13:04:32.204592 (+1209339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:32.204646 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:32.204700 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.204767 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.204869 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195326,"prepare.queue_time_us":157369,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":28973,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":1331573,"threads_started":3,"wal-append.queue_time_us":821329}
W20260709 13:04:32.199306  8200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.008s
I20260709 13:04:32.199663  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:32.217147  8200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.008s
I20260709 13:04:32.111146 12150 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:32.140158 12042 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.108722 12242 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:32.187558 12185 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.754827  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1936) took 1162 ms. Trace:
W20260709 13:04:32.493954  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.722743  8239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.007s	sys 0.025s
W20260709 13:04:32.924243  8239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.007s	sys 0.036s
W20260709 13:04:32.855872  8810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.015s	sys 0.028s
I20260709 13:04:32.243968  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:32.925370  8193 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:32.261183  8117 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:32.758658  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.537038  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 375125us
W20260709 13:04:32.689496  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.010s
W20260709 13:04:32.915194  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 710068us
I20260709 13:04:32.260389  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:32.918401  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.533s (SENT) [suppressed 22 similar messages]
W20260709 13:04:32.918725  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 725935us
I20260709 13:04:32.925671  8271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:32.198611 12003 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:32.926782  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.924839  8810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.017s	sys 0.030s
I20260709 13:04:32.190837 12247 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:32.198803 12010 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.259770  8023 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 10, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.014513  8271 raft_consensus.cc:606] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.014933  8271 raft_consensus.cc:614] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:32.664896 11904 consensus_meta.cc:287] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.813s	user 0.006s	sys 0.002s
W20260709 13:04:32.914564 12174 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.911s	user 0.010s	sys 0.001s
W20260709 13:04:32.855438 11983 consensus_meta.cc:287] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.000s
I20260709 13:04:32.861857 12166 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:32.260686 11975 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:32.898643 11960 consensus_meta.cc:287] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.919s	user 0.010s	sys 0.001s
W20260709 13:04:32.904898 11925 consensus_meta.cc:287] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.000s
W20260709 13:04:32.872737 12220 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.873s	user 0.002s	sys 0.006s
W20260709 13:04:32.903776 11912 consensus_meta.cc:287] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.887s	user 0.004s	sys 0.004s
W20260709 13:04:33.010037  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.049s	sys 0.124s
I20260709 13:04:32.923938  8195 rpcz_store.cc:276] 0709 13:04:31.592059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.786849 (+194790us) service_pool.cc:224] Handling call
0709 13:04:31.792070 (+  5221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:31.802065 (+  9995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:31.802095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.819384 (+ 17289us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.172231 (+352847us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:32.172272 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.172338 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.754599 (+582261us) raft_consensus.cc:1685] finished
0709 13:04:32.754619 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.754761 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5987,"raft.queue_time_us":85,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2907,"thread_start_us":336332,"threads_started":1,"wal-append.queue_time_us":743375}
I20260709 13:04:32.926993 12241 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:33.016029  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.009s	sys 0.021s
W20260709 13:04:32.610520 12012 consensus_meta.cc:287] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.002s
I20260709 13:04:33.015726  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.013684  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:32.916929 12173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.006s	sys 0.005s
I20260709 13:04:32.501273 12182 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.756760 12218 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:32.926363 12144 consensus_meta.cc:287] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.000s
I20260709 13:04:32.243129 12165 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:32.439477 12118 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:32.917538 12180 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.060336 12150 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:32.503021 12064 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:33.027635  8238 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.072s
I20260709 13:04:32.924803 11965 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.021253  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:32.534448 12251 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.045588 12266 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:32.956991  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.032718  8023 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 6, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 6 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:32.458071 11908 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:32.633605 12257 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:32.260385 12248 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:32.203251 12229 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.813s
I20260709 13:04:33.033870  8267 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:33.049075 12012 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.919684 12199 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:32.230406 12151 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.260653 12206 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.790s
I20260709 13:04:32.230809 12055 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:32.827903 12249 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.070173 12042 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.075068 12249 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.073712  8023 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.076522 12055 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.070977 12240 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.077193 12240 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.077900 12249 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:33.040608  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.049s	sys 0.124s
I20260709 13:04:33.035113 11904 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.032990 12253 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:33.078637  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 910135us
I20260709 13:04:33.078917 12253 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.079296 12139 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.079427  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:33.080737 12253 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.038266 12190 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.050330 12267 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.050051 12182 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.051425 12242 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.053493 12220 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.081406 12267 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.061141 12144 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.081940 12220 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.083262  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 1.07377e+06us
I20260709 13:04:33.019750 12054 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.083911 12220 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.057410  8122 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:33.081406 11904 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.084471  8122 pending_rounds.cc:85] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 10
I20260709 13:04:33.084782  8122 pending_rounds.cc:107] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:33.047407 12252 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.056703  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:33.056306  8116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 519) took 2046 ms (client timeout 2203 ms). Trace:
I20260709 13:04:33.018927 12010 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:33.046869 12173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.014s	sys 0.010s
W20260709 13:04:32.660012 12071 consensus_meta.cc:287] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.002s
I20260709 13:04:33.089588 12195 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.089866 12071 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.063418  8774 connection.cc:256] RPC call timeout handler was delayed by -1.0045427369999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:04:33.043159  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:33.063524  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 47869.6us
I20260709 13:04:33.020493 12003 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.065418  8238 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.074s
W20260709 13:04:33.098654  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 865967us
I20260709 13:04:33.066661  8197 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:32.917448 12258 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.039521 11925 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.100592  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58212.8us
I20260709 13:04:33.102595  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.046663 12241 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:04:33.065713 11975 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:33.068523 11965 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.068384 12266 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.085054  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2305) took 1905 ms. Trace:
I20260709 13:04:33.076725  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.120496  8196 rpcz_store.cc:276] 0709 13:04:31.179217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.231950 (+ 52733us) service_pool.cc:224] Handling call
0709 13:04:32.097130 (+865180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.137863 (+ 40733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.084855 (+946992us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400028fd0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:33.084997 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989042560}
I20260709 13:04:33.077078  8023 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 8, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 8 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:33.086020  8163 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.907s (SENT)
W20260709 13:04:33.086372  8116 rpcz_store.cc:269] 0709 13:04:31.010220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.986425 (+976205us) service_pool.cc:224] Handling call
0709 13:04:33.056103 (+1069678us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000e33d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:33.056237 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403277568}
I20260709 13:04:33.085147  8122 raft_consensus.cc:2889] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.120842  8192 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:33.085960  8195 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.122073  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:33.069257 12251 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.089107 12182 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.092093  8124 raft_consensus.cc:2368] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8.
I20260709 13:04:33.092763 12054 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.094340 12240 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.097142  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.083621 12144 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.082476 12181 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.083534 12267 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.084194 12183 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.011368 12211 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.101155 12177 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:04:33.109670 12012 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.086656 12248 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.110476 11904 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.113718 12071 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.146399  8195 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:33.101071 12195 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:33.087649 12055 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.122869 12266 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.091806 12265 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.016412 12247 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.157763 12251 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.148169 12246 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.158151 12265 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.158671 12246 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.159595 12267 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.160123 12267 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.123328  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78275.7us
I20260709 13:04:33.124691 12165 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:04:33.162184 12267 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.121668  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.071126 11908 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.128223  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.128798  8023 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 9, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:33.137934  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 51934.7us
W20260709 13:04:33.170933  8163 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.958s (SENT)
I20260709 13:04:33.170574  8023 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.138587  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:33.118851 12255 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.114773 11925 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.117359  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.134262 12042 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.142455 12211 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.179241  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.174455  8023 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.150964  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 686) took 1194 ms. Trace:
I20260709 13:04:33.150782 12055 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.151497 11965 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.118188 12253 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:33.180559  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.181393 11908 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.134768 12054 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.154623 12003 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.181993 12241 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.182403 12241 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.182519 12054 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.182816 12241 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.156210 12176 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.158967 12247 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.183023 11975 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.121011 12199 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:04:33.180375 12251 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:33.183561 11975 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.181128  8809 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.184202 12251 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.186213 12251 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.187069  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.187739  8806 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:33.188584 12151 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.189234  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.189793  8806 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:33.180598  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.190483  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.192077 12071 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:33.192288 12206 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:33.192637 12177 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:33.193009 12177 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.193334 12177 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:33.195094  8124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 523) took 2184 ms (client timeout 1849 ms). Trace:
I20260709 13:04:33.193022 12071 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:04:33.195487  8124 rpcz_store.cc:269] 0709 13:04:31.011096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.654371 (+643275us) service_pool.cc:224] Handling call
0709 13:04:33.194923 (+1540552us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540026b1d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:33.195030 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972636544}
I20260709 13:04:33.196427 12126 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.196755  8808 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:33.173859  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:33.198355  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.198980 12199 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:33.173938  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.176762 12183 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.200215  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 522) took 2189 ms. Trace:
I20260709 13:04:33.200848 12010 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.201308 12187 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.201844  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.202596 12248 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:33.202739  8117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2199) took 2313 ms (client timeout 1943 ms). Trace:
I20260709 13:04:33.193370 11904 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:04:33.203276 12176 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:33.200057  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:33.204082 12272 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.003s
I20260709 13:04:33.204334  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1779) took 2171 ms. Trace:
I20260709 13:04:33.204708  8267 rpcz_store.cc:276] 0709 13:04:31.032488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.032594 (+   106us) service_pool.cc:224] Handling call
0709 13:04:31.032867 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.070804 (+2037937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.204117 (+133313us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b5400408b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:33.204256 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4597973376}
I20260709 13:04:33.205133  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.205760  8192 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:33.205838  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.206421  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.207113  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.134819 12150 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:04:33.202903  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.148372 12139 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:33.180349  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.206719  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:33.155025 12264 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:04:33.193502 12147 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:33.174530  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 52935.1us
I20260709 13:04:33.211117  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.211670  8267 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:33.207815  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.214771 12176 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.200124 12183 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.215420  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.215992  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.216552  8269 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 6.
I20260709 13:04:33.209702 12147 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:33.218037  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.218197 12147 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.219767  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.220323  8271 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
W20260709 13:04:33.203135  8117 rpcz_store.cc:269] 0709 13:04:30.889503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.889643 (+   140us) service_pool.cc:224] Handling call
0709 13:04:31.282779 (+393136us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:33.202565 (+1919786us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54000852d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:33.202653 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394132992}
I20260709 13:04:33.221658 12010 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.200591  8122 rpcz_store.cc:276] 0709 13:04:31.010878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.159786 (+1148908us) service_pool.cc:224] Handling call
0709 13:04:33.057061 (+897275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.122134 (+ 65073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.200042 (+ 77908us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54000e33d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:33.200162 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062998400}
I20260709 13:04:33.197309 12174 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:33.205265  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1933) took 1614 ms. Trace:
I20260709 13:04:33.209128  8802 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:33.209669  8194 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:33.124221  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 205839us
I20260709 13:04:33.223196  8200 rpcz_store.cc:276] 0709 13:04:31.591215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.684585 (+ 93370us) service_pool.cc:224] Handling call
0709 13:04:31.684862 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.217583 (+532721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.217616 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:32.250520 (+ 32904us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.916587 (+666067us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:32.916625 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.916705 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.170214 (+253509us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:33.205003 (+ 34789us) raft_consensus.cc:1685] finished
0709 13:04:33.205022 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.205208 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2470,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":44,"spinlock_wait_cycles":27750144,"thread_start_us":920052,"threads_started":2,"wal-append.queue_time_us":574469}
I20260709 13:04:33.222385  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.182140 12055 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.122701 12261 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:04:33.226423  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.226538  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.227059  8198 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:33.228083  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.203116 12199 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:33.229766  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.218606  8269 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:33.230800  8124 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:33.231258  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.171379  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:33.161072 12246 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.235038  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.217831  8809 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:33.236009  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.236560  8119 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:33.235466  8811 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:33.237802  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:33.238340  8198 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.238865 12218 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:33.239303  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:33.238466  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.239727  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.240226  8271 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:33.232041 12010 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.240681  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.241118 12010 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.242882  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.240370 12253 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:04:33.240690  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.245571 12218 consensus_queue.cc:1243] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:33.246155 12218 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:33.246495 12218 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:33.240028  8200 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 7: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:33.246628  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.245509 12177 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.247148  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.211053 12211 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.245420  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.247748  8122 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:33.248490  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.248641  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:33.249250  8193 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:33.249166  8116 raft_consensus.cc:2393] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:33.250882  8124 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:33.101429 12258 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:33.175148  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 78583.9us
I20260709 13:04:33.219594 12147 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.240329  8194 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:33.258149  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.251361  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.245604  8117 raft_consensus.cc:2368] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:33.244768 12054 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:33.251840  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 134577us
I20260709 13:04:33.259745  8193 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:33.197965  8023 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:33.254014  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.263109  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.263649  8195 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:33.160187 12265 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.261171  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.263742  8267 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:33.252764  8774 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.203s (SENT)
I20260709 13:04:33.257758  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.254437  8810 rpcz_store.cc:276] 0709 13:04:31.956035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.956157 (+   122us) service_pool.cc:224] Handling call
0709 13:04:31.967758 (+ 11601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.000929 (+ 33171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.000964 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:32.001464 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.188584 (+187120us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b1800341f80. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c092a6 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c092a6 00007fbd21c09240
0709 13:04:33.010283 (+821699us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:33.143169 (+132886us) log.cc:844] Serialized 14 byte log entry
0709 13:04:33.143638 (+   469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.143754 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.143816 (+    62us) raft_consensus.cc:1685] finished
0709 13:04:33.150193 (+  6377us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.150344 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34740,"prepare.queue_time_us":223234,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":33608,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":3829,"spinlock_wait_cycles":7305216,"thread_start_us":954007,"threads_started":2,"wal-append.queue_time_us":1056129}
I20260709 13:04:33.270900  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.275823  8116 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:33.271078  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.275171  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.276764  8120 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:33.270181  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.277585  8119 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:33.279362  8271 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:33.279294  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.280192  8269 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:33.256575  8803 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:33.281759  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.282436  8269 raft_consensus.cc:2368] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:33.283951  8269 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:33.285029  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.286353  8166 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.286810  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.288808  8123 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:33.289455  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.290398  8166 leader_election.cc:400] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:33.290700  8166 leader_election.cc:403] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:33.291092  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.291705  8265 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:33.294642  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.216487 12183 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.231805 12252 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.294854  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.315514  8116 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.300473  8198 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:33.296056  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:33.316651  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 80845.7us
I20260709 13:04:33.317404  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:33.317963  8803 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:04:33.313987  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 143075us
I20260709 13:04:33.315850  8117 raft_consensus.cc:2376] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8. Re-sending same reply.
I20260709 13:04:33.313561  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.323207  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.323791  8120 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:33.294853  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.325639  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.318101  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:33.325273  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.327530  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.327952  8270 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
W20260709 13:04:33.328176  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2114069350000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:04:33.328559  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2114069350000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 13:04:33.328747  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.329198  8272 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:33.329938  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.328486  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.332687  8268 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:33.326665  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:33.334383  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.335043  8809 raft_consensus.cc:2368] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:33.336229  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.336800  8192 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:33.338320  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.337955  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.339206  8803 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.200137 11975 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.261591 12211 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:33.294234 12042 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.341089  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.326332 12265 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.290650 11965 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.335080  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:33.395215  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 60205.7us
I20260709 13:04:33.396198 12220 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.396906 12220 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:33.397311 12220 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.398890  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.399567  8191 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:33.400434  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.400986  8191 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:33.401800  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.402319  8191 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:33.403015  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:33.404029  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.404774  8273 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:33.406198 12220 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.406883  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.407491  8273 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.408757 12220 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.288597 12174 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.348788  8803 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:33.342515  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47741.4us
I20260709 13:04:33.387292  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.388137  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.264338 12276 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:33.389246  8811 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:33.272897 12126 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:04:33.410241 12177 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.336695 12071 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:04:33.410713  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:33.344374  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0678675789999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 13:04:33.332494 12246 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.410781  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.341156 11908 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:33.410990 12183 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:04:33.341207 12139 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:33.337955 12064 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:33.391316  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.392269  8238 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.391754 12042 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.392935  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.394203  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.394399  8116 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:33.332677 12055 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.288254 12180 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:04:33.333071 12003 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:33.332274 12262 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.428705  8269 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:33.429557  8124 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:33.434844  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.435194  8117 raft_consensus.cc:2376] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9. Re-sending same reply.
I20260709 13:04:33.424993  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.435451  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.433602  8802 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.452356  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.444222  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.453069  8775 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.434269  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.435961  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.453867  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.438118  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.439036  8805 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 13:04:33.436311  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49113.7us
I20260709 13:04:33.455598  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.443686  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.456534  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:33.428851  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0678675789999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 13:04:33.447911  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.440495  8803 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:33.449882  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.389189 12253 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:33.386773 12254 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.520614  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.519088  8806 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:33.454875  8805 pending_rounds.cc:85] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 9
I20260709 13:04:33.459448  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.459399  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.484992  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.527441  8194 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:33.483381  8088 leader_election.cc:400] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:33.530225  8193 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:33.530535  8088 leader_election.cc:403] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:33.503789  8273 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:33.451380 12262 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.410056 11975 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.529618  8805 pending_rounds.cc:107] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:04:33.478470 12255 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.533119 12253 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.533847 12255 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.534155 12253 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:33.479007  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 54106.7us
I20260709 13:04:33.534389 12255 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.532811 12262 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.531208  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.537693  8193 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:33.534986  8805 raft_consensus.cc:2889] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.540445  8805 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:33.544541 12255 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.478967 12012 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:33.547355 12253 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.548684  8806 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:33.549011  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65766.7us
I20260709 13:04:33.550383  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.550549  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:33.550966  8124 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:33.551769  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.552712  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.549841  8117 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:33.553236  8124 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:33.559021  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.559537  8124 raft_consensus.cc:2376] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9. Re-sending same reply.
I20260709 13:04:33.434592 12042 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.427222 12276 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.441182 12151 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:33.563302  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 103929us
I20260709 13:04:33.435726 12071 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:33.435401 12055 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.529268 12250 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:33.562620  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:33.436017 12177 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:33.521304 12183 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.572006  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.572837  8811 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:04:33.570923  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet ff5d69caf66c468aa9766af3b02649b0: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:33.595271  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 66527us
I20260709 13:04:33.436823 12274 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:33.430862 11908 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.575733 12166 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.446201 12211 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:33.575757  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 116418us
I20260709 13:04:33.581670  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.581946  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.623379  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.583077 12276 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.574906  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.519975 12150 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.424049 11965 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.440487 12176 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.529605 12267 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:33.529784 11904 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.585193  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.549121 12181 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:33.586313  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.519119 12190 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:33.530516 12248 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.587790  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.652444  8119 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:33.571449  8802 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:33.590652  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.443667 12174 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.548342 12195 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.440884 11983 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:04:33.438068 12220 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 13:04:33.570987 12252 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.423870 12265 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.570375 12180 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.604890  8124 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:33.605875  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.608788 12253 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.429306 12246 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.618846  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.586042 12165 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:33.623759  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.587502 12071 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.624408  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.669560  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:33.669737  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 45398.3us
I20260709 13:04:33.670466  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:33.519203 12251 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.589383 12250 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.671151 12251 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.671218 12250 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.671686 12251 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.625290 12177 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:33.673524 12177 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.591074 12055 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.548385 12254 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.532829 11975 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.622198 11908 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.675319 12254 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:33.675846 12254 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.640774  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.677531  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.678064  8116 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:33.678821  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:33.641651  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.624606 12126 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.679394 12251 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.679833 12126 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.680662  8808 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:33.622047 12166 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.680768 12055 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.642472  8117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:04:33.645274  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.682228  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.682639  8265 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:04:33.682953  8265 pending_rounds.cc:85] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
W20260709 13:04:33.683004  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet e8843c2ad2d543b89354e114ebd9d638: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:33.654891 12248 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.683257  8265 pending_rounds.cc:107] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:04:33.683593  8265 raft_consensus.cc:2889] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.681878  8117 raft_consensus.cc:606] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.684280  8117 raft_consensus.cc:614] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:33.679437  8116 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:33.649708  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.681572 12251 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.634464 12257 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:33.635653 12150 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.658955 12195 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.663952 12255 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:33.651683  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:33.655866  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.607048 12183 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.597548 12151 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.659475  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.663055  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.641407 12267 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:33.663414 12296 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.655196 12181 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.649510 11904 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.667192  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.669766 12211 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.618009 12274 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.649963  8273 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:33.662421 12261 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:33.667900 12246 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.689776  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:33.767222  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.738677  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.703279  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.738358  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.739125  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.730223  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.853601  8119 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
W20260709 13:04:33.858773  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.856668  8802 raft_consensus.cc:2393] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:33.714920  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 318927us
W20260709 13:04:33.720100  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70497.6us
I20260709 13:04:33.697681  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.673880 12177 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.744861  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.858389  8805 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:33.719866  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.718979  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.681555 12166 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.743585  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.681850 12071 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.667214 12165 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.860447  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:33.662101 12012 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:33.926286 12147 consensus_meta.cc:287] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 13:04:33.751958 12126 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:33.700619 12266 consensus_meta.cc:287] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.002s
W20260709 13:04:33.715235 12241 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.517s	user 0.000s	sys 0.008s
I20260709 13:04:33.861369 11904 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.946355 12251 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.948709 12147 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.685974 12248 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.731426 12139 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:33.714200 12064 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:33.950009 12139 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.706514 12174 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.888064  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.903383  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:33.719594 12199 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:33.952239  8802 raft_consensus.cc:2393] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 7: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:33.728395  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:33.909049  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.954175 12241 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.954953  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:33.931195  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 307484us
I20260709 13:04:33.956283  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:33.861583 12267 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.861482 12150 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.872092  8272 raft_consensus.cc:2410] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:04:33.701958 12288 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:33.913157  8268 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
W20260709 13:04:33.904634 12010 consensus_meta.cc:287] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.001s
I20260709 13:04:33.904369  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.999177  8266 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.709604 12262 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:33.940934  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:33.860419  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.917912 12261 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:33.862610  8088 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:33.961135  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:33.692049 12291 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:04:33.981926  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.685400 12206 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.990470  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.861099 12257 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.730971 12003 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.035226  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.735885 12190 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:33.947285 12266 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:33.691910 11975 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:33.689492 12054 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:34.068037  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.005s
I20260709 13:04:33.991236  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:33.947366  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:33.705811 12220 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:33.691411 12258 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.001951  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:33.750468 12218 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:34.073019  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 71167.3us
W20260709 13:04:34.001056  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 414775us
I20260709 13:04:34.007678  8117 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:33.913830  8194 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:34.009310  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 146758us
I20260709 13:04:33.988983  8191 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:04:34.009469  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.010008  8124 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:34.003844  8269 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:34.004411  8198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.006s
I20260709 13:04:33.757436 11908 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:34.031550  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70483.1us
I20260709 13:04:34.078732  8091 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:33.766825 12250 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.035497  8265 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:33.861016 12274 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.093865 12181 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.072798 12220 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.094779 12220 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:34.036751  8122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.008s	sys 0.002s
I20260709 13:04:33.949272 12147 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.097604  8807 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:34.098205 12195 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.098569 12252 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10.
I20260709 13:04:34.098869 12218 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.097468 12255 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.099589 12255 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.099910 12255 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.100782 12250 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.004565 12010 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.102658  8810 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:34.102886 12010 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:34.097510  8122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.008s	sys 0.002s
I20260709 13:04:34.105281  8121 raft_consensus.cc:2368] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:33.710660 12265 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.085464 12190 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:34.107751 12190 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.110159 12183 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.066360  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:34.006551 12261 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.993995  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:33.981182 12199 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:04:34.037698 12206 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:34.069052  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.010s	sys 0.005s
I20260709 13:04:33.999392 12187 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:34.070007  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:34.110790  8120 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.000749 12301 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:34.071102  8196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.027s	sys 0.053s
I20260709 13:04:33.683086 12180 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.003021 12251 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.716566 11965 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:34.075734  8198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.006s
I20260709 13:04:34.038107 12003 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:34.082948  8266 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
W20260709 13:04:33.946058  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 85713.3us
I20260709 13:04:34.177233  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:34.032199 12300 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:34.084718  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.085657  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.086516  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:34.178001  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:34.178776  8807 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.086890  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:34.089273  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.091235 12262 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.000433 12299 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.182446 12299 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.184758 12299 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.157399 12261 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:34.097530 12254 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.110093  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.186563  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:34.186720  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 101134us
W20260709 13:04:34.041778  8118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.010s
I20260709 13:04:34.187529  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.110678  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:34.188198  8123 raft_consensus.cc:2376] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13. Re-sending same reply.
I20260709 13:04:34.188969  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.189512  8123 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:34.189708 12309 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:34.190281  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.110839  8273 raft_consensus.cc:606] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.036610 12257 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:34.157192  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 606696us
I20260709 13:04:34.027094 12165 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:34.191915  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 105111us
I20260709 13:04:34.192889 12054 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.130699  8272 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:34.193266 12054 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:34.193815 12054 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:34.187870  8118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.000s	sys 0.015s
I20260709 13:04:34.198684  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.199337  8198 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.190515 12309 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:34.110028  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.150727  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.209280  8117 raft_consensus.cc:2410] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:34.159425  8268 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:34.160534  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 85666.8us
I20260709 13:04:34.115255  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.075240 12249 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:34.163055  8196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.027s	sys 0.053s
I20260709 13:04:34.167053  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:34.148491 12042 consensus_meta.cc:287] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.001s
I20260709 13:04:34.249637 12042 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.171511  8808 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:33.873581 12296 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.251914  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.252481  8200 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:34.252612  8117 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:34.253496  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.038149 12185 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:34.178038  8116 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:34.253806  8194 raft_consensus.cc:2410] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:04:34.254783  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.255024 12177 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.255398  8116 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.255741  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.256358  8116 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.256803 12206 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.180634  8191 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.257242  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.257949  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.258565  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.259056  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.200736  8270 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 9: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:34.199548  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:34.202467  8123 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:34.260169 12249 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:34.260704 12249 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:34.203760  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:34.261696  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 57980.2us
I20260709 13:04:34.261559 12249 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.263294  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.187630  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:34.153154  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 76425.7us
I20260709 13:04:34.263973  8121 raft_consensus.cc:2376] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10. Re-sending same reply.
W20260709 13:04:34.260293  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 60828.5us
W20260709 13:04:34.206154  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.264735  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:34.265233  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.200665  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:34.265237  8777 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:34.266103  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65522.5us
W20260709 13:04:34.267019  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.219741  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:34.268215  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:34.268751  8268 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.207207  8807 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:34.152798  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.270223  8197 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:34.210903 12287 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:34.210163  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:34.168815 12301 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.174261 11908 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.224166  8199 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:34.268359  8193 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:34.224887  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.251853 12042 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.190841  8273 raft_consensus.cc:614] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:34.259274  8194 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:34.210572 12241 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.271255  8125 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.168501 12251 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.266894  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.260213  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:34.274219  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.278752  8198 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.287611  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:34.288554  8198 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:34.269336  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:34.254025  8117 raft_consensus.cc:2376] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13. Re-sending same reply.
I20260709 13:04:34.285055  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:34.336879  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51976.9us
I20260709 13:04:34.337626  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.304910 12241 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:34.305420 12304 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:34.344873  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.306152  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.306283  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:34.268505 12300 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:34.253587 12296 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:34.308094  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 79873.6us
I20260709 13:04:34.287031  8120 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:34.083472 12012 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.309957  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.310927 12252 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.311856  8121 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:34.312431  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:34.284479 12265 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.313725  8197 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:34.305472 11908 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.321964  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:34.189522 12199 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:04:34.338505  8198 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
W20260709 13:04:34.341099  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 53559us
I20260709 13:04:34.346050  8192 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.346155  8273 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.351934  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2215) took 1094 ms. Trace:
I20260709 13:04:34.358314  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:34.312821 12315 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:34.352640 12151 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.364499 11965 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:34.364970  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:34.349113 12304 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.349237 12250 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:34.376730  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54865.5us
I20260709 13:04:34.424985  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:34.471668  8266 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:34.373553  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.363205  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:34.472317  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2330) took 1221 ms. Trace:
I20260709 13:04:34.472329  8194 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.473312  8775 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:34.425863  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 160685us
I20260709 13:04:34.474920  8200 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:04:34.420524  8268 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.370093  8125 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.207676 12220 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.479528  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:34.435114  8122 rpcz_store.cc:276] 0709 13:04:33.257468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.287724 (+ 30256us) service_pool.cc:224] Handling call
0709 13:04:33.287946 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.288110 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:34.104895 (+816785us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.351605 (+246710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.351656 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:34.351699 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.351766 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.351883 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17596,"prepare.queue_time_us":286127,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":12510,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":1034856,"threads_started":2}
I20260709 13:04:34.361035 12181 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.453589  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.485277  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.486119  8198 raft_consensus.cc:2410] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:34.485998  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.487140  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:34.422745 12302 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:34.361714 12055 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.471012 12304 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.432452  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:34.494149  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 61757.6us
I20260709 13:04:34.365593 12177 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.419334 11908 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.463007  8117 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.362021 12147 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.463554  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:34.466390  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 203146us
I20260709 13:04:34.469170  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:34.475301  8200 pending_rounds.cc:85] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 3
I20260709 13:04:34.475198  8273 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:34.353440 12183 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:04:34.477440  8125 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:34.484226 12265 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:34.488754 12181 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.481689  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:34.500634  8120 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:34.550887  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69284.7us
I20260709 13:04:34.501278  8200 pending_rounds.cc:107] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:04:34.505235  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:34.551841  8200 raft_consensus.cc:2889] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:34.508399  8163 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.514s (SENT)
I20260709 13:04:34.483676  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:34.458988  8270 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:04:34.488775  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:34.462194 12195 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:34.553071  8197 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:34.469461 11965 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.471232 12250 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:34.504866  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2092) took 1107 ms. Trace:
I20260709 13:04:34.552717  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:34.553273  8268 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.552605  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:34.496073 12010 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:34.563372  8125 rpcz_store.cc:276] 0709 13:04:33.397757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.476860 (+1079103us) service_pool.cc:224] Handling call
0709 13:04:34.477122 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.504618 (+ 27496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.504810 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:34.564023  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55652.5us
W20260709 13:04:34.567407  8163 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.647s (SENT)
I20260709 13:04:34.567787  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:34.470571  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 238444us
I20260709 13:04:34.555213  8192 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.376065 12252 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:34.558561  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53419.6us
I20260709 13:04:34.562629 12315 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:34.579730 12254 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:34.581384 12319 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:04:34.581915 12266 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.584177 12054 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.497537 12302 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:34.557852 12195 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:34.585698  8163 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.676s (SENT)
W20260709 13:04:34.627090  8163 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.712s (SENT)
I20260709 13:04:34.627498  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:34.588549  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:34.589221  8268 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:34.521855 12276 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.003s
W20260709 13:04:34.557958 11904 consensus_meta.cc:287] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.012s
I20260709 13:04:34.597630  8120 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:34.600406  8195 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:34.603022  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:34.499428 12199 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:34.558301 12181 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.600490  8194 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:34.503700 11908 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.499943 12042 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:34.589074 12250 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.598294 12241 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:04:34.610330 12315 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.562865 11965 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.611553 12302 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.607671 12010 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.589850 12265 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:34.563086 12055 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:34.611573  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet db7845485d6b4a86b219eae83659a36e: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:34.495882 12274 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.631011  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:34.558189 12257 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.642279  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.782996  8197 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.593542 12252 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:34.644112  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55627.1us
I20260709 13:04:34.528294 12185 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:04:34.795835  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:34.670961 12266 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:34.598169 12126 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:34.601886 12177 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:34.622219 12318 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:04:34.619695 12071 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.671s	user 0.003s	sys 0.015s
W20260709 13:04:34.619436 12267 consensus_meta.cc:287] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.009s
W20260709 13:04:34.674134  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 47069.1us
W20260709 13:04:34.818871  8163 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.923s (SENT)
I20260709 13:04:34.819262  8163 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:34.820358  8163 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.925s (SENT)
W20260709 13:04:34.820499  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 462316us
I20260709 13:04:34.679620  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:34.621011 12054 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:34.735371  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:34.759815  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet fe00257dce7d4bb38119184a1572ed9e: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:34.631155  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:34.653505 12199 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.659611 12187 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:04:34.735050 11975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.012s	sys 0.016s
I20260709 13:04:34.796646  8807 raft_consensus.cc:2410] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:04:34.622728 12314 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:04:34.800969 12177 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:34.619058 12248 consensus_meta.cc:287] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.006s
I20260709 13:04:34.619410 12165 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.750008 12042 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:34.812378  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 530) took 1171 ms. Trace:
I20260709 13:04:34.616932 12304 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.781236 12301 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.762660 12180 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.658275 12003 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.651989 11904 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:34.801538  8803 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:34.833930 11975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.013s	sys 0.017s
I20260709 13:04:34.644529 12296 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.798565 12265 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:34.650000 12276 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:34.831512  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 200434us
W20260709 13:04:34.815181 12246 consensus_meta.cc:287] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.911s	user 0.009s	sys 0.008s
I20260709 13:04:34.842854  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:34.815793 12252 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:34.503419 12300 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.838636  8121 rpcz_store.cc:276] 0709 13:04:33.641044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.491962 (+850918us) service_pool.cc:224] Handling call
0709 13:04:34.503671 (+ 11709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.812088 (+308417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.812114 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.812153 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:34.812183 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.812239 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.812329 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36441,"raft.queue_time_us":90500,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4578,"thread_start_us":270601,"threads_started":1}
W20260709 13:04:34.845785  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 352528us
I20260709 13:04:34.849308  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:34.851269  8191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.025s
W20260709 13:04:34.994807  8191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.025s
I20260709 13:04:34.834918 12199 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.829710 12183 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:35.006659  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 157415us
I20260709 13:04:35.007576  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:34.973423 12054 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.839107 12177 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.854725  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:34.928795  8199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.015s	sys 0.022s
I20260709 13:04:34.931305  8272 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:34.840382 12055 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:34.933725  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 464609us
I20260709 13:04:35.018814  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:35.019732  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:35.021659 12277 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:35.022068 12277 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.022522 12277 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.024525 12211 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:35.025012 12211 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:34.813525 12071 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.837901 11983 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.025818 11983 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.027523 12071 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:35.028214 11983 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.811822 12126 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.028873 12211 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.030084 12126 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:34.936290  8119 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:34.841832 12309 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:34.851902 12220 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.852337 12010 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:35.031240 12309 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.031538 12010 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.033295 12309 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:35.033442 12010 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:34.942013  8811 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:34.837299 12267 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:34.934351 12314 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:04:35.035660  8806 raft_consensus.cc:2393] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 8: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:34.809684 12195 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.035934 12267 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.842005 12248 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.037009  8810 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:35.038152 12248 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.959158  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1959) took 1311 ms. Trace:
I20260709 13:04:34.971143  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:35.039239  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 68245.8us
I20260709 13:04:35.038789  8193 rpcz_store.cc:276] 0709 13:04:33.647455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.431268 (+783813us) service_pool.cc:224] Handling call
0709 13:04:34.431484 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.431618 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:34.715799 (+284181us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.958804 (+243005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.958860 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:34.958907 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.958971 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.959101 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45131,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":114,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9009,"thread_start_us":490698,"threads_started":2}
I20260709 13:04:35.040606  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:34.952979 12320 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
W20260709 13:04:34.954818 12261 consensus_meta.cc:287] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.007s
I20260709 13:04:35.041759 12261 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.042402  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2218) took 1772 ms. Trace:
I20260709 13:04:35.043813 12261 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:34.852982 12254 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:04:35.042749  8118 rpcz_store.cc:276] 0709 13:04:33.270451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.271376 (+   925us) service_pool.cc:224] Handling call
0709 13:04:33.271675 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:33.272057 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:33.385688 (+113631us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b18004a5d20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd248d04bc 00007fbd21c1e48b 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf
0709 13:04:33.385835 (+   147us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.198526 (+812691us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:34.219694 (+ 21168us) log.cc:844] Serialized 52 byte log entry
0709 13:04:34.219848 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:34.220064 (+   216us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.306652 (+ 86588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.306732 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.587296 (+280564us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b18004a5d20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:34.613221 (+ 25925us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b18004a5d20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b522 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:35.042204 (+428983us) raft_consensus.cc:1685] finished
0709 13:04:35.042225 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.042341 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87870,"prepare.queue_time_us":219780,"prepare.run_cpu_time_us":1677,"prepare.run_wall_time_us":19933,"raft.queue_time_us":98547,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":87691,"spinlock_wait_cycles":41466368,"thread_start_us":865077,"threads_started":2,"wal-append.queue_time_us":908326}
I20260709 13:04:35.044525  8265 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:04:34.992250  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 149457us
I20260709 13:04:35.044871  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:35.030990 12250 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.994616  8089 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:35.046993  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52466.8us
I20260709 13:04:35.047627  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:35.047742 12250 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:35.048667  8118 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:34.821643 12266 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:35.049901  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:34.855840  8270 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:35.012384  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:35.051152 12309 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:35.013072  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:35.014492  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:35.015144  8199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.015s	sys 0.022s
I20260709 13:04:35.051527 12309 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.051957 12309 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.015635  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:35.016230  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:34.973834 12325 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.046307  8198 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:35.049995 12266 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.995515  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1957) took 1401 ms. Trace:
I20260709 13:04:35.056537  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:35.073609  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:34.990903 12252 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:35.002085 12326 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:35.086962  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:35.087303  8191 rpcz_store.cc:276] 0709 13:04:33.594499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.288409 (+693910us) service_pool.cc:224] Handling call
0709 13:04:34.288649 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.304385 (+ 15736us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:34.348189 (+ 43804us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.995205 (+647016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.995263 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:34.995301 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.995363 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.995465 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34130,"prepare.queue_time_us":46687,"prepare.run_cpu_time_us":12866,"prepare.run_wall_time_us":44208,"raft.queue_time_us":596,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":646734,"threads_started":1}
I20260709 13:04:34.997254 12307 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:35.067795 12064 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:04:35.089150  8117 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.004s
I20260709 13:04:35.147454  8117 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:35.017546 12180 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:35.108197 12334 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:04:35.066851 12338 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:04:35.108472 12126 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:04:35.108049  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 61596.7us
W20260709 13:04:35.241241  8166 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.533s (SENT)
I20260709 13:04:35.108911 12055 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:35.110136 12337 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:04:35.110566 12139 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.160s	user 0.010s	sys 0.000s
I20260709 13:04:35.053520 12211 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:35.144369  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 289706us
W20260709 13:04:35.067673 12150 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.040s	user 0.007s	sys 0.014s
I20260709 13:04:35.310241 12150 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.312156  8271 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:35.086323 12321 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:04:35.222054 12274 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:35.111615 12265 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.222045 12258 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:35.220749  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:35.222129  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 751) took 1359 ms. Trace:
I20260709 13:04:35.086988 12248 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.299779 12252 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.274888  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:35.141310 12307 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.145720 12308 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:35.309441 12139 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.319947  8266 rpcz_store.cc:276] 0709 13:04:33.862329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.499071 (+636742us) service_pool.cc:224] Handling call
0709 13:04:34.540044 (+ 40973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.540246 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:34.938832 (+398586us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.221804 (+282972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.221852 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:35.221893 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.221952 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.222072 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189228,"prepare.queue_time_us":81964,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":190047,"spinlock_wait_cycles":38694144,"thread_start_us":437223,"threads_started":2,"wal-append.queue_time_us":374761}
W20260709 13:04:35.376643  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 68793.5us
I20260709 13:04:35.067785 12246 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:34.997823 12042 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.395596  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2229) took 2014 ms. Trace:
I20260709 13:04:35.396148  8123 rpcz_store.cc:276] 0709 13:04:33.381317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.260679 (+879362us) service_pool.cc:224] Handling call
0709 13:04:34.260935 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.309818 (+ 48883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.309846 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.310273 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.637069 (+326796us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:34.637108 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.637178 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.395397 (+758219us) raft_consensus.cc:1685] finished
0709 13:04:35.395415 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.395537 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48552,"raft.queue_time_us":49539,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":326477,"threads_started":1,"wal-append.queue_time_us":529827}
I20260709 13:04:35.087092 12054 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:35.359861 12166 consensus_meta.cc:287] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.326s	user 0.013s	sys 0.006s
I20260709 13:04:35.296522 12341 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:35.455392 12330 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:35.455907  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53047.7us
I20260709 13:04:35.115047 12325 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.508023  8809 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:35.907500  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:35.908743  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 835186us
I20260709 13:04:35.909878  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:35.839993  8090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.002s	sys 0.027s
W20260709 13:04:35.683832  8197 consensus_meta.cc:287] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.891s	user 0.006s	sys 0.002s
I20260709 13:04:35.607591  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:35.910643  8090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.002s	sys 0.030s
I20260709 13:04:35.666004  8808 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:35.910776  8197 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:35.869238  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:35.916756  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:35.917416  8193 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:35.867509  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1797) took 2198 ms. Trace:
I20260709 13:04:35.870258  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:35.914608  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 744) took 1320 ms. Trace:
W20260709 13:04:35.871922  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.392853 12258 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:35.376116 12308 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:35.870785  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:35.918277  8267 rpcz_store.cc:276] 0709 13:04:33.669146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.669268 (+   122us) service_pool.cc:224] Handling call
0709 13:04:33.682894 (+ 13626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.072732 (+389838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.072758 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.079515 (+  6757us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.344554 (+265039us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:34.417295 (+ 72741us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.516757 (+ 99462us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b1800443aa0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:04:34.801960 (+285203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.802981 (+  1021us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.867146 (+1064165us) raft_consensus.cc:1685] finished
0709 13:04:35.867262 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.867437 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47791,"prepare.queue_time_us":75352,"prepare.run_cpu_time_us":1222,"prepare.run_wall_time_us":8777,"raft.queue_time_us":436629,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5981,"spinlock_wait_cycles":20386688,"thread_start_us":837542,"threads_started":3,"wal-append.queue_time_us":363546}
W20260709 13:04:35.934399  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.942377  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.029s	sys 0.022s
W20260709 13:04:35.952797  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.029s	sys 0.022s
W20260709 13:04:35.953419  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 945774us
I20260709 13:04:35.404577 12252 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.916147 12248 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:35.967188 12248 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.848629 12054 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:35.556411 12211 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:35.937100 12249 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:35.782415 12246 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:35.968421 12249 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.921497 12166 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:35.969295 12248 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:35.970459 12249 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:35.911923  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.970894 12166 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:35.932168  8197 rpcz_store.cc:276] 0709 13:04:34.594262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.602348 (+  8086us) service_pool.cc:224] Handling call
0709 13:04:35.914546 (+1312198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:35.971509  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 57139.4us
I20260709 13:04:35.972154  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:35.972604  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.974718  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:35.973331  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:35.975880  8197 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:35.560853 12199 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.560s	user 0.003s	sys 0.004s
W20260709 13:04:35.574483 12218 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.475s	user 0.006s	sys 0.003s
W20260709 13:04:35.747385 12277 consensus_meta.cc:287] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.000s
W20260709 13:04:35.783310 12255 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.683s	user 0.007s	sys 0.013s
W20260709 13:04:35.813647 12181 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.062s	user 0.009s	sys 0.001s
W20260709 13:04:35.823268 11908 consensus_meta.cc:287] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.041s	user 0.005s	sys 0.004s
I20260709 13:04:35.957455  8118 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:35.956290  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:35.378310 12307 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:36.000097  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 43876.5us
W20260709 13:04:35.621086 12251 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.225s	user 0.000s	sys 0.013s
W20260709 13:04:35.965174  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.000s	sys 0.012s
I20260709 13:04:35.936349 12330 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:35.915048 11965 consensus_meta.cc:287] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.123s	user 0.012s	sys 0.000s
I20260709 13:04:35.968710 12246 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:35.833057 12309 consensus_meta.cc:287] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.781s	user 0.006s	sys 0.003s
I20260709 13:04:35.396126 12339 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:35.912954 12302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.004s	sys 0.004s
I20260709 13:04:35.977612  8123 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
W20260709 13:04:35.808641 12177 consensus_meta.cc:287] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.698s	user 0.004s	sys 0.004s
I20260709 13:04:35.978245  8274 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:35.457405 12003 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:35.551302 12139 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:35.728325 12257 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:35.990574  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1963) took 2298 ms. Trace:
I20260709 13:04:35.992617  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.035625  8198 rpcz_store.cc:276] 0709 13:04:33.691899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.490979 (+799080us) service_pool.cc:224] Handling call
0709 13:04:34.491218 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.068931 (+577713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.990328 (+921397us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400206cd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:35.990514 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276240768}
I20260709 13:04:35.973431 12308 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:35.927640 12360 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:34.472666  8196 rpcz_store.cc:276] 0709 13:04:33.250712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.250822 (+   110us) service_pool.cc:224] Handling call
0709 13:04:33.251111 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.251293 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:34.248765 (+997472us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.472012 (+223247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.472061 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:34.472102 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.472161 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.472266 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68047,"prepare.queue_time_us":226407,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":73046,"thread_start_us":1152027,"threads_started":2}
I20260709 13:04:36.028313 12309 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.101119  8117 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:36.102489 12309 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.103049 12330 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:36.005020 11908 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.034368 12177 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.107434 12177 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.108688  8268 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:36.049998 12258 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:36.113865 12364 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:04:36.114943  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2231) took 1135 ms. Trace:
I20260709 13:04:36.115280  8120 rpcz_store.cc:276] 0709 13:04:34.979742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.979973 (+   231us) service_pool.cc:224] Handling call
0709 13:04:34.980425 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.991569 (+ 11144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.991599 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.997653 (+  6054us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.402776 (+405123us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:35.402813 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.402873 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.114737 (+711864us) raft_consensus.cc:1685] finished
0709 13:04:36.114756 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.114887 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68806,"raft.queue_time_us":11314,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":24982,"thread_start_us":257828,"threads_started":1,"wal-append.queue_time_us":927735}
I20260709 13:04:35.998804 12181 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.117031  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.117894  8120 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.118259  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2238) took 1136 ms. Trace:
I20260709 13:04:36.118541  8120 rpcz_store.cc:276] 0709 13:04:34.981951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.116753 (+1134802us) service_pool.cc:224] Handling call
0709 13:04:36.118207 (+  1454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.119000 12181 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.119714 12181 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:36.120193 12325 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.018271 11965 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.123878 11965 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:36.146442  8266 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:36.020015 12251 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.165449  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.166164  8196 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:36.002365  8071 placement_policy_util.cc:248] tablet ccbf67588374458ebbd07bc5aeeb3b5a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 13:04:36.007586  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.004560  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2240) took 1022 ms. Trace:
I20260709 13:04:36.167330  8118 rpcz_store.cc:276] 0709 13:04:34.982419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.114213 (+131794us) service_pool.cc:224] Handling call
0709 13:04:36.004486 (+890273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:36.169986  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 758) took 1565 ms (client timeout 1938 ms). Trace:
W20260709 13:04:36.018078  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.000s	sys 0.013s
I20260709 13:04:36.021975  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:36.381692  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 1.30473e+06us
I20260709 13:04:35.984825 12229 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.993935 12341 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:35.982206 12199 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.008045 12300 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.008457 12126 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:35.991161 12277 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.018811 12361 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:36.029083 12302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.004s	sys 0.006s
I20260709 13:04:35.568801 12055 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:35.998579 12255 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:36.170401  8270 rpcz_store.cc:269] 0709 13:04:34.602663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.602780 (+   117us) service_pool.cc:224] Handling call
0709 13:04:36.167553 (+1564773us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001c34d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.167685 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490576768}
W20260709 13:04:36.173394 12336 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.861s	user 0.009s	sys 0.000s
W20260709 13:04:36.174868  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.397804  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:36.175235  8193 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
W20260709 13:04:36.185560 12369 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:04:36.190508 12308 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.039733 12362 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
W20260709 13:04:36.191181 12358 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.880s	user 0.003s	sys 0.011s
I20260709 13:04:36.199538  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.201782 12376 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:36.202258 12251 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:36.202261  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 199916us
W20260709 13:04:36.206068  8271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1803) took 2511 ms (client timeout 2252 ms). Trace:
I20260709 13:04:36.134943 12360 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:36.229868  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 359686us
I20260709 13:04:36.232599  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:36.237421  8091 connection.cc:256] RPC call timeout handler was delayed by -1.0802765349999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:04:36.239001  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.242843 12150 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:36.243845  8124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 546) took 2300 ms (client timeout 1849 ms). Trace:
I20260709 13:04:36.248471  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 698) took 2072 ms. Trace:
W20260709 13:04:36.251260  8195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 733) took 2855 ms (client timeout 2070 ms). Trace:
I20260709 13:04:36.253147  8266 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:36.254976  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 780) took 2817 ms. Trace:
I20260709 13:04:36.256086  8192 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:36.266667  8804 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:36.269866  8806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 802) took 2378 ms (client timeout 1535 ms). Trace:
I20260709 13:04:36.250052 12379 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:36.375778  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.377588 12375 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.385022 12229 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.391189 12300 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.436360  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.437014  8266 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:36.412935  8196 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.414455  8194 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:36.415282  8118 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:36.387264  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.378865 12299 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.373771 12010 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.427978  8802 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:36.423216  8806 rpcz_store.cc:269] 0709 13:04:33.887676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.887788 (+   112us) service_pool.cc:224] Handling call
0709 13:04:36.266095 (+2378307us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54007107d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.266288 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492356864}
I20260709 13:04:36.450320  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:36.450824  8802 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.378069 12373 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:36.388790 12341 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.399665  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.420233 12185 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.388109 12296 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:36.406097  8119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 537) took 2760 ms (client timeout 1949 ms). Trace:
I20260709 13:04:36.415755  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.460207  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 547) took 2517 ms. Trace:
I20260709 13:04:36.419173  8267 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:36.421206  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:36.421388  8124 rpcz_store.cc:269] 0709 13:04:33.942968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.086307 (+143339us) service_pool.cc:224] Handling call
0709 13:04:36.243630 (+2157323us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540026b1d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.243772 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4157604096}
I20260709 13:04:36.421511  8810 rpcz_store.cc:276] 0709 13:04:34.176416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.176525 (+   109us) service_pool.cc:224] Handling call
0709 13:04:34.248232 (+ 71707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.037377 (+789145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.248199 (+1210822us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001d74d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.248398 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813625728}
I20260709 13:04:36.423734  8191 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:04:36.414486  8271 rpcz_store.cc:269] 0709 13:04:33.694472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.034975 (+340503us) service_pool.cc:224] Handling call
0709 13:04:36.205823 (+2170848us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001be9d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.205975 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2934897920}
I20260709 13:04:36.430321  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:36.434885  8163 connection.cc:256] RPC call timeout handler was delayed by -1.713280248999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:04:36.428578  8805 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:04:36.421622  8195 rpcz_store.cc:269] 0709 13:04:33.395599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.956014 (+560415us) service_pool.cc:224] Handling call
0709 13:04:36.251026 (+2295012us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400365454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.251151 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294834432}
W20260709 13:04:36.460927  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45242.4us
I20260709 13:04:36.429055  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.451385  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1806) took 2756 ms. Trace:
I20260709 13:04:36.390811 12126 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.452948  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.422380  8809 rpcz_store.cc:276] 0709 13:04:33.437130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.439589 (+  2459us) service_pool.cc:224] Handling call
0709 13:04:33.439942 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.908774 (+2468832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.254705 (+345931us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540059fe54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.254889 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4755864320}
W20260709 13:04:36.411110 12331 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.096s	user 0.001s	sys 0.019s
I20260709 13:04:36.456116  8193 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:36.471254  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:36.480362  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.480933  8193 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.459057  8121 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:36.459920  8119 rpcz_store.cc:269] 0709 13:04:33.645624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.907649 (+262025us) service_pool.cc:224] Handling call
0709 13:04:36.405860 (+2498211us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54003cfad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.406016 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250505088}
W20260709 13:04:36.433914 12316 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 1.975s	user 0.009s	sys 0.005s
I20260709 13:04:36.412891 12376 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:36.410159 12308 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.411545 12362 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:36.454180 12218 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:36.491604  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.468694  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.464761  8265 rpcz_store.cc:276] 0709 13:04:33.695166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.098845 (+403679us) service_pool.cc:224] Handling call
0709 13:04:34.099182 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.044874 (+945692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.451122 (+1406248us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400154354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.451311 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173672192}
I20260709 13:04:36.417778 12003 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.407281 12301 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.433503 12211 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:04:36.472805  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.469373  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:36.482807  8774 leader_election.cc:336] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.849s (SENT)
I20260709 13:04:36.413591 11965 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:36.467905  8166 leader_election.cc:336] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.918s (SENT)
I20260709 13:04:36.426045 12307 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.416239 12304 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:36.434662 12277 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.416000 12360 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.487032  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.407121 12330 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.473799 12296 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.488698  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.492811  8124 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.414925 12181 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:04:36.494146  8810 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:36.413731 12315 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:36.495886  8191 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:36.524310  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.530149 12199 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.487246 12174 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:04:36.531383 12190 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:36.531737 12190 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:36.532963  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:36.473570 12185 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.472141 12126 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.434055 12187 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:04:36.484004 12366 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:04:36.509773  8806 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.394084 12361 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:36.513216  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45349.9us
W20260709 13:04:36.557054  8166 leader_election.cc:336] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.964s (SENT)
I20260709 13:04:36.431910 12300 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.473029 12251 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.514385  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.562148  8118 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:36.458313 12010 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.455591 12299 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.517779  8195 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.487375  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:36.515039 11965 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:36.568737  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 81451.4us
I20260709 13:04:36.569416  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:36.519309  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.423494 12379 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.492200 12206 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.491262 12362 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:36.423797 12375 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.574610 12299 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.575083  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.575637  8197 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.575870 12375 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.500703  8193 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:36.485448 12150 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:04:36.486883 12071 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:04:36.542853  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:36.543256  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.509193  8774 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.521147 12330 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.532486 12190 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.540508 12382 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.460192 12373 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.548566  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 761) took 1328 ms. Trace:
I20260709 13:04:36.554242  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:36.510563 12003 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.511658 12218 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.565229 12361 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:36.566825  8166 leader_election.cc:336] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.222s (SENT)
I20260709 13:04:36.567930  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1966) took 2531 ms. Trace:
I20260709 13:04:36.541599 12315 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:36.567247 12229 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:36.573218  8811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 792) took 2942 ms (client timeout 2254 ms). Trace:
W20260709 13:04:36.678609  8811 rpcz_store.cc:269] 0709 13:04:33.631150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.631335 (+   185us) service_pool.cc:224] Handling call
0709 13:04:36.573020 (+2941685us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54004493d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.573147 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893300608}
W20260709 13:04:36.573993  8803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 791) took 2983 ms (client timeout 1649 ms). Trace:
I20260709 13:04:36.679193  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.577529  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.573129  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:36.679834  8270 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.675298  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50776 (request call id 80) took 3044 ms. Trace:
I20260709 13:04:36.485677 12317 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:04:36.592249  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 157144us
I20260709 13:04:36.580776  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.687247  8193 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:36.578564  8124 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:36.687671  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:36.688323  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.689302  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.599114  8195 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:36.599359  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.598567  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 115833us
W20260709 13:04:36.660738 12328 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.725s	user 0.009s	sys 0.035s
I20260709 13:04:36.691490  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.689720  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.653733  8197 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:36.624351  8269 rpcz_store.cc:276] 0709 13:04:35.220165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.220378 (+   213us) service_pool.cc:224] Handling call
0709 13:04:36.548375 (+1327997us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400211454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.548507 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064555264}
W20260709 13:04:36.667271  8121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2237) took 1685 ms (client timeout 1636 ms). Trace:
I20260709 13:04:36.616889 12010 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:36.693207  8121 rpcz_store.cc:269] 0709 13:04:34.981488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.008402 (+ 26914us) service_pool.cc:224] Handling call
0709 13:04:36.667087 (+1658685us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000deb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.667198 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3082763136}
I20260709 13:04:36.694675  8806 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:36.659274  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.695925  8119 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
W20260709 13:04:36.672605  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 105820us
I20260709 13:04:36.577792 12313 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:36.669145  8196 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:36.659768  8807 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:36.666631  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2236) took 1685 ms. Trace:
I20260709 13:04:36.574633 12379 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.544878 12376 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.572431 12165 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.690179 12315 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:36.576833 12174 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:36.513765 12301 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.679111  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1807) took 2983 ms. Trace:
I20260709 13:04:36.679903  8118 raft_consensus.cc:2376] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11. Re-sending same reply.
I20260709 13:04:36.729624  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.730741  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.680423  8122 rpcz_store.cc:276] 0709 13:04:33.626003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.480868 (+854865us) service_pool.cc:224] Handling call
0709 13:04:36.576072 (+2095204us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54000deb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2e735 00007fbd24d269fa 00007fbd29cee4c9 00007fbd2326ac54 00007fbd2326abe2 00007fbd2326ab11 00007fbd2326aa8c 00007fbd23269d42 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.669980 (+ 93908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4602411264}
W20260709 13:04:36.681137  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 108055us
I20260709 13:04:36.750216  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:36.679471  8803 rpcz_store.cc:269] 0709 13:04:33.590302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.590441 (+   139us) service_pool.cc:224] Handling call
0709 13:04:36.573811 (+2983370us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54006103d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.573927 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639616768}
I20260709 13:04:36.751626  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:36.668984 12333 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.276s	user 0.000s	sys 0.025s
I20260709 13:04:36.692142  8266 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:36.753396  8270 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:36.672642  8200 rpcz_store.cc:276] 0709 13:04:34.036365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.613914 (+577549us) service_pool.cc:224] Handling call
0709 13:04:34.614200 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.029076 (+414876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.029103 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.029140 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:35.029175 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.567659 (+1538484us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54000294d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.567731 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.567872 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953761536}
W20260709 13:04:36.668090 12332 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.355s	user 0.005s	sys 0.010s
I20260709 13:04:36.699331  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.654786 11965 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.658787 12373 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:36.675678  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 121547us
I20260709 13:04:36.698951 12187 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:04:36.699774  8163 leader_election.cc:336] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.887s (SENT)
I20260709 13:04:36.702697  8117 rpcz_store.cc:276] 0709 13:04:34.981218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.148106 (+166888us) service_pool.cc:224] Handling call
0709 13:04:36.666460 (+1518354us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54000852d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.666578 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778545408}
I20260709 13:04:36.709676  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:36.762436  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:36.762439  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.655404 12195 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.664639 12276 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.617035 12325 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:36.716887  8193 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:04:36.763676  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54103.4us
I20260709 13:04:36.718437  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.677568  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.764845  8267 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:36.725706  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:36.686359 12361 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.681217 12042 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.624262 12365 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:04:36.764320  8271 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:36.727201  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:36.700656 12181 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.728318  8272 rpcz_store.cc:276] 0709 13:04:33.695406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.194136 (+498730us) service_pool.cc:224] Handling call
0709 13:04:34.194561 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.015430 (+820869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.678882 (+1663452us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400408b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.679057 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693822848}
I20260709 13:04:36.746031  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.691387 12190 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.687011 12250 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.745121  8118 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:36.770753  8121 raft_consensus.cc:2368] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
W20260709 13:04:36.748952  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 211370us
I20260709 13:04:36.752347  8122 raft_consensus.cc:2410] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:36.753746  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.780380  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:36.690303 12261 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:36.781379 12373 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:36.781769 12373 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:36.782219 12373 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.783449 12042 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.785555 12261 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:36.786046 12042 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.786441 12261 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.766005 12375 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:36.787390 12218 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.787936 12375 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.778574  8267 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:36.789855 12375 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.790136  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.653468 12382 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.791352  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.791851  8267 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.788892 12373 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.758172  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.792135 11904 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:36.792338 12382 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.792879  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1953) took 3272 ms. Trace:
I20260709 13:04:36.799028  8199 rpcz_store.cc:276] 0709 13:04:33.520962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.272225 (+751263us) service_pool.cc:224] Handling call
0709 13:04:34.272531 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.314172 (+ 41641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.314201 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.314620 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.051960 (+737340us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:35.051998 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.052058 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.668386 (+1616328us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:36.792594 (+124208us) raft_consensus.cc:1685] finished
0709 13:04:36.792615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.792807 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119632,"raft.queue_time_us":72197,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12318,"spinlock_wait_cycles":25094528,"thread_start_us":736998,"threads_started":1,"wal-append.queue_time_us":772075}
I20260709 13:04:36.800781  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.793157  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.787505  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2228) took 3431 ms. Trace:
I20260709 13:04:36.802242  8199 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:36.794641  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.803210  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.803640  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.792032  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.804646  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.760931 12366 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.768395 12174 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.805470  8116 rpcz_store.cc:276] 0709 13:04:33.337638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.257070 (+919432us) service_pool.cc:224] Handling call
0709 13:04:34.277041 (+ 19971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.316550 (+ 39509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.316695 (+   145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.317937 (+  1242us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.603831 (+285894us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:34.603874 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.603942 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.660055 (+2056113us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:36.764571 (+104516us) raft_consensus.cc:1685] finished
0709 13:04:36.764592 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.768606 (+  4014us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38843,"raft.queue_time_us":39035,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"spinlock_wait_cycles":3726592,"thread_start_us":185828,"threads_started":1,"wal-append.queue_time_us":442831}
I20260709 13:04:36.460927  8125 rpcz_store.cc:276] 0709 13:04:33.943195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.565626 (+622431us) service_pool.cc:224] Handling call
0709 13:04:34.588046 (+ 22420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.588317 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.588341 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.588710 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.939872 (+1351162us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b180043c6c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:04:36.229068 (+289196us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:36.449385 (+220317us) log.cc:844] Serialized 14 byte log entry
0709 13:04:36.451819 (+  2434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.451889 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.451926 (+    37us) raft_consensus.cc:1685] finished
0709 13:04:36.460044 (+  8118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.460158 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2163,"raft.queue_time_us":26256,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":21641,"spinlock_wait_cycles":26684160,"thread_start_us":506461,"threads_started":2,"wal-append.queue_time_us":1632976}
I20260709 13:04:36.807307  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.807483  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.808014  8116 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:36.808159  8125 raft_consensus.cc:2368] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11.
I20260709 13:04:36.795051  8196 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:36.808919  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.793748 12386 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:36.809641  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.810459  8199 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.811190  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.811681  8116 raft_consensus.cc:2376] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8. Re-sending same reply.
I20260709 13:04:36.812018 12307 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.809762  8125 raft_consensus.cc:2368] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:36.812657  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.812433 12315 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.710050 12362 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.762981  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.813659 12362 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.814045  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.814139  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.814777  8196 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:36.722508  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.809651  8122 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:04:36.765576  8810 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.815341  8119 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:36.815910  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.816448  8122 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:36.816581  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.817140  8119 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.817776 12252 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.818272 12252 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.819736  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.819983 12296 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.765767  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:36.766662  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.822441  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2351) took 1987 ms. Trace:
W20260709 13:04:36.823177  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56596.7us
I20260709 13:04:36.766978  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.764168  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.824321  8119 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:36.824923  8200 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 9: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:36.822817  8194 rpcz_store.cc:276] 0709 13:04:34.834790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.114719 (+279929us) service_pool.cc:224] Handling call
0709 13:04:35.114998 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.440604 (+1325606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.822225 (+381621us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540021c354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.822387 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2988130048}
I20260709 13:04:36.825655  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.825755  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:36.819592  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.824744 12296 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:36.826371  8200 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:36.726125 12126 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.826638  8194 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
W20260709 13:04:36.826879 12346 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.513s	user 0.005s	sys 0.007s
I20260709 13:04:36.827517  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.824383  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:36.768893  8811 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:36.769042  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 69481.1us
I20260709 13:04:36.828157  8198 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:36.758987 12302 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.772059  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.772403  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.772817 12250 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.829630 12195 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:36.773588  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.771274 11965 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:36.840695  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:36.840873  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 75181.7us
I20260709 13:04:36.777767  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.778537  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.813023  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.841809  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:36.814812  8269 raft_consensus.cc:2368] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:36.717734 12010 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:04:36.825855 12349 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.506s	user 0.004s	sys 0.011s
I20260709 13:04:36.828487 12296 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.830292  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.854377  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.824468  8193 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:36.797276  8266 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:36.830946  8116 raft_consensus.cc:2410] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:36.831393  8272 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:36.831857  8163 leader_election.cc:336] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.955s (SENT)
W20260709 13:04:36.809727 12383 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:36.829479  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:36.832902  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.833166  8194 raft_consensus.cc:2410] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:04:36.819551 12255 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.876698 12361 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:36.877568  8124 raft_consensus.cc:2368] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:36.878248  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.878934 12255 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:36.879462  8274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1794) took 3262 ms (client timeout 1953 ms). Trace:
W20260709 13:04:36.879853  8274 rpcz_store.cc:269] 0709 13:04:33.617278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.618452 (+  1174us) service_pool.cc:224] Handling call
0709 13:04:36.879288 (+3260836us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5400346f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.879399 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5307357440}
I20260709 13:04:36.879341  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.841696 12042 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:36.879315 12255 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:36.881299  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2239) took 1899 ms. Trace:
I20260709 13:04:36.881774 12255 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.881847  8120 rpcz_store.cc:276] 0709 13:04:34.982190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.119205 (+1137015us) service_pool.cc:224] Handling call
0709 13:04:36.119501 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.559416 (+439915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.559443 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.559483 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:36.559512 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.881078 (+321566us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400307354. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.881137 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.881247 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011274112}
I20260709 13:04:36.883180  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.884151  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:36.760201  8775 connection.cc:256] RPC call timeout handler was delayed by -1.5564434340000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:04:36.881280  8200 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:36.886417  8775 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:36.887269  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.836424  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:36.834940  8122 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:36.775599 12301 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.842938  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.842270  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.843902 11965 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:36.828261 12126 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.844868 12250 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.829460 12302 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:36.847026  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.891968  8807 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.892526  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.893044  8122 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.893445 12302 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.893754  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 760) took 1853 ms. Trace:
I20260709 13:04:36.894201  8269 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:36.894106  8268 rpcz_store.cc:276] 0709 13:04:35.040483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.040871 (+   388us) service_pool.cc:224] Handling call
0709 13:04:35.041151 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.109098 (+1067947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.893532 (+784434us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003b9f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:36.893680 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454761216}
I20260709 13:04:36.895278  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.894997 11965 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.895875  8268 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:04:36.887363  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.890599  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.897137  8120 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:36.890987 12373 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.888490 12325 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:36.889127  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 56289.6us
I20260709 13:04:36.898314  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.898654  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:36.898872  8121 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:36.899225  8120 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:36.899799  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.900416 12300 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:36.900914 12300 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:36.881670  8808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 800) took 1869 ms (client timeout 1636 ms). Trace:
I20260709 13:04:36.898063  8200 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:36.902200  8194 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:36.836611  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:36.849942  8117 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:36.896584  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:36.904386  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 62657.1us
I20260709 13:04:36.904799  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.840377 12195 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:36.758558 12071 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:04:36.855443  8163 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:36.855578  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.755035  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.859620  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:36.918978  8193 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:36.859900  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.920455  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.860576  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:36.833616  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:36.856680  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:36.922933  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 89382.5us
I20260709 13:04:36.828724 11908 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:36.861644  8089 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:36.862185 12375 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:36.862767 12003 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:36.864002 12352 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.550s	user 0.008s	sys 0.020s
I20260709 13:04:36.809962 12366 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.869055  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1813) took 2664 ms. Trace:
I20260709 13:04:36.859081 12296 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.810184 12174 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:36.847501 12185 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.818002 12330 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:36.870659 12211 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:36.871095  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.987510  8265 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:36.871893  8804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 699) took 2695 ms. Trace:
I20260709 13:04:36.874948 12252 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:36.875694  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.931522 12375 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.884603  8272 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:36.906494  8191 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:36.965744 12010 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:36.852229  8199 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:36.998649  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.999436  8265 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:36.902149  8808 rpcz_store.cc:269] 0709 13:04:35.012302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.012425 (+   123us) service_pool.cc:224] Handling call
0709 13:04:36.881487 (+1869062us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54004e8754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.881576 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411196672}
I20260709 13:04:36.849706  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:37.000264  8191 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:37.000687  8197 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:36.903786  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.900470  8121 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.887969 12276 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.910212  8267 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:37.006850  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:37.007818  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:37.008159  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:37.008813  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.911759  8122 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:37.009274  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:37.009826  8269 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:37.010301  8122 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:37.010587  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.860492  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:37.011840  8803 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.920703  8116 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:36.921528  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:37.013790  8266 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:37.014606  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:37.015609  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.923218  8196 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:36.927932  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.884068 12042 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:37.018798  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:37.019304 12042 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:36.910238 12265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.591s	user 0.011s	sys 0.017s
I20260709 13:04:37.019898  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:37.020394 12265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.702s	user 0.012s	sys 0.017s
I20260709 13:04:36.877725 12181 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:36.898108 12325 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:37.022073 12325 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.024617  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:37.025724  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:37.026290  8811 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
W20260709 13:04:36.930851  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 99016.1us
I20260709 13:04:36.930860  8274 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
W20260709 13:04:36.933948  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 72387.1us
I20260709 13:04:36.910000 12361 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.908859 12302 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:36.966588  8273 rpcz_store.cc:276] 0709 13:04:34.205131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.551480 (+346349us) service_pool.cc:224] Handling call
0709 13:04:34.551792 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.600986 (+ 49194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:34.622559 (+ 21573us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.027574 (+405015us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:35.028061 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.028195 (+   134us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:35.028633 (+   438us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.221555 (+192922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.221635 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.825380 (+1603745us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:36.868867 (+ 43487us) raft_consensus.cc:1685] finished
0709 13:04:36.868886 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.869002 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":414174,"prepare.queue_time_us":21804,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":441338,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":126627,"spinlock_wait_cycles":131915008,"thread_start_us":368498,"threads_started":2,"wal-append.queue_time_us":538177}
I20260709 13:04:37.031651  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:36.978554  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:36.980466  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:36.933451 12373 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:37.041127  8195 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:36.884428  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:36.932873 12327 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:37.044200  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.997866 12211 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:37.044653  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:36.992916  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:36.935880 12250 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:36.907001  8807 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:36.996995  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:36.901777 12300 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.003736  8268 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:37.016803  8270 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.020846  8265 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:36.978001 12251 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:04:36.994212 12375 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.030882  8809 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:04:37.027208 12276 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.031873  8274 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:37.029772  8163 leader_election.cc:336] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.026s (SENT)
W20260709 13:04:37.072515  8163 leader_election.cc:336] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.055s (SENT)
I20260709 13:04:37.072924  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:37.035916  8166 leader_election.cc:336] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.986s (SENT)
I20260709 13:04:37.073879  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:37.036219  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2235) took 2055 ms. Trace:
I20260709 13:04:37.075168  8123 rpcz_store.cc:276] 0709 13:04:34.980982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.909658 (+928676us) service_pool.cc:224] Handling call
0709 13:04:37.036077 (+1126419us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54000de154. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:37.036167 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154274048}
I20260709 13:04:37.042268  8119 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:37.042795  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 183815us
I20260709 13:04:36.988425  8804 rpcz_store.cc:276] 0709 13:04:34.176667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.191135 (+ 14468us) service_pool.cc:224] Handling call
0709 13:04:36.266466 (+2075331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.422956 (+156490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.871725 (+448769us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54007107d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:36.871841 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4772258688}
I20260709 13:04:37.020792 12376 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.029911 12010 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:37.055889  8271 raft_consensus.cc:2393] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:37.062543  8269 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:04:37.088188  8163 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.207s (SENT)
I20260709 13:04:37.095417  8269 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:37.040548  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:37.064785  8272 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:04:37.097297  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52715.2us
I20260709 13:04:37.077813  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:37.101567 12199 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:37.102273 12199 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.102626 12199 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:37.078563  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.054733  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:37.097553  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:37.103916  8803 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:37.092006  8265 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:04:37.097478 12277 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:37.043998 12327 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:37.054224 12302 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:37.121855  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.127426  8804 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:37.127705  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.065655 12042 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:37.128991  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:37.123055  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:37.066033 12373 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:37.079996 12064 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:37.121539  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:37.136081  8163 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:37.092006 12218 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.142597  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:37.144008  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.128958  8270 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:37.081961 12181 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:37.139978  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.061786 12340 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:04:37.149488  8271 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:37.150467  8777 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:37.136657 12071 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.156040  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:37.158390  8197 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:37.121269 12277 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.156077  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:37.128294 12055 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:37.134572 12262 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:37.142231 12307 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.184782  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2361) took 1206 ms. Trace:
I20260709 13:04:37.173321  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:37.159173  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:37.170565  8804 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:37.061607 12195 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.157498  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:37.188009  8197 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:37.187661  8198 rpcz_store.cc:276] 0709 13:04:35.978667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.046577 (+ 67910us) service_pool.cc:224] Handling call
0709 13:04:36.046875 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.829088 (+782213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.184507 (+355419us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400029ed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:37.184715 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796451072}
I20260709 13:04:37.188176  8196 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:37.122243 12250 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:04:37.154841 12150 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.157531 12325 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:37.157827 12181 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.159607 11965 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.171128 12055 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:37.186925 12277 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.158545 12380 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:37.188355 12307 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:37.223412  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:37.235867  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:37.222095  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.237816  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.191887 12064 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.153836 12218 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:37.199445 12187 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.209992 12386 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.192356 12071 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:04:37.217062  8012 maintenance_manager.cc:419] P b6992e613c544a1db779b61d07fa6870: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033397
W20260709 13:04:37.313742  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 76770.5us
I20260709 13:04:37.352989  8089 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:37.311935  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.333899  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 173403us
I20260709 13:04:37.242643 12307 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.243031 12382 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:37.355139  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 188853us
I20260709 13:04:37.234462 12380 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:37.242235 11904 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:37.326233 12174 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:37.349713 12276 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:37.359382  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.306494 12299 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:37.351897 12396 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:04:37.328378 12126 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.306318 12185 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:37.164394 12211 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:37.194078 12010 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:37.185436 12327 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.325510 12064 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.234259 12302 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.307986 12165 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 13:04:37.378645  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:37.367774 12391 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:04:37.337901 12340 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:04:37.385865  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:37.562637  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 176836us
I20260709 13:04:37.563767  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.367430 12380 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.339505 12366 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:37.390923  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.405074 12401 log.cc:927] Time spent T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:04:37.410101 12397 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:04:37.540263 12400 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.187s	user 0.003s	sys 0.006s
I20260709 13:04:37.307731 12373 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.352492 12386 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:37.377537 12299 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:37.368820 12382 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.387879 12185 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:37.620712 12185 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:37.621696 12296 consensus_meta.cc:287] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 13:04:37.622041 12386 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:37.623788 12407 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:04:37.622051 12296 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:37.388681 12317 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:37.557291  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:37.625833  8199 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
W20260709 13:04:37.626114 12408 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:04:37.626331 12296 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:37.577632  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.627460 12382 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:37.367316 12055 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.608101 12003 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:37.628646 12003 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:37.630589 12003 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:37.631242 12317 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.633778 12181 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:37.626842  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:37.634935  8199 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:37.620337 12398 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
W20260709 13:04:37.627415  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49901.3us
W20260709 13:04:37.540079 12395 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.405s	user 0.000s	sys 0.010s
W20260709 13:04:37.621563 12403 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:04:37.652711  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2344) took 3625 ms. Trace:
W20260709 13:04:37.584314 12255 consensus_meta.cc:287] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.672s	user 0.018s	sys 0.004s
W20260709 13:04:37.666463  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.653043  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.609889 12174 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:37.609591 12151 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:37.609967 12410 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:37.586382 12340 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:37.627705 12405 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:04:37.672132  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 309746us
I20260709 13:04:37.595304 12199 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:37.674422  8810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.002s	sys 0.010s
W20260709 13:04:37.723716  8810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.002s	sys 0.010s
I20260709 13:04:37.617728 12327 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:37.566208 12313 consensus_queue.cc:1175] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 13:04:37.620378 12299 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:37.687742  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 787554us
I20260709 13:04:37.729900  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:37.651994 12301 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.753847  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2368) took 1320 ms. Trace:
I20260709 13:04:37.755754  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 746) took 1009 ms. Trace:
I20260709 13:04:37.756114  8191 rpcz_store.cc:276] 0709 13:04:36.746612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.002451 (+255839us) service_pool.cc:224] Handling call
0709 13:04:37.002771 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.003206 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.003235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:37.018178 (+ 14943us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.158097 (+139919us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:37.158132 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.160872 (+  2740us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.755536 (+594664us) raft_consensus.cc:1685] finished
0709 13:04:37.755553 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.755697 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1552,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":24008,"thread_start_us":102638,"threads_started":1,"wal-append.queue_time_us":301694}
I20260709 13:04:37.672070  8192 rpcz_store.cc:276] 0709 13:04:34.026792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.611026 (+584234us) service_pool.cc:224] Handling call
0709 13:04:36.255791 (+1644765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.422612 (+166821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.652501 (+1229889us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400365450. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:37.652651 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3781960960}
I20260709 13:04:37.720458  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:37.593178 12307 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:37.721014  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 68036.7us
I20260709 13:04:37.718555 12340 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.718338 12410 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.695044 12151 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:37.683717 12174 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:37.754236  8193 rpcz_store.cc:276] 0709 13:04:36.433690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.929514 (+495824us) service_pool.cc:224] Handling call
0709 13:04:36.932202 (+  2688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.965592 (+ 33390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.965625 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.966093 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.141879 (+175786us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:37.306331 (+164452us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.328086 (+ 21755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.328163 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.753630 (+425467us) raft_consensus.cc:1685] finished
0709 13:04:37.753652 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.753790 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1418,"prepare.queue_time_us":244532,"prepare.run_cpu_time_us":537,"prepare.run_wall_time_us":1117,"raft.queue_time_us":33617,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":59373,"thread_start_us":227432,"threads_started":2,"wal-append.queue_time_us":223232}
W20260709 13:04:37.846150  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.755244 12376 consensus_meta.cc:287] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.630s	user 0.005s	sys 0.004s
W20260709 13:04:37.869498  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.837226 12410 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:37.928140 12362 consensus_meta.cc:287] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.023s	user 0.009s	sys 0.001s
W20260709 13:04:37.853410  8166 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.606s (SENT)
I20260709 13:04:37.958041  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:37.847486 12325 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.006s	sys 0.018s
I20260709 13:04:37.686702 12277 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.729269 12317 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:37.766594 12218 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:37.717885 12255 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:37.962441 12416 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:37.922310 12361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.023s	sys 0.053s
W20260709 13:04:38.223273 12042 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.086s	user 0.004s	sys 0.011s
I20260709 13:04:37.837585 12340 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:38.217796  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 364438us
W20260709 13:04:38.222559  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 492706us
I20260709 13:04:38.235141  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:38.090777 12003 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.236582 12003 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:38.180572 12398 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:04:38.171051  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 807) took 1150 ms. Trace:
I20260709 13:04:38.282361  8808 rpcz_store.cc:276] 0709 13:04:37.021140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.030044 (+  8904us) service_pool.cc:224] Handling call
0709 13:04:37.045435 (+ 15391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.045726 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.045757 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:37.062696 (+ 16939us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.193054 (+130358us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:37.193095 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.193159 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.170822 (+977663us) raft_consensus.cc:1685] finished
0709 13:04:38.170842 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.170985 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124389,"threads_started":1,"wal-append.queue_time_us":292559}
I20260709 13:04:37.940078 12174 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:37.975410 12325 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.007s	sys 0.018s
I20260709 13:04:37.936947 12409 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:38.240530  8806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.003s
W20260709 13:04:38.321645  8806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.022s	sys 0.003s
I20260709 13:04:37.997548 12181 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.217868 12151 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:38.232781 12361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.023s	sys 0.060s
I20260709 13:04:38.306819 12003 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:38.316387 12185 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.695s	user 0.000s	sys 0.006s
W20260709 13:04:38.319581 12375 consensus_meta.cc:287] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.252s	user 0.008s	sys 0.000s
I20260709 13:04:38.223290 12362 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.269168 12315 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.321440 12409 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.304811 12325 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:38.331651 12380 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.000s
W20260709 13:04:38.334038 12373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.003s	sys 0.009s
I20260709 13:04:38.347651 12409 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.399508 12424 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.414498 12307 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.341526 12362 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.416770 12362 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:38.423110 12299 consensus_meta.cc:287] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.588s	user 0.003s	sys 0.003s
I20260709 13:04:38.597900 12299 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.600651 12299 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:38.484992  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:38.439589 12327 consensus_meta.cc:287] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.000s
W20260709 13:04:38.485603  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.003s	sys 0.024s
W20260709 13:04:38.487110  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.488039  8121 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:38.218153  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:38.490860  8166 leader_election.cc:336] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.721s (SENT)
W20260709 13:04:38.217226  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:38.495645  8146 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 13:04:38.503177  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 711) took 1478 ms. Trace:
W20260709 13:04:38.517689 12010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.012s	sys 0.030s
W20260709 13:04:38.609534 12010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.012s	sys 0.030s
I20260709 13:04:38.608969  8803 rpcz_store.cc:276] 0709 13:04:37.024670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.166986 (+142316us) service_pool.cc:224] Handling call
0709 13:04:37.167337 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:37.167766 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.167804 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:37.188593 (+ 20789us) log.cc:844] Serialized 52 byte log entry
0709 13:04:37.725130 (+536537us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:37.725168 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.725230 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.502443 (+777213us) raft_consensus.cc:1685] finished
0709 13:04:38.502500 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.502896 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8272,"raft.queue_time_us":3665,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7329,"thread_start_us":399135,"threads_started":1,"wal-append.queue_time_us":1226109}
I20260709 13:04:38.611946  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:38.517786 12195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.016s	sys 0.079s
I20260709 13:04:38.612257  8125 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:38.612533 12195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.016s	sys 0.079s
I20260709 13:04:38.366366 12199 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:38.331554 12185 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.616094 12185 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:38.346313 12315 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.616974  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53272 (request call id 14) took 2172 ms. Trace:
I20260709 13:04:38.617411  8122 rpcz_store.cc:276] 0709 13:04:36.444437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.010951 (+566514us) service_pool.cc:224] Handling call
0709 13:04:38.616401 (+1605450us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b54003ff2d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2e735 00007fbd29ceed29 00007fbd2326d1d4 00007fbd2326d162 00007fbd2326d091 00007fbd2326d00c 00007fbd2326c2c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:38.616715 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14136192}
I20260709 13:04:38.333405 12375 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.441078 12410 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.623903 12410 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:38.439186 12424 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.367352 12380 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.328033  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 809) took 1306 ms. Trace:
W20260709 13:04:38.394171 12373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.003s	sys 0.009s
W20260709 13:04:38.629223  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 138618us
I20260709 13:04:38.450551 12423 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:38.630949  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2251) took 1765 ms. Trace:
I20260709 13:04:38.457943 12436 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:38.326762 12181 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.586637 12277 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.590091 12317 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:38.593679  8191 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:38.594172  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 811) took 1571 ms. Trace:
I20260709 13:04:38.595983 12325 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.009865  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2108) took 1577 ms. Trace:
I20260709 13:04:38.603274  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:38.562196  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 343815us
W20260709 13:04:38.607560  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.003s	sys 0.025s
W20260709 13:04:38.581319 11965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.005s
I20260709 13:04:38.631351  8121 rpcz_store.cc:276] 0709 13:04:36.865905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.002197 (+136292us) service_pool.cc:224] Handling call
0709 13:04:37.002603 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.626982 (+1624379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.630637 (+  3655us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540033c054. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:38.630852 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3415026432}
I20260709 13:04:38.689199  8196 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.690519  8117 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
W20260709 13:04:38.710798  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 1.80559e+06us
W20260709 13:04:38.632588  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.740432  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 778) took 1037 ms. Trace:
I20260709 13:04:38.691256  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2245) took 1855 ms. Trace:
I20260709 13:04:38.756966  8267 rpcz_store.cc:276] 0709 13:04:37.678845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.679416 (+   571us) service_pool.cc:224] Handling call
0709 13:04:37.679741 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.679948 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.679973 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:38.249846 (+569873us) log.cc:844] Serialized 26 byte log entry
0709 13:04:38.577060 (+327214us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:38.577137 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.577248 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.716276 (+139028us) raft_consensus.cc:1685] finished
0709 13:04:38.716302 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.716632 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":83954,"threads_started":1,"wal-append.queue_time_us":292466}
W20260709 13:04:38.759943  8195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 749) took 2011 ms (client timeout 1878 ms). Trace:
W20260709 13:04:38.760646  8195 rpcz_store.cc:269] 0709 13:04:36.748222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.792948 (+ 44726us) service_pool.cc:224] Handling call
0709 13:04:38.759458 (+1966510us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540022c754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:38.759669 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516002176}
I20260709 13:04:38.632970 12010 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.751818  8191 pending_rounds.cc:85] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:04:38.607592 12430 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:38.761940  8265 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:38.762923  8194 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:38.713213 12392 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.557s	user 0.045s	sys 0.073s
W20260709 13:04:38.693612  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.634s (SENT) [suppressed 43 similar messages]
W20260709 13:04:38.763674 12443 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:04:38.764793 12218 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:04:38.695032 12440 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:04:38.755857  8117 pending_rounds.cc:85] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 10
W20260709 13:04:38.709023  8163 leader_election.cc:336] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.666s (SENT)
I20260709 13:04:38.756914  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 819) took 1116 ms. Trace:
I20260709 13:04:38.767902  8191 pending_rounds.cc:107] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:38.785959  8117 pending_rounds.cc:107] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:04:38.771726 12010 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.772110 12317 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.775682  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:38.786623  8808 rpcz_store.cc:276] 0709 13:04:37.638562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.602506 (+963944us) service_pool.cc:224] Handling call
0709 13:04:38.754645 (+152139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:38.750938  8810 rpcz_store.cc:276] 0709 13:04:37.022473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.069052 (+ 46579us) service_pool.cc:224] Handling call
0709 13:04:37.121946 (+ 52894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.724039 (+602093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.724070 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:38.216942 (+492872us) log.cc:844] Serialized 26 byte log entry
0709 13:04:38.531795 (+314853us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:38.555528 (+ 23733us) log.cc:844] Serialized 14 byte log entry
0709 13:04:38.593557 (+ 38029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.593683 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.593733 (+    50us) raft_consensus.cc:1685] finished
0709 13:04:38.593743 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.594005 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13307,"prepare.queue_time_us":23488,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":27814,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":4863,"thread_start_us":925584,"threads_started":3,"wal-append.queue_time_us":238632}
I20260709 13:04:38.757432  8125 rpcz_store.cc:276] 0709 13:04:36.835450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.901531 (+ 66081us) service_pool.cc:224] Handling call
0709 13:04:38.611270 (+1709739us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:38.611839 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.619560 (+  7721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.691162 (+ 71602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8229632}
W20260709 13:04:38.788719  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 79907.4us
I20260709 13:04:38.792788 12218 consensus_queue.cc:1059] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:38.793640 12430 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.799925 12218 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:38.800530 12218 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:38.707458 12362 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:38.802129  8803 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.802757 12362 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:38.805583 11965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.008s	sys 0.012s
I20260709 13:04:38.802125 12218 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:38.807389  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 507937us
I20260709 13:04:38.808650 12362 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:38.809628 12340 consensus_meta.cc:287] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.007s
I20260709 13:04:38.810210 12340 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.812248 12340 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:38.812637 12010 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.760653 12190 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.816378 12190 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.817615  8803 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:38.818039 12251 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:04:38.818647 12190 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.786713  8191 raft_consensus.cc:2889] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.810055 12218 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.819861  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1992) took 1581 ms. Trace:
I20260709 13:04:38.820211  8191 rpcz_store.cc:276] 0709 13:04:37.238729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.757414 (+518685us) service_pool.cc:224] Handling call
0709 13:04:38.592807 (+835393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.819466 (+226659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.819655 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:38.814016  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:38.813647 12436 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.823105 12436 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:38.814781  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48052.6us
I20260709 13:04:38.786959  8117 raft_consensus.cc:2889] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.628379  8806 rpcz_store.cc:276] 0709 13:04:37.021937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.029855 (+  7918us) service_pool.cc:224] Handling call
0709 13:04:37.030137 (+   282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:37.037923 (+  7786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.037950 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:37.044455 (+  6505us) log.cc:844] Serialized 52 byte log entry
0709 13:04:37.202225 (+157770us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:37.231798 (+ 29573us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.355586 (+123788us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.610448 (+254862us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b1800374140. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:04:38.321964 (+711516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.322044 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.327799 (+  5755us) raft_consensus.cc:1685] finished
0709 13:04:38.327824 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.327971 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2708,"prepare.queue_time_us":36972,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":11527,"raft.queue_time_us":206937,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":25515,"spinlock_wait_cycles":10633856,"thread_start_us":904473,"threads_started":3,"wal-append.queue_time_us":298270,"wal-append.run_cpu_time_us":3365,"wal-append.run_wall_time_us":1317774}
I20260709 13:04:38.810151  8804 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:38.843562  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 149977us
I20260709 13:04:38.807974  8118 rpcz_store.cc:276] 0709 13:04:36.432070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.830679 (+398609us) service_pool.cc:224] Handling call
0709 13:04:36.830964 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:36.850006 (+ 19042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.850035 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:36.863301 (+ 13266us) log.cc:844] Serialized 52 byte log entry
0709 13:04:36.953981 (+ 90680us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.954025 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.954106 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.009588 (+1055482us) raft_consensus.cc:1685] finished
0709 13:04:38.009610 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.009799 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9856,"raft.queue_time_us":39053,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":90286,"threads_started":1,"wal-append.queue_time_us":203106}
I20260709 13:04:38.852548  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:38.854347  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:38.854669 12409 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:38.845999  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 1.49302e+06us
I20260709 13:04:38.779366 12174 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.849095 12315 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.866612  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2246) took 2028 ms. Trace:
I20260709 13:04:38.868904  8117 rpcz_store.cc:276] 0709 13:04:36.836016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.903452 (+ 67436us) service_pool.cc:224] Handling call
0709 13:04:38.689329 (+1785877us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800000c98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:38.689775 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.863181 (+173406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.864711 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5308160}
I20260709 13:04:38.872684 11965 raft_consensus.cc:2764] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:04:38.881886  8802 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:38.882097 12373 raft_consensus.cc:2764] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:04:38.882294 12430 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.881959  8270 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:38.869590  8166 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.765s (SENT)
I20260709 13:04:38.865967 12251 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.888466  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:38.888727 12375 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:38.892243  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.893743 12362 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:38.894899  8199 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:38.895756  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2380) took 1746 ms. Trace:
W20260709 13:04:38.896314  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 82487.1us
I20260709 13:04:38.867156 12255 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.905681 12307 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.906363 12307 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:38.907564  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 82138.4us
I20260709 13:04:38.909451  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:38.918495 12380 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.894500 12362 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.941720 12218 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:38.942512 12218 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.942988 12218 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:38.943125  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.941788  8091 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:38.944583 12252 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.944693 12380 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:38.945580 12380 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.947844 12361 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:38.948307 12361 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:38.948757 12174 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.949977 12361 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:38.950634  8163 leader_election.cc:336] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.918s (SENT)
I20260709 13:04:38.951150  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:38.951495 12361 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.953548 12362 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:38.954116 12362 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:38.950366  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:38.954806 12362 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:38.955250 12252 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.944782 12300 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:38.896085  8199 rpcz_store.cc:276] 0709 13:04:37.148798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.684322 (+535524us) service_pool.cc:224] Handling call
0709 13:04:38.892800 (+1208478us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:38.893137 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.895341 (+  2204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.895665 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740712192}
I20260709 13:04:38.948189 12380 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:38.969563  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 66296us
I20260709 13:04:38.970561  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:38.966310 12419 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.344s	user 0.019s	sys 0.019s
I20260709 13:04:38.975065 12424 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:38.975936 12424 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:38.980541  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:38.979512  8238 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:38.969702 12190 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:04:38.971613 12380 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:38.986871 12251 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.017621  8117 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.010083 12409 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:39.029557  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2120) took 2230 ms. Trace:
I20260709 13:04:39.030202  8271 rpcz_store.cc:276] 0709 13:04:36.757179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.094537 (+337358us) service_pool.cc:224] Handling call
0709 13:04:37.149313 (+ 54776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.153095 (+  3782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.970461 (+1817366us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b5400308ed0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:38.987462 (+ 17001us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125331712}
I20260709 13:04:39.030879  8125 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:39.032373  8118 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:39.033478  8121 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:04:39.034550  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 153669us
I20260709 13:04:39.034802  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:39.036003  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:39.036370  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 155122us
I20260709 13:04:39.036513 12439 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.037212 12439 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.037855 12315 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:39.038277 12315 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.038654 12315 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:39.040126 12261 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:04:39.029577 12380 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.042289  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:39.042744 12151 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.044021 12380 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.044633 12380 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:39.046326  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 816) took 1665 ms. Trace:
I20260709 13:04:39.047473  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2379) took 1898 ms. Trace:
I20260709 13:04:39.046690  8811 rpcz_store.cc:276] 0709 13:04:37.381338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.381489 (+   151us) service_pool.cc:224] Handling call
0709 13:04:37.381821 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.383644 (+  1823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.383674 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:37.387614 (+  3940us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.544119 (+156505us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:37.544158 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.544224 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.913840 (+1369616us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:39.045889 (+132049us) raft_consensus.cc:1685] finished
0709 13:04:39.045911 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:39.046137 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1455,"raft.queue_time_us":23725,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":31198592,"thread_start_us":156133,"threads_started":1,"wal-append.queue_time_us":234031}
I20260709 13:04:39.047837  8196 rpcz_store.cc:276] 0709 13:04:37.148583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.219171 (+ 70588us) service_pool.cc:224] Handling call
0709 13:04:37.325477 (+106306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.762138 (+1436661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.047193 (+285055us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540002a8d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:39.047416 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2971504896}
I20260709 13:04:39.043955  8265 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:04:39.050884  8166 leader_election.cc:336] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.733s (SENT)
I20260709 13:04:39.057596  8192 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:39.057932 12071 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:39.058516  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1994) took 1819 ms. Trace:
I20260709 13:04:39.058794 12071 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.060462  8192 rpcz_store.cc:276] 0709 13:04:37.239224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.757831 (+518607us) service_pool.cc:224] Handling call
0709 13:04:39.056822 (+1298991us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:39.057210 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:39.058093 (+   883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.058431 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748681088}
I20260709 13:04:39.072574 12439 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.073956  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:39.074988  8271 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:39.077288  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:39.078496 12430 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:39.079119 12430 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:39.045265 12380 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.084463  8117 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:39.083873 12261 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:39.086272 12261 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:39.092598  8166 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.733s (SENT)
I20260709 13:04:39.094131 12429 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:39.094312  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:39.095062  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 144523us
I20260709 13:04:39.095611  8118 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
W20260709 13:04:39.095820  8163 leader_election.cc:336] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.964s (SENT)
I20260709 13:04:39.095971 12453 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.096335  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:39.089476 12261 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.059347 12327 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:39.102409  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:39.100430  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.106289 12327 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:39.100204  8118 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:04:39.107707 12304 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:39.097149 12424 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.100816  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:39.101711  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.108875  8125 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.109318 12441 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:39.109890 12441 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:39.110782 12441 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.098727  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:39.112142 12441 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.104398  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.084698 12307 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.101212  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.105728 12453 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.102418  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2369) took 2635 ms. Trace:
I20260709 13:04:39.114478  8200 rpcz_store.cc:276] 0709 13:04:36.466659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.932764 (+466105us) service_pool.cc:224] Handling call
0709 13:04:36.935863 (+  3099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.092898 (+157035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.092933 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.092977 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:37.093008 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.102019 (+2009011us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003c41d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:39.102080 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:39.102241 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360656256}
I20260709 13:04:39.101823  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:39.115782 12453 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.116304 12327 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.116422  8119 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:39.116693 12327 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:39.117543 12317 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.118656  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2249) took 2272 ms. Trace:
I20260709 13:04:39.119014  8124 rpcz_store.cc:276] 0709 13:04:36.846095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.909377 (+ 63282us) service_pool.cc:224] Handling call
0709 13:04:36.909654 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.033593 (+123939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.033622 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.033662 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:37.033692 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.065420 (+2031728us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54004097d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:39.084210 (+ 18790us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:39.118491 (+ 34281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284611968}
I20260709 13:04:39.097208 12380 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.120625  8125 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:39.122023 12380 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.109390  8117 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:04:39.103049  8193 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 13:04:39.100559  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64709.1us
W20260709 13:04:39.105793  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 88230.8us
W20260709 13:04:39.122064  8166 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.865s (SENT)
W20260709 13:04:39.135254  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 180623us
I20260709 13:04:39.124171  8193 pending_rounds.cc:85] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:04:39.135953  8193 pending_rounds.cc:107] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:04:39.136226  8193 raft_consensus.cc:2889] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:39.139201  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:39.103148  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:39.108053 12181 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:39.142786  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 100769us
I20260709 13:04:39.100123 12430 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.148684 12010 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:39.149256 12261 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.149794  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.122888 12304 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.152274 12304 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:39.154230  8811 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:39.098397 12265 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:04:39.157970 12218 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.154310  8805 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:39.162894  8123 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:39.168042  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:39.168386  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 72649.5us
I20260709 13:04:39.170428  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:39.167303  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1996) took 1927 ms. Trace:
I20260709 13:04:39.172312  8193 rpcz_store.cc:276] 0709 13:04:37.239707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.928931 (+689224us) service_pool.cc:224] Handling call
0709 13:04:39.089119 (+1160188us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:39.102451 (+ 13332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:39.165967 (+ 63516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.167237 (+  1270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796278528}
I20260709 13:04:39.159075 12064 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.146677 12307 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.176579  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.177558  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:39.178220  8166 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.098s (SENT)
I20260709 13:04:39.185837  8266 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:39.186457  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.187233  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.187836  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:39.188287  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.189515  8805 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.194988 12265 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:39.170125 12181 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.196170  8265 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:04:39.197085 12218 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:39.197885  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.199975  8811 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:39.176072 12362 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:39.208150  8268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1827) took 2427 ms (client timeout 1961 ms). Trace:
W20260709 13:04:39.208659  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62419.9us
I20260709 13:04:39.210748 12327 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:39.212137  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85787.9us
I20260709 13:04:39.203528 12455 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:39.213006 12150 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:39.213786  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 817) took 1600 ms. Trace:
W20260709 13:04:39.216025  8268 rpcz_store.cc:269] 0709 13:04:36.780373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.896380 (+116007us) service_pool.cc:224] Handling call
0709 13:04:39.177731 (+2281351us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b5400346054. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:39.207939 (+ 30208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228448640}
I20260709 13:04:39.213754  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:39.221757  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 76256.9us
I20260709 13:04:39.219811  8802 rpcz_store.cc:276] 0709 13:04:37.613152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.613292 (+   140us) service_pool.cc:224] Handling call
0709 13:04:37.613591 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.882414 (+1268823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.213513 (+331099us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54005401d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:39.213727 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897766784}
I20260709 13:04:39.196586 12181 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.225468  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:39.225606 12455 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.228271 12455 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.228677 12302 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:39.229867  8193 raft_consensus.cc:2410] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:04:39.228210  8775 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:39.231506  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.231660 12439 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:39.232239 12439 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:39.232960  8163 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.609s (SENT)
I20260709 13:04:39.233628  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:39.233318 12439 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.221743 12150 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:39.232240  8200 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:39.237270  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:39.237833  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 1978) took 2853 ms. Trace:
I20260709 13:04:39.203747 12454 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:39.238076  8804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 815) took 2145 ms. Trace:
I20260709 13:04:39.218278 12064 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:39.247352  8804 rpcz_store.cc:276] 0709 13:04:37.092928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.200326 (+107398us) service_pool.cc:224] Handling call
0709 13:04:37.200631 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.860537 (+1659906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.237828 (+377291us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54005f0854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:39.238010 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3641108224}
I20260709 13:04:39.247026  8194 rpcz_store.cc:276] 0709 13:04:36.384888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.903569 (+518681us) service_pool.cc:224] Handling call
0709 13:04:38.762453 (+1858884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.769133 (+  6680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.222633 (+453500us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540022c750. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:39.237774 (+ 15141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4274298240}
I20260709 13:04:39.245772  8805 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:39.252199  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.252439 12150 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.253841 12150 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.254173  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:39.254933 12406 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.883s	user 0.026s	sys 0.033s
I20260709 13:04:39.255263  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.255498 12427 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.254911  8265 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:39.255997 12427 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.262069 12342 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:39.248420  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:39.263006  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:39.258989  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:39.266369  8269 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:39.269915  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:39.270367  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.269851  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:39.272594  8120 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:39.246810 12362 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:39.273869 12362 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.274358 12265 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.273593  8193 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.275148 12426 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.275779 12426 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.274891 12265 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.277549 12064 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.278486 12265 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:39.279464 12064 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.280619 12426 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.280817 12151 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.281787  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2111) took 2526 ms. Trace:
I20260709 13:04:39.244729 12071 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:39.287495  8193 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:39.269438 12455 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.276304 12362 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:39.292953  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51143.6us
I20260709 13:04:39.282138  8273 rpcz_store.cc:276] 0709 13:04:36.755073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.038089 (+283016us) service_pool.cc:224] Handling call
0709 13:04:37.038395 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:37.038711 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.038737 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:37.044725 (+  5988us) log.cc:844] Serialized 52 byte log entry
0709 13:04:37.160676 (+115951us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:37.672668 (+511992us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.672919 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.672988 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.920361 (+1247373us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b180032fe60. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c092a6 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db
0709 13:04:39.254259 (+333898us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:39.263210 (+  8951us) raft_consensus.cc:1685] finished
0709 13:04:39.263286 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:39.281550 (+ 18264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33232,"prepare.queue_time_us":206923,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":939,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":22315,"spinlock_wait_cycles":24285184,"thread_start_us":531945,"threads_started":2,"wal-append.queue_time_us":238596}
W20260709 13:04:39.302780  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.949s (SENT)
I20260709 13:04:39.303543 12307 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:39.282153 12300 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:39.295656 12361 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:39.308017 12361 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.308373 12361 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:39.273887 12055 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.314153 12327 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.283595 12315 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.316664  8192 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:39.316861  8194 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:04:39.317515  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.317920 12315 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:39.321494  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 88612.5us
W20260709 13:04:39.322577  8163 leader_election.cc:336] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.721s (SENT)
I20260709 13:04:39.272519 12454 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.322938  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:39.326774 12307 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:39.327419 12454 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:39.327801  8163 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.765s (SENT)
I20260709 13:04:39.328167  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:39.328642 12375 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:39.332336  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:39.333526  8777 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:39.334666 12426 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:39.334972 12265 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:39.335038 12426 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.336347 12426 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.341966  8273 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:39.317689  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.344205  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:39.347925 12455 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.349524 12327 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:39.350111 12327 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.350620 12427 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:39.335152  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 72351.2us
I20260709 13:04:39.352147  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:39.354925  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:39.355953 12165 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:39.356906  8166 leader_election.cc:336] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.227s (SENT)
I20260709 13:04:39.357558  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:39.359440  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.360230  8200 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.361871  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.362028 12218 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:39.362636  8194 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:39.362629 12218 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:39.365435 12218 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.342573  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 779) took 1663 ms. Trace:
W20260709 13:04:39.361603  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64375.1us
I20260709 13:04:39.371482 12327 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:39.372655  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:39.373600 12365 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:39.375474 12365 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:39.350034 12455 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:39.377388  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet d6579e4214554536b3727b869a8aedfa: Illegal state: Replica 65d66cd655cd4400b079b4427061ca5e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:39.378333  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.378747  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.379891  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.380368  8199 raft_consensus.cc:2393] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:39.380878  8195 raft_consensus.cc:2410] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:39.381294  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:39.381568 12461 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:39.379391  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.379148  8192 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.369508  8270 rpcz_store.cc:276] 0709 13:04:37.679135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.685484 (+  6349us) service_pool.cc:224] Handling call
0709 13:04:37.685774 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.902969 (+1217195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.342307 (+439338us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400074c54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:39.342508 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2747441408}
I20260709 13:04:39.382267  8191 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:39.381876  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.383181  8195 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.383674 12307 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.385272 12307 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.386243  8199 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.387176 12181 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.383272  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.387926  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:39.388342  8191 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:39.388567  8265 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:39.388800  8273 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:04:39.389302  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61536us
W20260709 13:04:39.390406  8163 leader_election.cc:336] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.101s (SENT)
I20260709 13:04:39.390794  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:39.392037  8163 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.219s (SENT)
W20260709 13:04:39.393050  8163 leader_election.cc:336] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.222s (SENT)
I20260709 13:04:39.393404  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:39.394016 12455 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:39.355209 12261 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:04:39.397864 12301 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:39.398694 12426 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:39.401228  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.401804  8195 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:39.397161  8192 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:39.397229  8811 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:39.406843  8191 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:39.408368  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:39.413717  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.414324  8805 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:39.409834 12165 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:39.416404  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:39.416702  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 1c80cbb5d28348cdbb8e0e9ef4d3bf28: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:39.424986 12426 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.427402  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.428540  8197 raft_consensus.cc:2410] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:39.428902  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:39.431879  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.431748  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.433316  8802 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:39.429061  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.434440  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.432651  8807 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:39.411222 12181 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.439641  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.408200 12373 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:04:39.416463 12165 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:39.447703  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:39.448398  8120 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:39.444128  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.445922 12071 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:39.446702  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53688.3us
I20260709 13:04:39.446866  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.451889  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.452565  8195 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:39.457846 12181 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.458415 12181 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.458352 12165 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.460126 12165 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:39.461472  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:39.462533  8807 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:39.468633  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:39.473101  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.457324 12218 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:39.477334  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:39.478016  8269 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:39.480123 12463 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:04:39.484226  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:39.453434 12071 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:39.456781 12427 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.497593  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:39.500020  8195 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:39.501717  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:39.474910 12302 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:39.514747 12071 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:39.515686  8023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 168) took 13461 ms (client timeout 15000 ms). Trace:
I20260709 13:04:39.521049 12427 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.532516  8199 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
W20260709 13:04:39.533883 12468 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:04:39.534109 12361 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:39.536054  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.482129 12455 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.536618  8191 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:39.569111  8200 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:39.588861 12365 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.589481 12365 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.589618 12455 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:39.485679 12218 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:39.503978 12255 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.615907  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:39.616838 12252 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:39.618686 12252 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.617609 12362 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:39.620929 12362 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:39.591281 12300 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:39.505923 12302 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:39.498415 12373 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:04:39.639582 12362 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.501292 12375 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:04:39.697754  8020 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:39.699774  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 82454.9us
I20260709 13:04:39.698048 12302 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:39.607151 12181 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:39.622556 12424 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.703794  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.134042  8192 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:40.135802  8200 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:40.136256  8200 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:39.710090 12365 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:40.000494  8271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.075s	sys 0.092s
W20260709 13:04:40.137703  8271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.075s	sys 0.098s
I20260709 13:04:39.648322 12255 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.140594 12255 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:40.141307 12424 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.143959 12071 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.710233 12010 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:40.145898  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.146330 12010 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.149299 12010 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:40.147248  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:39.706523 12469 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:04:40.151533  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:40.151841  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet e8843c2ad2d543b89354e114ebd9d638: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:40.153134  8270 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:39.640483 12300 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.153671 12300 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.707525  8020 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 5 to 6, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 6 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:39.516155  8023 rpcz_store.cc:269] 0709 13:04:26.053900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.054150 (+   250us) service_pool.cc:224] Handling call
0709 13:04:39.515447 (+13461297us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:33.615659 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:33.625693 (+ 10034us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:33.625728 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:04:33.629557 (+  3829us) tablet.cc:662] Decoding operations
0709 13:04:33.711756 (+ 82199us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:33.711813 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:33.711841 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:04:33.712958 (+  1117us) tablet.cc:701] Row locks acquired
0709 13:04:33.712972 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:04:33.713108 (+   136us) write_op.cc:270] Start()
0709 13:04:33.713209 (+   101us) write_op.cc:276] Timestamp: P: 1783602273713065 usec, L: 0
0709 13:04:33.713225 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:04:33.772473 (+ 59248us) log.cc:844] Serialized 6738 byte log entry
0709 13:04:36.268368 (+2495895us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:36.808572 (+540204us) op_driver.cc:464] REPLICATION: finished
0709 13:04:37.034044 (+225472us) write_op.cc:301] APPLY: starting
0709 13:04:37.040376 (+  6332us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:37.150560 (+110184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:37.154325 (+  3765us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:37.550440 (+396115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:37.550860 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:04:37.550936 (+    76us) write_op.cc:312] APPLY: finished
0709 13:04:37.551301 (+   365us) log.cc:844] Serialized 119 byte log entry
0709 13:04:37.551477 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:37.551656 (+   179us) write_op.cc:454] Released schema lock
0709 13:04:37.551713 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:37.552119 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:37.552150 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2504901,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":195059,"apply.run_cpu_time_us":5451,"apply.run_wall_time_us":544048,"num_ops":17,"prepare.queue_time_us":179677,"prepare.run_cpu_time_us":75705,"prepare.run_wall_time_us":484135,"raft.queue_time_us":266892,"raft.run_cpu_time_us":22400,"raft.run_wall_time_us":121145,"replication_time_us":3095202,"spinlock_wait_cycles":9049856,"thread_start_us":623184,"threads_started":4,"wal-append.queue_time_us":577538,"wal-append.run_cpu_time_us":80092,"wal-append.run_wall_time_us":4240148}]]}
I20260709 13:04:39.951553 12375 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.165912 12375 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.167971 12302 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:40.170011  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 223841us
I20260709 13:04:40.171491  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:39.968999 12218 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.170258  8020 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 9 to 10, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 10 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.175216 11908 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:40.174978  8020 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.176123 12424 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:40.176663  8020 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 4 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 7 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:39.849964  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:40.178575  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.179384 12315 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.179821 12315 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.180447  8273 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:40.180719  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.181491  8270 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:40.182107 12315 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:40.183269  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:40.184181 12413 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:40.185003 11908 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:40.185410 11908 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.185738 11908 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.190742 12300 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.192924 12300 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:40.194231  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.194938  8805 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:39.848658 12261 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.197569  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:39.852062  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63649.8us
I20260709 13:04:40.196913  8802 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:40.178086  8020 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 6 to 8, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:39.880297  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:39.788765  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.203364  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:40.205740  8807 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:04:40.206640  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.207840  8805 raft_consensus.cc:2410] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:40.208498  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:40.211750  8806 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.209321  8195 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:39.712972 12464 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
I20260709 13:04:39.810760 12429 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:40.197621 12261 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.221411 12427 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:40.222059 12455 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:40.222545  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.222906  8802 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:39.863634 12361 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:39.846968 12277 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:39.848526 12151 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.168013 12375 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:40.238093  8811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.050s	sys 0.049s
I20260709 13:04:40.267454  8117 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:40.244730  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:40.268898  8811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.050s	sys 0.049s
I20260709 13:04:40.269310  8805 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:40.253568  8270 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:40.253750  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.256942  8125 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:40.267122 12165 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:40.238261  8124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:04:40.229748 12429 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:40.234584 12307 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.267030  8119 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:40.267046  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:40.264942  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.270706  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:40.258654  8200 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.273957  8124 raft_consensus.cc:606] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
W20260709 13:04:40.267973  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 96556.2us
W20260709 13:04:40.274817  8269 consensus_meta.cc:287] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.774s	user 0.005s	sys 0.002s
I20260709 13:04:40.277534  8124 raft_consensus.cc:614] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:40.277900  8269 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:40.278867  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.279973  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.279173  8120 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:40.281106  8195 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:40.281623 12252 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:40.281797 12071 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.282433 12071 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.285895  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.286993  8020 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 4 to 9, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.245119 12475 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:40.206853 11908 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.261868 12277 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:40.296618  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:40.290297  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.293311  8775 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:40.282035 12261 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:40.299178  8197 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:40.302284  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.302780  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:40.303105  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.303470  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.304024  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:40.267511 12427 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:04:40.234275 12181 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:04:40.306275  8777 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:40.299371  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.313997  8194 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:40.314579  8808 raft_consensus.cc:2368] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14.
I20260709 13:04:40.305861  8198 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:40.304605 12439 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:40.309481  8809 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:40.289094 12165 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.310065  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.311231  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.311965  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:40.295471 12475 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:40.320011  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.323407  8200 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.322309  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.324167  8120 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:40.325845  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.329659  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.330137 12455 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:40.330535 12455 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.330874 12455 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:40.333461  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.335054  8191 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:40.283911 12151 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.341429  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 790) took 1172 ms. Trace:
I20260709 13:04:40.295845 12307 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.341773  8119 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:40.346429  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.342720  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:40.346993  8194 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.344094  8118 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:40.344660  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.344760  8120 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:04:40.320489 12424 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:40.325578 12315 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:40.349831  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.350138 12315 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:40.343713  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.350629  8122 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.351313 12151 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:40.351835  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.346854  8020 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 9 to 10, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 10 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.347791  8270 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:40.351233  8809 raft_consensus.cc:2393] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 9: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:40.298177 12218 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:40.355731  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.356771  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.341841  8267 rpcz_store.cc:276] 0709 13:04:39.169019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.171676 (+  2657us) service_pool.cc:224] Handling call
0709 13:04:39.183073 (+ 11397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.217993 (+ 34920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.218015 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:39.238389 (+ 20374us) log.cc:844] Serialized 26 byte log entry
0709 13:04:39.312578 (+ 74189us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:39.312618 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.312692 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:39.712392 (+399700us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:40.335363 (+622971us) raft_consensus.cc:1685] finished
0709 13:04:40.335383 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.341253 (+  5870us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11824,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":5312,"spinlock_wait_cycles":63834496,"thread_start_us":64757,"threads_started":1,"wal-append.queue_time_us":230221}
I20260709 13:04:40.357836  8805 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:40.359730  8121 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:40.327657 12475 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:40.360021  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.360831  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:40.361515  8020 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 10, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 10 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.317643 12261 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:04:40.363040  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.364365  8191 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:40.365281  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.364152  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.366206  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.365859  8120 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.367672  8198 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:40.369525  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.372011  8193 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:40.350642 12315 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.373062  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:40.373422  8811 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:40.349886 12424 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:40.341818 12181 consensus_queue.cc:1243] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:40.382872  8089 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.379958 12480 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:40.379351  8200 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:04:40.352614 12071 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:40.385587  8200 pending_rounds.cc:85] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:04:40.352025 12151 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:04:40.385948  8200 pending_rounds.cc:107] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 13:04:40.387102  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 67708.5us
I20260709 13:04:40.390322  8200 raft_consensus.cc:2889] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.391455  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:40.383833  8802 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:40.386396  8020 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:40.388295  8163 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.865s (SENT)
I20260709 13:04:40.341107 12165 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.388775  8191 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:40.404987  8191 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:40.400481  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:40.383271 12252 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:40.410902  8193 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:40.411345  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:40.412149  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.428705  8120 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:40.410354 12373 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:40.448643  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.445547  8191 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.363289 12429 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:40.453620  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47314.8us
I20260709 13:04:40.412191 12071 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:04:40.456341 12479 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:40.457836  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.458722  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.483500  8194 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:40.461480  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.461898 12165 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:40.462649  8268 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:40.462515  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.438279 12055 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:04:40.462931 12424 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.403227 12439 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:04:40.416596 12252 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.411430 12413 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:04:40.464600  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.465512  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.450901 12255 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:40.470104 12472 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:04:40.471645  8020 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.436784 12427 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:40.472960  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 84698.8us
W20260709 13:04:40.474735  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:40.475718  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 150477us
I20260709 13:04:40.462925  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.484369  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:40.486876 12375 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:40.486959  8270 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:40.489313  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:40.454012 12181 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:40.499809  8274 raft_consensus.cc:2410] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:40.475263 12071 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:40.483464  8265 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:40.503538  8191 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:40.499840  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.515659  8268 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.508615  8272 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:40.509841  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.510888  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.392146 12277 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.531057  8806 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:40.531510  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 8, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 8 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:40.497735 12252 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.501150 11908 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:40.536091  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 122838us
I20260709 13:04:40.535847  8272 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
W20260709 13:04:40.538698  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 134623us
I20260709 13:04:40.539211  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.545859  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:40.550741  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.552567  8020 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 9 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 10 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:40.530881 12429 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.560683  8122 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:40.562424  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.563689  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:40.577056  8274 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:40.579186  8163 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.098s (SENT)
I20260709 13:04:40.579671  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:40.586212  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:40.591138  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 101875us
I20260709 13:04:40.592199  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:40.594024  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 104465us
W20260709 13:04:40.598181  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45095.6us
I20260709 13:04:40.580598 12365 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:40.575065 12488 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:40.553511 12426 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:04:40.606899  8020 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 8 to 10, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 10 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.590127 12277 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:40.615048  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.597939 12218 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:40.613843  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:40.629004  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.601580 12181 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:40.598297 12427 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:40.636366  8020 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 8 to 9, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.638209  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 793) took 1183 ms. Trace:
I20260709 13:04:40.632597  8191 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:04:40.634006  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56657.5us
I20260709 13:04:40.605211 12255 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:40.644516  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65380.7us
I20260709 13:04:40.608985 12488 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:40.638592  8271 rpcz_store.cc:276] 0709 13:04:39.455179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.455304 (+   125us) service_pool.cc:224] Handling call
0709 13:04:39.455618 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:39.461889 (+  6271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.461916 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:39.462563 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 13:04:40.138099 (+675536us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:40.138137 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.138200 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.637987 (+499787us) raft_consensus.cc:1685] finished
0709 13:04:40.638006 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.638148 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7055,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2500,"thread_start_us":675146,"threads_started":1,"wal-append.queue_time_us":833395}
W20260709 13:04:40.648195  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47863us
I20260709 13:04:40.649870 12488 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:40.612545 12375 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:40.645759  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.635725 12307 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:40.586257 12071 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.660578  8266 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:40.666741  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:40.665795  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 65010.9us
I20260709 13:04:40.669497  8271 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:40.667753  8089 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:40.669700  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:40.698550  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:40.699440  8266 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.702512  8271 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:40.684302 12151 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:40.709846  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69258.1us
W20260709 13:04:40.713619  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43990.9us
I20260709 13:04:40.726704  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.727381  8117 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:40.728662  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.730911  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.732918  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.734521  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.735982  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.736492 12513 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.685158 12165 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:04:40.679036 12181 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:04:40.763862  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44928.9us
I20260709 13:04:40.701953 12500 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:40.666242 12482 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:04:40.768065  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.768471  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.769140  8124 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:40.769081  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.777243  8120 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:40.784303  8266 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:40.776340  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.786144  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.725135 12365 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:40.723425 12218 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:40.786793  8116 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:40.792953  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:40.793591  8122 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:40.821126  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:40.791458 12499 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:04:40.737062 12513 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.707994 12427 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:40.768989 12455 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:40.766165 12375 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:41.111085  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 315740us
W20260709 13:04:41.111280  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:40.878901  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.056099  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:40.869118  8267 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:40.821851  8121 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:40.973590  8274 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:40.826295  8118 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:41.002813  8117 raft_consensus.cc:2410] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:40.965740  8268 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:40.991338  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:41.111795  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 444100us
I20260709 13:04:40.907687  8122 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:40.972303  8807 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:40.855656  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 57562.7us
W20260709 13:04:41.062722 12252 consensus_meta.cc:287] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.003s
W20260709 13:04:41.070001 12511 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:04:41.070168 12487 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260709 13:04:40.951280 12486 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:04:40.972872 12498 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:41.159562  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 445343us
I20260709 13:04:41.160373  8089 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:41.113487 12475 consensus_meta.cc:287] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 13:04:41.064744 12516 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.814082 12503 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:41.163024  8119 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:41.045061 12490 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:40.893419 12491 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:04:41.194109 12496 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:04:40.797197 12255 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.115981 12151 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:41.045451 12512 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:40.792476 12500 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.178733  8810 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:41.177933  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:41.190831  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.130367 12514 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:41.163031 12181 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.879540 12365 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:41.189810  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:41.176793 12504 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.164326 12252 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.108347 12218 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.345752  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:41.354954  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.352361  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2016) took 1113 ms. Trace:
W20260709 13:04:41.357278  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 179402us
W20260709 13:04:41.337805  8166 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.634s (SENT)
I20260709 13:04:41.356364  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 766) took 1066 ms. Trace:
W20260709 13:04:41.356159  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 166413us
I20260709 13:04:41.358511  8195 rpcz_store.cc:276] 0709 13:04:40.289729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.289831 (+   102us) service_pool.cc:224] Handling call
0709 13:04:40.290121 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.294186 (+  4065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.294222 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.301284 (+  7062us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.449582 (+148298us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:40.449618 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.449690 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.306916 (+857226us) raft_consensus.cc:1685] finished
0709 13:04:41.306936 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.356244 (+ 49308us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":147800,"threads_started":1,"wal-append.queue_time_us":195857}
I20260709 13:04:41.353947  8119 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:41.223094 12490 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:41.309454 12477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:04:41.305910 12524 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:04:41.217254  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:41.347793 12519 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:04:41.376792  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:41.373551  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet ff5d69caf66c468aa9766af3b02649b0: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:41.188750 12503 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:41.390472 12503 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:41.345018 12315 consensus_meta.cc:287] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.000s
I20260709 13:04:41.390933  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.391238 12315 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.357932  8196 rpcz_store.cc:276] 0709 13:04:40.238809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.238975 (+   166us) service_pool.cc:224] Handling call
0709 13:04:40.249093 (+ 10118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.249474 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.249509 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.249963 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.489692 (+239729us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:40.489727 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.489790 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.352157 (+862367us) raft_consensus.cc:1685] finished
0709 13:04:41.352177 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.352305 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10065,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":12740,"thread_start_us":239385,"threads_started":1,"wal-append.queue_time_us":355651}
I20260709 13:04:41.391821 12535 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:41.392145  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.392551  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.393246  8122 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.377666 12181 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:41.372058  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.195953 12523 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:41.364589 12504 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.387737 12071 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:41.190783 12498 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.396775 12477 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:41.366552 12514 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.390044 12490 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:41.390707 12365 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.419901  8195 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:41.391582  8193 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:41.196280 12532 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:41.376629  8166 leader_election.cc:336] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.849s (SENT)
I20260709 13:04:41.373118 12300 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.214478 12516 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.374622  8123 raft_consensus.cc:2376] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11. Re-sending same reply.
I20260709 13:04:41.383780  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.435617  8272 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:04:41.396085  8196 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
W20260709 13:04:41.397517  8774 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.873s (SENT)
I20260709 13:04:41.399854 12522 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.407517  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:41.440608  8125 raft_consensus.cc:2376] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13. Re-sending same reply.
I20260709 13:04:41.401171  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.402160  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.409013  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.409922  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.442305  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.442442  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.411158  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:41.412199  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.443409  8117 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:41.444133  8274 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.444442  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.412784  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:41.361985 12534 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:41.387936 12454 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:41.445676  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.445629 12534 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.423614  8265 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:41.387425 12500 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.187067 12475 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.433620  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.447088 12454 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:41.447499  8273 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:41.397161 12523 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:41.447983 12454 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.449303 12454 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.444133  8267 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.437007  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:41.446600 12534 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:41.312985 12165 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.452316 12165 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.448911 12523 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.453827 12523 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:41.443436  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.456139  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.446447  8274 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.458240  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.460675 12475 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.461975 12475 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:41.462402 12475 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:41.463196 12475 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:41.479614 12534 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.481851  8117 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:41.482379 12523 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.487041 12534 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.486308 12523 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.485375 12475 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.439356  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.423228 12532 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.421025 12530 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:41.511097  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:41.517298  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.515336 12537 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.515637  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.435426 12300 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.516196 12498 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.516855 12530 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:41.521517  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 328798us
W20260709 13:04:41.522784  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 146175us
W20260709 13:04:41.526818  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.531353  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:41.525331  8166 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.943s (SENT)
I20260709 13:04:41.542726  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.387380 12151 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.532014  8271 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
W20260709 13:04:41.545708  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.433687 12490 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:04:41.552673  8196 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:41.553575  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.553630  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.553996  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.558251  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:41.558831  8120 raft_consensus.cc:2376] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8. Re-sending same reply.
I20260709 13:04:41.515375 12252 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.560022  8123 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:41.561326  8196 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:41.519222 12532 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:41.404484 12477 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.530702 12530 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.581430  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:41.579533  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.553900 12454 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:41.605667  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 88990.9us
W20260709 13:04:41.606602  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.508693 12522 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.613296  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:41.613971 12536 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:04:41.614538  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.615566  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.616087  8271 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:41.616845  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.618037  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:41.619115  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.619284 12165 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.616854  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.621984  8199 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:41.622308  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.557441 12475 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.628270  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.628434 12315 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.524464 12537 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.635039  8122 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:41.633253  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.636423  8274 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.633919  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:41.626394 12488 consensus_meta.cc:287] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.976s	user 0.004s	sys 0.007s
I20260709 13:04:41.643656  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.669763  8195 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:41.677336  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.682902  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:41.683905  8274 raft_consensus.cc:2376] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13. Re-sending same reply.
I20260709 13:04:41.637717 12315 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.690554  8271 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:41.606359 12454 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.695467  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:41.696135  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:41.697129  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 60971.5us
I20260709 13:04:41.698423  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:41.668602 12513 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:41.702982  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 323155us
I20260709 13:04:41.703812 12509 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.704530 12509 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.704977 12509 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.707799  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.707940 12537 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:41.708509  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e848f577948c470fb4c95fcc2b55b7ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:41.708881  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.709432 12480 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:41.676128 12488 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.712538 12488 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:41.694574 12315 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.713621  8272 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.714236 12545 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.714875 12315 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:41.714745 12545 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:41.715196  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.715899  8272 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:41.716801 12545 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.718364  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:41.718889  8200 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:41.721674  8274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
W20260709 13:04:41.724141  8166 leader_election.cc:336] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.248s (SENT)
W20260709 13:04:41.731289  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.964s (SENT)
I20260709 13:04:41.732067  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:41.717170 12454 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.701589 12539 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:41.750651 12495 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.750993 12539 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.753799  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:41.754359  8195 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:41.756350 12429 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.179s	user 0.007s	sys 0.003s
I20260709 13:04:41.757586  8191 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:04:41.761260  8774 leader_election.cc:336] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.000s (SENT)
I20260709 13:04:41.761708  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:41.748420  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.762533  8195 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:41.747534  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.763633  8272 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:04:41.765407  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.727742 12362 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:41.729431 12490 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:41.777886  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:41.781481  8195 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:41.775131 12495 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.733795 12493 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.726999 11908 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:41.780532  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 62247.7us
W20260709 13:04:41.788674  8774 leader_election.cc:336] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.022s (SENT)
W20260709 13:04:41.785197  8163 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.733s (SENT)
I20260709 13:04:41.786046  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.737186 12010 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:41.790422  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:41.791081  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:41.736362 12521 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.753219 12539 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.764372 12413 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.781594 12429 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:41.817991  8274 raft_consensus.cc:606] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:41.782920 12490 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.781423 12362 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.820179  8274 raft_consensus.cc:614] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:41.780264 12535 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:41.828600  8091 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:41.832135 12509 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.822742  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:41.825881  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 93903us
I20260709 13:04:41.841874  8268 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:41.841902  8195 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:41.843214  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.799823 12373 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:41.845916  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:41.846275  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61122.6us
I20260709 13:04:41.798605 12508 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:41.851099  8163 leader_election.cc:336] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.733s (SENT)
I20260709 13:04:41.854305  8163 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:41.823588 12424 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.851553  8200 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:41.826786 12490 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.826076 12362 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:41.826315 12535 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:41.860769  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:41.857052 12218 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.841995 12429 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:41.866109  8163 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.839s (SENT)
I20260709 13:04:41.853915 12509 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:41.870482  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.825800 11908 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:41.880518  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58052.2us
I20260709 13:04:41.882881  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.883605  8272 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:41.887050 12151 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:41.887627 12151 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:41.886972  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.890949  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.815598 12493 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.869382 12307 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:41.895689  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:41.826485 12413 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.870702 12514 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.862468 12500 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:04:41.828261 12521 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:41.863802 12534 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:04:41.898630 12522 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.934609  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:41.931399 11908 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:41.938120 12558 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:41.930321 12502 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:41.940912 12535 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:41.929693 12561 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:04:41.930960 12315 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:41.943389  8163 leader_election.cc:336] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.860s (SENT)
I20260709 13:04:41.944090 12527 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:41.945048 12413 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.945242  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:42.007787  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62646.9us
I20260709 13:04:41.901623  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.009124  8272 raft_consensus.cc:2410] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:41.947830  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:41.862351 12424 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:41.973886  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.931260 12151 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:41.889899 12523 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:41.993230  8274 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:04:41.994104  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 150865us
I20260709 13:04:41.929999 12550 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:41.860710 12508 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.005584  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:41.942394 12300 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:41.999866 12535 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:42.016373  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 74363.7us
W20260709 13:04:42.024947  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 183042us
W20260709 13:04:42.025642  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 144342us
I20260709 13:04:42.037999  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.038616  8272 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:42.005420 12315 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:42.022406 12539 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:42.051456  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 262780us
I20260709 13:04:42.049137  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:42.044863  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 184157us
I20260709 13:04:42.031309 12495 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:41.999070 12429 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.008985 12502 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:42.437323  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 375220us
I20260709 13:04:42.083073  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2020) took 1828 ms. Trace:
W20260709 13:04:42.441525  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 394234us
W20260709 13:04:42.196555  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.054101  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.449407  8199 rpcz_store.cc:276] 0709 13:04:40.254607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.254811 (+   204us) service_pool.cc:224] Handling call
0709 13:04:40.255074 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.622411 (+1367337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.082841 (+460430us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000294d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:42.083006 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3143193984}
I20260709 13:04:42.082515  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 804) took 1208 ms. Trace:
W20260709 13:04:42.144012  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.086474  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:42.056965  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 195467us
I20260709 13:04:42.077052  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:42.038000 12523 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.044130 12300 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.451323  8265 rpcz_store.cc:276] 0709 13:04:40.874258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.874387 (+   129us) service_pool.cc:224] Handling call
0709 13:04:40.874691 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.446951 (+572260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.082278 (+635327us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400346a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:42.082450 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261734656}
I20260709 13:04:42.080899  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:42.452440  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.040675 12514 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:42.469484  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 388654us
W20260709 13:04:42.452143  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:42.081108  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:42.443852  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 401824us
W20260709 13:04:42.090044 12503 consensus_meta.cc:287] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.002s
I20260709 13:04:42.076785  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:42.088526  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 145180us
I20260709 13:04:42.469717  8807 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:42.475924  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.476281  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:42.478199  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 776) took 1105 ms. Trace:
W20260709 13:04:42.330746 12530 consensus_meta.cc:287] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.002s
I20260709 13:04:42.044342 12480 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.453s
I20260709 13:04:42.044945 12488 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.463s
W20260709 13:04:42.714608  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 240533us
I20260709 13:04:42.549687  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:42.480465  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:42.074929 12071 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
W20260709 13:04:42.080776 12563 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:04:42.479914  8809 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
W20260709 13:04:42.080081 12567 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:04:42.081576 12562 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:04:42.528065  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:42.780565  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 301648us
I20260709 13:04:42.492702  8089 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:42.782470  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:42.803328  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 310707us
W20260709 13:04:42.777976  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.803781  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:42.804718  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.805599  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:42.680794  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.054448 11908 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.807071  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.806878 11908 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.807708 12582 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:42.808717  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.808996 11908 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:42.809576 11908 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:42.809895 11908 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:42.329295 12533 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:42.810712 11908 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.811365 12533 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:42.811831 12533 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.811926 11908 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.082460 12517 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.731s
I20260709 13:04:42.762794  8197 rpcz_store.cc:276] 0709 13:04:41.372630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.373132 (+   502us) service_pool.cc:224] Handling call
0709 13:04:41.388335 (+ 15203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.723644 (+335309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.723679 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.732297 (+  8618us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.853445 (+121148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:42.011169 (+157724us) log.cc:844] Serialized 14 byte log entry
0709 13:04:42.011993 (+   824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.012074 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:42.477912 (+465838us) raft_consensus.cc:1685] finished
0709 13:04:42.477930 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.478130 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21279,"raft.queue_time_us":109931,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":11482,"thread_start_us":529198,"threads_started":3,"wal-append.queue_time_us":284598}
I20260709 13:04:42.814565  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.815371  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.815959  8197 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
W20260709 13:04:42.762226  8163 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.634s (SENT)
I20260709 13:04:42.804322  8272 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:42.049935 12539 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.773417 12503 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:42.713639 12542 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.662s	user 0.003s	sys 0.000s
I20260709 13:04:42.441845 12508 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:42.746812 12424 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:42.783404  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:42.200573 12527 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:42.477082 12523 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:42.077656 12307 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.636850 12261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.012s
I20260709 13:04:42.832445 12307 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:42.820225  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2027) took 1213 ms. Trace:
I20260709 13:04:42.834450  8193 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:42.817119  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.821081 12455 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:42.826159 12490 consensus_meta.cc:287] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.959s	user 0.008s	sys 0.000s
I20260709 13:04:42.834662  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:42.831799 12362 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.958s	user 0.007s	sys 0.000s
I20260709 13:04:42.820303  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:42.819541  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 589) took 1746 ms. Trace:
I20260709 13:04:42.836437 12362 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.823565 12539 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.827564  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 775) took 1455 ms. Trace:
I20260709 13:04:42.826521  8269 raft_consensus.cc:2393] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:42.837105  8116 rpcz_store.cc:276] 0709 13:04:41.073637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.085322 (+ 11685us) service_pool.cc:224] Handling call
0709 13:04:41.106232 (+ 20910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.405053 (+298821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.405098 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.424204 (+ 19106us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.609023 (+184819us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:41.609058 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.712000 (+102942us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400393854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:41.712049 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:42.819269 (+1107220us) raft_consensus.cc:1685] finished
0709 13:04:42.819286 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.819483 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686265728,"thread_start_us":59051,"threads_started":1,"wal-append.queue_time_us":1180732}
I20260709 13:04:42.082715 12315 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.839006  8270 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:42.840237 12362 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:42.840477 12315 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.838433  8198 rpcz_store.cc:276] 0709 13:04:41.372389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.373062 (+   673us) service_pool.cc:224] Handling call
0709 13:04:41.389379 (+ 16317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.579078 (+189699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.579110 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.594111 (+ 15001us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.786317 (+192206us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:41.786352 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.786411 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:42.827384 (+1040973us) raft_consensus.cc:1685] finished
0709 13:04:42.827407 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.827516 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16796,"raft.queue_time_us":108549,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":47,"thread_start_us":326596,"threads_started":2,"wal-append.queue_time_us":243243}
I20260709 13:04:42.842312  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:42.842326  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2138) took 1441 ms (client timeout 1849 ms). Trace:
I20260709 13:04:42.090826 12504 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:42.835692 12490 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:42.843034  8270 rpcz_store.cc:269] 0709 13:04:41.400823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.400929 (+   106us) service_pool.cc:224] Handling call
0709 13:04:42.842140 (+1441211us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400076a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:42.842249 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213936384}
I20260709 13:04:42.843918  8268 raft_consensus.cc:2368] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 9. Current term is 10.
I20260709 13:04:42.844192  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.819974  8192 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:42.839893 12477 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:42.846501  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.821223  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.847071 12490 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:42.845553  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:42.837294  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 75105.6us
I20260709 13:04:42.848510  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.847049  8192 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:42.850077 12575 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:42.850257  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:42.052666 12373 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:42.457160 12516 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:42.842801  8198 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.847514  8272 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:42.838894 12218 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:42.853206 12218 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:42.853433  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.854125  8272 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:42.853820 12373 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.854837  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.831914  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:42.855795 12373 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:42.856007 12509 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:42.756732 12514 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.856443 12509 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:42.840972  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61383.1us
I20260709 13:04:42.856835 12509 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:42.834251 12532 consensus_meta.cc:287] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.253s	user 0.006s	sys 0.005s
I20260709 13:04:42.857679 12532 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.845299  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.858952  8270 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:42.858513  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.859802  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.860591  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.861181  8266 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:42.862061  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.827912  8805 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:42.860369  8270 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:42.831821  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:42.864075 12504 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:42.864122  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.850679 12181 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:42.865168  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2161) took 1022 ms. Trace:
I20260709 13:04:42.870748  8193 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:42.870678 12504 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.870914  8269 rpcz_store.cc:276] 0709 13:04:41.842850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.842984 (+   134us) service_pool.cc:224] Handling call
0709 13:04:42.864994 (+1022010us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400074754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:42.865115 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259602816}
I20260709 13:04:42.871968  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:42.872596  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.870265  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.866775 12509 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.867707  8238 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:42.869009  8192 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.822175 12507 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:42.870039  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.837564 12455 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:42.861069 12218 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:42.931841  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:42.933202  8805 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.933483  8270 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:42.834245  8196 rpcz_store.cc:276] 0709 13:04:41.607167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.607292 (+   125us) service_pool.cc:224] Handling call
0709 13:04:41.632636 (+ 25344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.632831 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:41.797646 (+164815us) log.cc:844] Serialized 14 byte log entry
0709 13:04:42.084809 (+287163us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b1800496060. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:42.818071 (+733262us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b1800496060. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf 00007fbd24d42038
0709 13:04:42.819213 (+  1142us) log.cc:844] Serialized 14 byte log entry
0709 13:04:42.819919 (+   706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:42.819965 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:42.820012 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.820081 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.820175 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":738697,"prepare.queue_time_us":947705,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":16928,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":3517,"spinlock_wait_cycles":21009920,"thread_start_us":145411,"threads_started":2,"wal-append.queue_time_us":239008}
I20260709 13:04:42.077337 12528 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:42.872874  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:42.915620  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55326.2us
I20260709 13:04:42.929859  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:42.836190  8199 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:42.895244  8198 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:42.815975  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.835582  8197 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 15: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:42.832124 12493 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:42.886142  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:42.879076  8272 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:42.919646  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:42.935401  8163 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.943s (SENT)
I20260709 13:04:42.926204  8273 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:42.934520  8266 raft_consensus.cc:2410] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:04:42.885119  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:42.937148  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 495441us
W20260709 13:04:42.611450  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 132433us
I20260709 13:04:42.937136  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:42.832479 12261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.018s
I20260709 13:04:42.937229  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:42.921813 12307 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:42.939535  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 71906.1us
I20260709 13:04:42.961464  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:42.963151  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.964257  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:42.941644  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2172) took 1008 ms. Trace:
I20260709 13:04:42.973253  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:42.966022  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:42.966405  8166 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 3.115s (SENT)
W20260709 13:04:42.940351  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54274us
I20260709 13:04:42.074755 12500 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.833s
W20260709 13:04:42.823501 12535 consensus_meta.cc:287] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.786s	user 0.004s	sys 0.003s
I20260709 13:04:42.961051  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2176) took 1026 ms. Trace:
W20260709 13:04:42.964007  8774 leader_election.cc:336] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.091s (SENT)
I20260709 13:04:42.077482 12568 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 1.054s
I20260709 13:04:42.934736 12507 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:42.982522  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:42.968888  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.964792  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2184) took 1028 ms. Trace:
I20260709 13:04:42.983469  8196 raft_consensus.cc:2410] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:42.972879  8270 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:42.983291  8273 rpcz_store.cc:276] 0709 13:04:41.939373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.831580 (+892207us) service_pool.cc:224] Handling call
0709 13:04:42.964734 (+133154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:42.974007  8809 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:42.974418  8166 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:42.984464  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:42.975837  8805 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:42.850796 12575 consensus_queue.cc:1243] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:42.973510  8269 rpcz_store.cc:276] 0709 13:04:41.933325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.872687 (+939362us) service_pool.cc:224] Handling call
0709 13:04:42.941585 (+ 68898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:42.973634  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:42.977064  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47296.9us
I20260709 13:04:42.754941 12151 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.827869 12503 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:42.475462 12512 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:42.917059 12504 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:42.979621  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:42.980109  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.037736  8199 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
W20260709 13:04:42.980465  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 60900.3us
I20260709 13:04:42.895535 12582 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.967433  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2170) took 1034 ms. Trace:
I20260709 13:04:43.039920  8198 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:42.914407 12523 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:42.999191 12455 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:42.974400  8191 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:42.984699  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.054157  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:43.054663  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2171) took 1121 ms. Trace:
I20260709 13:04:42.638784 12495 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.987319  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50152us
I20260709 13:04:43.058920  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:42.981400  8274 rpcz_store.cc:276] 0709 13:04:41.934240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.784355 (+850115us) service_pool.cc:224] Handling call
0709 13:04:42.960984 (+176629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:42.984273  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2165) took 1101 ms. Trace:
I20260709 13:04:42.856781 12514 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.059970  8270 rpcz_store.cc:276] 0709 13:04:41.882957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.940984 (+1058027us) service_pool.cc:224] Handling call
0709 13:04:42.984214 (+ 43230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:42.993506  8200 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:42.997859  8192 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:43.061170  8199 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:43.061861  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2412) took 1115 ms. Trace:
I20260709 13:04:43.062150  8199 rpcz_store.cc:276] 0709 13:04:41.946778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.060642 (+1113864us) service_pool.cc:224] Handling call
0709 13:04:43.061000 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.061635 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.061809 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.066882  8191 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:43.067451  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2415) took 1120 ms. Trace:
I20260709 13:04:43.067750  8191 rpcz_store.cc:276] 0709 13:04:41.947425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.066442 (+1119017us) service_pool.cc:224] Handling call
0709 13:04:43.066721 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.067250 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.067399 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:43.073709  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.049834 12593 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:04:43.087260  8195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.005s	sys 0.029s
W20260709 13:04:42.998356  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.088678  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.936321 12010 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:04:43.004544 12151 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.999928 12594 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:43.014155  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50186.5us
W20260709 13:04:43.096637  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.170s (SENT)
I20260709 13:04:43.054771 12502 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.014580 12261 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:43.015574  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 777) took 1642 ms. Trace:
I20260709 13:04:43.099725  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2192) took 1158 ms. Trace:
I20260709 13:04:42.985915 12307 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.982358 12476 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:43.016039 12533 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:42.788062 12530 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:42.535097 12300 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.924361 12539 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:42.830724 12527 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:42.978009 12427 raft_consensus.cc:2764] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:43.017282  8265 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:43.017653 12503 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.099517 12261 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.020627  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44846 (request call id 19) took 1172 ms. Trace:
I20260709 13:04:43.021240 12315 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.022578 12509 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.024142  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:43.111224  8197 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.111754  8271 raft_consensus.cc:2368] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9.
I20260709 13:04:42.964017 12165 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:04:43.038781  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.039870  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:43.040474  8266 rpcz_store.cc:276] 0709 13:04:41.932820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.869822 (+937002us) service_pool.cc:224] Handling call
0709 13:04:42.967372 (+ 97550us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:42.983295  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 47915.5us
I20260709 13:04:43.054986  8273 rpcz_store.cc:276] 0709 13:04:41.933084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.984493 (+1051409us) service_pool.cc:224] Handling call
0709 13:04:43.054605 (+ 70112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.112453  8193 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.085929  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.113134  8270 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 15: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:43.113371  8267 raft_consensus.cc:2410] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:43.087996  8191 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:43.088840  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.113885  8198 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:43.114313  8268 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:43.094409  8192 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:43.114830  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2423) took 1035 ms. Trace:
I20260709 13:04:43.115134  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2416) took 1126 ms. Trace:
I20260709 13:04:43.049644 12532 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.048632 12512 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:43.097048  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.091220  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.117072  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.099565  8194 rpcz_store.cc:276] 0709 13:04:41.372882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.373322 (+   440us) service_pool.cc:224] Handling call
0709 13:04:41.388815 (+ 15493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.609174 (+220359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.609319 (+   145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.635691 (+ 26372us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.797334 (+161643us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:41.797390 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.797465 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.015378 (+1217913us) raft_consensus.cc:1685] finished
0709 13:04:43.015397 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.015521 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17127,"raft.queue_time_us":108930,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":303998,"threads_started":2,"wal-append.queue_time_us":213616}
I20260709 13:04:43.100386  8272 rpcz_store.cc:276] 0709 13:04:41.941507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.854615 (+913108us) service_pool.cc:224] Handling call
0709 13:04:43.097886 (+243271us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5400211454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:43.099664 (+  1778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53892480}
I20260709 13:04:43.049449 12582 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.108140  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2185) took 1168 ms. Trace:
I20260709 13:04:43.017832  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.083194 12495 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.109917  8810 rpcz_store.cc:276] 0709 13:04:41.848065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.848188 (+   123us) service_pool.cc:224] Handling call
0709 13:04:43.020334 (+1172146us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540062e654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2e735 00007fbd24d269fa 00007fbd29cee4c9 00007fbd2326ac54 00007fbd2326abe2 00007fbd2326ab11 00007fbd2326aa8c 00007fbd23269d42 00007fbd2306348c 00007fbd230628c6
0709 13:04:43.020549 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235368192}
I20260709 13:04:43.102121 12476 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.025775 12507 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:43.126520  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 87820.8us
I20260709 13:04:43.128058  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:43.114034  8163 leader_election.cc:336] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.248s (SENT)
I20260709 13:04:43.114172  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2421) took 1068 ms. Trace:
W20260709 13:04:43.089402  8195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.029s
I20260709 13:04:43.115132  8198 rpcz_store.cc:276] 0709 13:04:42.079597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.113398 (+1033801us) service_pool.cc:224] Handling call
0709 13:04:43.113701 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.114605 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.114780 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.110898 12261 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.116418  8273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:43.097900  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.133649  8274 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:43.089390 12523 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.117877  8266 raft_consensus.cc:2410] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:43.119464  8265 rpcz_store.cc:276] 0709 13:04:41.939639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.981693 (+1042054us) service_pool.cc:224] Handling call
0709 13:04:43.108079 (+126386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.139638  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 809) took 1063 ms. Trace:
I20260709 13:04:43.139943  8265 rpcz_store.cc:276] 0709 13:04:42.076376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.138925 (+1062549us) service_pool.cc:224] Handling call
0709 13:04:43.139197 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.139352 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.139374 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.139413 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:43.139445 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.139492 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.139592 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.120163  8196 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:43.140815  8193 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:43.128925  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.128935  8191 rpcz_store.cc:276] 0709 13:04:42.045732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.083062 (+1037330us) service_pool.cc:224] Handling call
0709 13:04:43.083343 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.113960 (+ 30617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.114122 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.115535  8192 rpcz_store.cc:276] 0709 13:04:41.989193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.061600 (+1072407us) service_pool.cc:224] Handling call
0709 13:04:43.094172 (+ 32572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.114907 (+ 20735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.115087 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.130719  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2038) took 1275 ms. Trace:
I20260709 13:04:43.131897  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.133069  8273 raft_consensus.cc:606] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:42.998404  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.119997 12493 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.143167  8193 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:43.126840 12502 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:43.146873  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.118314 12315 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:43.141475 12413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.013s
I20260709 13:04:43.142323  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.143508  8806 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.126811 12476 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.156821  8193 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:43.132886 12517 raft_consensus.cc:2764] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:04:43.150228  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53624.6us
I20260709 13:04:43.150069  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 808) took 1099 ms. Trace:
I20260709 13:04:43.145375  8273 raft_consensus.cc:614] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:43.158627  8274 rpcz_store.cc:276] 0709 13:04:42.051162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.134241 (+1083079us) service_pool.cc:224] Handling call
0709 13:04:43.149637 (+ 15396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.149784 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.149807 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.149844 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:43.149885 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.149932 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.150014 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.151482  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.145905  8269 raft_consensus.cc:2393] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:43.133072 12503 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.163458  8774 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:43.134698 12583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.010s
I20260709 13:04:43.168665  8807 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
W20260709 13:04:43.157577  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 184013us
I20260709 13:04:43.163903  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38292 (request call id 37) took 1161 ms. Trace:
I20260709 13:04:43.164951  8193 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:43.165434  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:43.145032  8195 rpcz_store.cc:276] 0709 13:04:41.854865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.857853 (+  2988us) service_pool.cc:224] Handling call
0709 13:04:41.858136 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.858329 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:42.045244 (+186915us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.130368 (+1085124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.130418 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:43.130482 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.130559 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.130669 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27233,"prepare.queue_time_us":960276,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":91986,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":63328,"thread_start_us":1228576,"threads_started":3,"wal-append.queue_time_us":764959}
W20260709 13:04:43.157383 12413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.014s	sys 0.013s
I20260709 13:04:43.147823 12532 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.153573 12480 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:04:43.170837  8273 rpcz_store.cc:276] 0709 13:04:41.997459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.112755 (+1115296us) service_pool.cc:224] Handling call
0709 13:04:43.159122 (+ 46367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.176213  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 834) took 1122 ms. Trace:
I20260709 13:04:43.172891  8193 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:43.171111  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.149762 12502 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:43.155720 12521 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:43.168217  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54214.7us
I20260709 13:04:43.179433 12597 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.201979 12495 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:43.168871 12583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.004s	sys 0.010s
I20260709 13:04:43.179693 12151 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.169548 12598 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:43.176653 12504 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:04:43.206508 12490 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:43.206760 12514 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:43.207294  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 43899.5us
I20260709 13:04:43.208206 12533 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.209684 12495 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:43.209971 12539 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:43.211468  8198 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:43.212695  8198 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:04:43.179737  8776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.017s	sys 0.021s
I20260709 13:04:43.213958 12512 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.215219  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2186) took 1275 ms. Trace:
I20260709 13:04:43.215552  8267 rpcz_store.cc:276] 0709 13:04:41.939895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.782208 (+842313us) service_pool.cc:224] Handling call
0709 13:04:43.215028 (+432820us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400189554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:43.215155 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712473344}
I20260709 13:04:43.179898 12503 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.217669 12523 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:43.201885 12302 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:43.184631  8806 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:43.205565 12315 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:43.213912  8776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.017s	sys 0.022s
I20260709 13:04:43.177356 12010 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:43.180909  8238 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.180544  8807 rpcz_store.cc:276] 0709 13:04:42.046731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.046857 (+   126us) service_pool.cc:224] Handling call
0709 13:04:43.169150 (+1122293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.197755  8163 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:43.225467  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 54444.4us
I20260709 13:04:43.226189  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.229209  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2155) took 1541 ms. Trace:
I20260709 13:04:43.229594  8271 rpcz_store.cc:276] 0709 13:04:41.687968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.695260 (+  7292us) service_pool.cc:224] Handling call
0709 13:04:43.226264 (+1531004us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001beed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:43.229152 (+  2888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254499584}
I20260709 13:04:43.230942  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2411) took 1284 ms. Trace:
I20260709 13:04:43.231679  8200 rpcz_store.cc:276] 0709 13:04:41.946490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.947572 (+  1082us) service_pool.cc:224] Handling call
0709 13:04:43.230795 (+1283223us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54001ad1d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:43.230882 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260346624}
I20260709 13:04:43.230504  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2180) took 1295 ms. Trace:
I20260709 13:04:43.232867  8268 rpcz_store.cc:276] 0709 13:04:41.935178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.848302 (+913124us) service_pool.cc:224] Handling call
0709 13:04:43.230323 (+382021us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54004088d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:43.230448 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609787136}
W20260709 13:04:43.259991  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79153.6us
W20260709 13:04:43.261021  8166 leader_election.cc:336] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.944s (SENT)
I20260709 13:04:43.195657 12502 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.196996 12181 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.196266 12455 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.264609  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.270869  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.275959  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.268352  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:43.274889  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48778.5us
I20260709 13:04:43.264640  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.223245 12010 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:43.277248  8192 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:43.276760  8119 raft_consensus.cc:2410] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:43.278093  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.286988  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.254616 12488 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.287751  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.288328  8123 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:43.260957 12151 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:43.235960 12490 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:43.229542 12302 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:43.323311  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.323596  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:43.323992  8121 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:43.259672 12514 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:43.255198 12252 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.286696  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.302902  8116 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:04:43.273330  8774 connection.cc:256] RPC call timeout handler was delayed by -1.03542784199999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 13:04:43.314508 12522 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.329746 12362 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:43.335839  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.335635 12490 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.336472 12604 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.336828 12490 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.335600 12362 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:43.337479  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 76490.7us
I20260709 13:04:43.338169 12488 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:43.336408  8809 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:43.315193  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.324542  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.336906 12503 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:04:43.339998  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.340405 12522 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.277565 12568 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.260298 12307 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:04:43.282630 12533 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.259845 12255 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:04:43.287201 12010 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.281742 12165 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.334408  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.284919 12480 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:43.330325 12151 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:43.282081 12530 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:43.325560 12598 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:04:43.328935  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 63243.3us
I20260709 13:04:43.337045 12604 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.380473 12604 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:43.381014 12605 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:43.385147 12362 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.329282 12535 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:43.389714 12535 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:43.390585 12535 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.351416  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.303464 12181 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.324920 12517 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:04:43.289538 12455 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.402933 12455 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.325035 12500 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:04:43.373224  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.405298 12507 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.406162 12181 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.370502 12165 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.408437 12165 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.398716 12255 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:04:43.353489 12514 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:43.369208  8124 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:43.339175 12488 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:43.395735  8163 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.628s (SENT)
I20260709 13:04:43.423498  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:43.397143  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2424) took 1194 ms. Trace:
I20260709 13:04:43.364547 12516 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.358786 12302 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.411680  8811 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:43.374711  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.428172  8809 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:43.416038  8196 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:43.356338 12528 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:04:43.418133  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45001.5us
I20260709 13:04:43.429736  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.419283  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.424422  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:43.431229  8807 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.419852  8088 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.430450  8804 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:43.432763 12514 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.433272  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.433794  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:43.434357  8091 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.434906 12517 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.435421  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.435570 12517 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.436569 12517 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.355876 12568 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.434475  8804 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.429714  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.424551  8194 rpcz_store.cc:276] 0709 13:04:42.202433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.138966 (+936533us) service_pool.cc:224] Handling call
0709 13:04:43.149167 (+ 10201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.150904 (+  1737us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:43.160505 (+  9601us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.394489 (+233984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.394537 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:43.394584 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.396976 (+  2392us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.397093 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11480,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":2341,"raft.queue_time_us":8955,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":233683,"threads_started":1}
I20260709 13:04:43.438859  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:43.440807  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:43.456624  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60916.4us
I20260709 13:04:43.462652  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.422724 12527 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.428292 12362 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.461081  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.427992 12500 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:43.412281 12261 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.428252 12361 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:04:43.514528  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.461452 12528 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:43.505057  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.538496  8805 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:43.502806  8810 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:43.506978  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2178) took 1572 ms. Trace:
I20260709 13:04:43.528523  8807 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:43.541478 12508 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:43.542008 12508 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.544134 12508 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.547698  8804 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:43.549013  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2418) took 1538 ms. Trace:
I20260709 13:04:43.549418  8199 rpcz_store.cc:276] 0709 13:04:42.020968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.062816 (+1041848us) service_pool.cc:224] Handling call
0709 13:04:43.063098 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.063431 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.063458 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:43.063905 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.371368 (+307463us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:43.371408 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.371471 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.548818 (+177347us) raft_consensus.cc:1685] finished
0709 13:04:43.548839 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.548959 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18011,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3859,"thread_start_us":270867,"threads_started":1,"wal-append.queue_time_us":381670}
I20260709 13:04:43.466106 12252 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:43.553856  8197 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:43.536703 12575 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.565304 12582 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.457191 12504 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:04:43.593556  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.537730 12528 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.525605 12580 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.536526 12532 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.625943  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.627429  8268 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:43.544320 12476 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.633018  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:43.590768 12375 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:43.635861  8268 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:04:43.627224 12606 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:04:43.617059 12528 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.565829 12575 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.614811 12513 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.478938 12151 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.632344 12530 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.655629  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.656288  8268 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
W20260709 13:04:43.658655  8163 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.000s (SENT)
I20260709 13:04:43.659138  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:43.662472  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.591085 12252 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:43.626855 12527 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:43.670200  8267 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:43.646683 12601 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:04:43.672463  8125 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:43.637449 12599 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:43.673439  8269 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:04:43.678429  8237 connection.cc:256] RPC call timeout handler was delayed by -2.349838300999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:04:43.678853  8237 connection.cc:256] RPC call timeout handler was delayed by -2.3381383009999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:04:43.679446  8237 connection.cc:256] RPC call timeout handler was delayed by -1.9808383009999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:04:43.679800  8237 connection.cc:256] RPC call timeout handler was delayed by -1.940338300999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 13:04:43.680078  8237 connection.cc:256] RPC call timeout handler was delayed by -1.7513383009999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23010000000000003s for a response
W20260709 13:04:43.680347  8237 connection.cc:256] RPC call timeout handler was delayed by -1.367938300999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2727s for a response
W20260709 13:04:43.680619  8237 connection.cc:256] RPC call timeout handler was delayed by -1.22663830099998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2884s for a response
I20260709 13:04:43.682032  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.682677  8122 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:43.683233  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.578583 12480 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:43.683545  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:43.683761  8266 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:43.684087  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.694180  8123 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:43.685120  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:43.689605  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:43.696112  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:43.699760  8274 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.709483  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.710114  8117 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:43.712702  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.713297  8266 raft_consensus.cc:2376] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13. Re-sending same reply.
I20260709 13:04:43.719411  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:43.695652  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 355715us
I20260709 13:04:43.673779 12516 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:43.637288 12375 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.721089  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:43.722723  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.724795  8195 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:43.644500 12502 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.728384  8166 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.726979  8266 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:04:43.728044  8119 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:43.729182  8266 pending_rounds.cc:85] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:04:43.729590  8266 pending_rounds.cc:107] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:04:43.729820  8266 raft_consensus.cc:2889] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:43.691113 12503 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:43.734628  8117 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:43.732437  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:43.736603  8265 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:43.741168  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 362552us
I20260709 13:04:43.673295 12530 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.658794 12513 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.742102  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:43.676512 12527 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.743549  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:43.744505  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.754055  8267 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:43.746454  8122 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.740796  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.751966  8274 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:43.750605  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.742974  8265 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:43.755298  8265 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:43.756505  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.756930  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.734097 12455 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:43.761822  8802 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 13. Ops: []
I20260709 13:04:43.689191 12599 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.756029  8265 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:43.777231 12614 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:43.777426  8267 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:43.778337  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.778847  8267 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:43.779752  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:43.780668  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:43.781275  8267 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:43.783967  8267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:43.758666 12252 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:43.787705 12611 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:04:43.771893 12514 raft_consensus.cc:2764] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:43.789564 12513 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.741616 12307 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.792793 12628 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:43.761562 12455 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:43.800526 12455 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.802289 12502 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.803191 12575 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.804553 12375 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.806030 12476 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:43.785691  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:43.807121  8266 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.811101 12607 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:43.811545 12607 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:43.809321 12528 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.812289 12607 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.814324 12528 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.814940  8273 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:43.785758  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 66646.9us
I20260709 13:04:43.822242  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:43.824687  8266 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:43.762537  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.757457 12516 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:43.733565 12010 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:43.752539 12568 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:43.853320  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:43.872699  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 111281us
I20260709 13:04:43.854892  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.853916  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.853680  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:43.857856  8266 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:43.759552 12582 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:43.853590  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:43.873632  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.884716  8804 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:43.885280  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.886839  8195 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:43.825977 12261 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:43.888077  8166 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.846202 12607 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:43.876690  8807 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.740630 12503 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.889698  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:43.892148 12503 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:43.892338  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.763248 12604 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:04:43.892922  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.762321 12365 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:04:43.895529  8273 raft_consensus.cc:2410] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:43.864658  8809 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:43.896601  8122 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:43.855499 12516 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:43.884136 12582 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.902601  8274 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:43.883985 12598 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.890089 12307 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:43.909318  8807 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:43.909749  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:43.909540  8163 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.121s (SENT) [suppressed 59 similar messages]
I20260709 13:04:43.899466 12535 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:43.922461  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:43.921471 12413 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:43.912963 12582 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.910079 12516 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.920123 12307 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:43.908499 12625 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:43.938570  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:43.933950  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:43.967288  8195 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:43.846666 12480 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:43.926410 12633 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.932576 12413 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.971557  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:43.975744  8195 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.931747 12598 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.932346 12535 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:43.965865 12307 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.987608  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.992010  8125 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:43.992892  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.989370  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.966069 12625 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.994812  8117 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:43.993467  8125 raft_consensus.cc:2376] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11. Re-sending same reply.
I20260709 13:04:43.996500  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:43.997531  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:43.976322 12413 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:44.001583  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.001078  8118 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:44.006769  8118 pending_rounds.cc:85] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 8
I20260709 13:04:44.007001  8118 pending_rounds.cc:107] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:44.007225  8118 raft_consensus.cc:2889] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:44.001011  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.002568  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:44.001287  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.005414  8117 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 16: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:44.006093  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.008587  8123 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:44.008483  8125 raft_consensus.cc:2376] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11. Re-sending same reply.
I20260709 13:04:44.011379  8119 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:44.013697  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.014261  8125 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:43.995683 12625 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.015925  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:44.018536  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.019111  8119 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:44.019582  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.019896  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.020273  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.020757  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.022243  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.022927  8118 raft_consensus.cc:2393] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:44.023504  8117 raft_consensus.cc:2368] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:04:44.017939  8195 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:44.030879  8120 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:44.012399 12527 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:44.033829  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:04:44.035109  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:43.985039 12633 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:44.036230  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:44.022816 12598 raft_consensus.cc:2764] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:44.037209 12633 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:44.037385 12631 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:04:44.037531 12010 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:44.037974  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.039093  8123 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:44.041150  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.041755  8121 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:44.043761  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.049782  8121 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:44.060384  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.037566 12300 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:44.058663  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.064839  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.028666 12455 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.066498  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:44.050398 12630 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:04:44.075194  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.075747  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.076386  8120 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:44.075183  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.081861  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.083458  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.087423  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:44.088392  8121 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 16: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:44.067760 12620 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:04:44.097788  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.098799  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.097261  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:44.106415  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70254.3us
W20260709 13:04:44.109488  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.109694  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:44.109784  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.116621  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:44.114405  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.118068  8774 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:44.118438  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.119747  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:44.120644  8163 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:44.121754  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:44.081065 12644 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:44.075773 12646 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.132344  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.129750  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.130757  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:44.133556  8121 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:44.134277  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.132941  8119 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:44.135689  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.050102 12535 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.137059  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.138149  8118 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:44.131284 12373 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:44.142329  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.141137  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:44.143576  8121 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
W20260709 13:04:44.143939 12641 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:44.143092  8118 raft_consensus.cc:2368] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:44.128337 12568 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:44.131572 12302 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:44.137030 12509 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:44.151820 12528 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:04:44.153818 12645 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:04:44.155344 12455 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:44.157819  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:44.158691  8192 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:44.140995 12373 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.169878  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2049) took 1313 ms. Trace:
I20260709 13:04:44.153182 12648 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:44.131431 12429 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:04:44.152604 12638 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:04:44.173372  8198 rpcz_store.cc:276] 0709 13:04:42.856182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.213318 (+357136us) service_pool.cc:224] Handling call
0709 13:04:43.221620 (+  8302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.234442 (+ 12822us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:43.276534 (+ 42092us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.815113 (+538579us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b180037d8c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf 00007fbd24d42038
0709 13:04:44.125425 (+310312us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.125549 (+   124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.132147 (+  6598us) log.cc:844] Serialized 26 byte log entry
0709 13:04:44.132363 (+   216us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:44.132399 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.132575 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:44.169645 (+ 37070us) raft_consensus.cc:1685] finished
0709 13:04:44.169671 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.169816 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17268,"prepare.queue_time_us":310880,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":21980,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":17888,"spinlock_wait_cycles":18003712,"thread_start_us":675156,"threads_started":2,"wal-append.queue_time_us":748290}
I20260709 13:04:44.151165 12568 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:44.185647 12637 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:04:44.187573  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:44.188179 12429 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.190596  8091 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:04:44.167834 12635 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:04:44.191846  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 71276.6us
I20260709 13:04:44.163194 12509 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.182906 12648 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:44.189692 12568 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:44.198275 12575 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:44.198913 12642 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:44.199571 12375 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.200654 12300 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:44.201462 12580 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:44.205791  8091 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:44.207593 12625 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.209213  8163 leader_election.cc:400] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:04:44.211031 12307 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:44.182106 12373 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:44.227200 12509 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:44.245262 12632 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:04:43.539688  8270 rpcz_store.cc:276] 0709 13:04:41.934691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.113643 (+1178952us) service_pool.cc:224] Handling call
0709 13:04:43.119051 (+  5408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.119239 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:43.350861 (+231622us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.506564 (+155703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.506721 (+   157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:43.506766 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.506824 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.506928 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":21339,"thread_start_us":352123,"threads_started":2}
I20260709 13:04:44.247226  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:44.249414 12625 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:44.227890 12648 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:44.241622 12642 consensus_queue.cc:1243] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:44.252447 12646 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:44.253636 12071 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:04:44.255034  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:44.256529  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 791) took 1036 ms. Trace:
I20260709 13:04:44.241119 12010 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:44.260497  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:44.239508 12580 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.264071  8193 rpcz_store.cc:276] 0709 13:04:43.220573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.468992 (+248419us) service_pool.cc:224] Handling call
0709 13:04:43.469660 (+   668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.476918 (+  7258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.476948 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:43.502457 (+ 25509us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.856559 (+354102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:43.920086 (+ 63527us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.990190 (+ 70104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.990355 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:44.256333 (+265978us) raft_consensus.cc:1685] finished
0709 13:04:44.256352 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.256473 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6862,"prepare.queue_time_us":154574,"raft.queue_time_us":130909,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":13683,"spinlock_wait_cycles":4900096,"thread_start_us":360483,"threads_started":3,"wal-append.queue_time_us":353324}
I20260709 13:04:44.266716  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:44.257944  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 127219us
I20260709 13:04:44.274300  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:44.274677  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:44.262180 12598 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.278517  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:44.263761 12307 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:44.264766 12071 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:44.280781  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:44.276291 12535 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:44.281553 12659 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.275919 12625 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.274302 12580 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:44.275447 12010 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:44.295740 12010 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.299579 12373 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.281746 12516 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:44.289896 12659 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.307312 12659 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:44.289927 12071 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:44.308046 12071 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:44.308401 12568 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.280519 12455 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:44.287146 12307 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:44.285019 12535 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.278098 12646 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.285785 12429 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:44.280428 12302 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:04:44.291667 12582 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.323634 12582 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:44.273212 12655 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:04:44.301980 12616 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 0.561s	user 0.001s	sys 0.002s
I20260709 13:04:44.302631  8191 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:44.307456 12373 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:44.285765  8163 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:44.278914 12413 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:45.384410 12413 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:44.311573 12535 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:45.387269  8124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2283) took 2116 ms (client timeout 2034 ms). Trace:
W20260709 13:04:45.387660  8124 rpcz_store.cc:269] 0709 13:04:43.270782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.277049 (+  6267us) service_pool.cc:224] Handling call
0709 13:04:45.387068 (+2110019us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54000dd754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:45.387201 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78796672}
I20260709 13:04:44.346020 12580 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:45.391533 12580 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:44.343740 12648 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:44.393041 12568 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:44.408231 12516 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:45.393915 12516 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.404213 12509 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:44.422362  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2059) took 1186 ms. Trace:
I20260709 13:04:45.394625  8196 rpcz_store.cc:276] 0709 13:04:43.235681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.546771 (+311090us) service_pool.cc:224] Handling call
0709 13:04:43.547046 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.547349 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.547374 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.418596 (+871222us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b2c0000e5c8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:04:44.418971 (+   375us) log.cc:844] Serialized 26 byte log entry
0709 13:04:44.419986 (+  1015us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.420027 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.420109 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:44.422079 (+  1970us) raft_consensus.cc:1685] finished
0709 13:04:44.422100 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.422303 (+   203us) inbound_call.cc:177] Queueing success response
0709 13:04:44.497541 (+ 75238us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b4800002dd8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
Metrics: {"raft.queue_time_us":8002,"raft.run_cpu_time_us":4619,"raft.run_wall_time_us":931484,"spinlock_wait_cycles":85091968,"thread_start_us":633,"threads_started":1,"wal-append.queue_time_us":1581}
I20260709 13:04:44.474706 12533 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:45.395838 12509 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:45.397593 12648 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:44.493616 12599 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:44.502945 12530 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:44.552167  8777 connection.cc:256] RPC call timeout handler was delayed by -1.1585445839999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 13:04:45.402458  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:45.402639  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:44.554352  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 825) took 1128 ms. Trace:
I20260709 13:04:45.403939  8802 rpcz_store.cc:276] 0709 13:04:43.425762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.425855 (+    93us) service_pool.cc:224] Handling call
0709 13:04:43.432403 (+  6548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.775751 (+343348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.554151 (+778400us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54004475d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:44.554301 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757233920}
I20260709 13:04:45.408188 12668 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.407971 12535 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:44.705709  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.913080 12663 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:45.408727 12533 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:45.339938  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:45.354460  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e848f577948c470fb4c95fcc2b55b7ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:45.359023  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:45.409925  8193 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:45.410429  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.409057 12663 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:45.412683 12621 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:45.413076 12621 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:45.413439 12663 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:45.413950 12568 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.409616  8191 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:45.416397 12628 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:45.416755 12628 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:45.417495 12628 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:45.409566 12533 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:45.418617 12628 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:45.419041 12533 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.413421 12621 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:45.409659  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 55255us
W20260709 13:04:45.427459  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 1.60523e+06us
I20260709 13:04:45.433120  8193 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:45.433796 12648 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:45.434332 12648 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:45.436398 12648 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:45.436841 12648 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.434260 12668 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:45.442406  8237 leader_election.cc:400] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14.
I20260709 13:04:45.442816  8237 leader_election.cc:403] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:45.361600 12669 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:45.361997 12362 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.365111 12670 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:45.374773 12514 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:45.447784 12514 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:45.375468 12634 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.399s	user 0.009s	sys 0.010s
W20260709 13:04:44.684319 12619 log.cc:927] Time spent T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.891s	user 0.002s	sys 0.006s
I20260709 13:04:45.443482  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:45.447027 12362 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:45.455736  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
W20260709 13:04:45.483848  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 1.19807e+06us
I20260709 13:04:45.466740 12670 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:45.484644  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:45.466981 12218 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:45.437223 12648 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:45.485999  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:45.490123  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 87569.2us
I20260709 13:04:45.492038  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:45.492854 12672 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:45.495543 12670 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:45.449872 12669 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.722223 12670 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.723387 12669 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:46.723918 12669 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:46.724354 12669 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:45.502076 12514 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:45.488094 12218 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:45.640748 12673 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:46.854048 12673 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.854408 12218 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.855510 12218 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:46.856460 12673 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:46.857101 12673 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:45.553126  8123 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:45.649933 12684 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.561179  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:46.915666  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2068) took 1355 ms. Trace:
I20260709 13:04:46.915992  8192 rpcz_store.cc:276] 0709 13:04:45.560758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.560893 (+   135us) service_pool.cc:224] Handling call
0709 13:04:46.915609 (+1354716us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:46.917001  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:45.500780  8196 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:46.925172  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2065) took 1426 ms. Trace:
I20260709 13:04:46.925527  8196 rpcz_store.cc:276] 0709 13:04:45.498254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.498385 (+   131us) service_pool.cc:224] Handling call
0709 13:04:45.500472 (+  2087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.924925 (+1424453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.925121 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.502187  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:46.927225  8197 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.929425 12672 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.929911 12672 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:45.502478  8198 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:45.655750  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:46.934178  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2066) took 1435 ms. Trace:
I20260709 13:04:45.634325  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:45.666687  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.671476 12682 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:46.347358 12674 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:46.442049  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:46.937136 12682 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:46.937822  8199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 803) took 1600 ms (client timeout 1580 ms). Trace:
W20260709 13:04:46.938294  8199 rpcz_store.cc:269] 0709 13:04:45.337492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.441663 (+1104171us) service_pool.cc:224] Handling call
0709 13:04:46.937749 (+496086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:46.939145  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:46.939575 12682 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:46.940203  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:46.940799  8199 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
W20260709 13:04:46.513666  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 494191us
W20260709 13:04:46.560477  8295 debug-util.cc:398] Leaking SignalData structure 0x7b0800039fe0 after lost signal to thread 7005
W20260709 13:04:46.602560  8191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.022s	sys 0.005s
I20260709 13:04:46.934535  8198 rpcz_store.cc:276] 0709 13:04:45.498497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.498598 (+   101us) service_pool.cc:224] Handling call
0709 13:04:45.498904 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.933918 (+1435014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.934100 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:46.941794  8191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.022s	sys 0.006s
I20260709 13:04:46.942234  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:46.942468  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2063) took 1444 ms. Trace:
W20260709 13:04:46.943066  8295 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6ec0 after lost signal to thread 7008
I20260709 13:04:46.943460  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:46.944125  8295 debug-util.cc:398] Leaking SignalData structure 0x7b0800170240 after lost signal to thread 8057
I20260709 13:04:46.636922 12686 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.944653 12686 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.638397 12687 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:46.638765 12688 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.937238 12674 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.945690 12688 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.947773 12674 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:46.671844 12527 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:46.673808  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 1.23147e+06us
W20260709 13:04:46.674593  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.676298 12523 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14.
W20260709 13:04:46.692869 12533 consensus_meta.cc:287] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.273s	user 0.021s	sys 0.009s
I20260709 13:04:46.726629 12670 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.949738  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2070) took 1388 ms. Trace:
I20260709 13:04:46.727694 12691 raft_consensus.cc:2764] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:04:46.727798  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 1.23576e+06us
I20260709 13:04:46.729436 12669 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:46.737937  8166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.010s	sys 0.020s
I20260709 13:04:46.950129  8199 rpcz_store.cc:276] 0709 13:04:45.561399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.949040 (+1387641us) service_pool.cc:224] Handling call
0709 13:04:46.949281 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.949450 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:46.949482 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.949519 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:46.949554 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.949602 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.949686 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:46.752432  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 808) took 1301 ms. Trace:
I20260709 13:04:46.951865  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2073) took 1389 ms. Trace:
I20260709 13:04:46.951133  8193 rpcz_store.cc:276] 0709 13:04:45.451448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.451587 (+   139us) service_pool.cc:224] Handling call
0709 13:04:45.451867 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:45.452175 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.452204 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:45.469240 (+ 17036us) log.cc:844] Serialized 26 byte log entry
0709 13:04:45.639284 (+170044us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:45.639332 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.639394 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.752189 (+1112795us) raft_consensus.cc:1685] finished
0709 13:04:46.752210 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.752366 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":439,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3897,"thread_start_us":150820,"threads_started":1,"wal-append.queue_time_us":175683,"wal-append.run_cpu_time_us":1601,"wal-append.run_wall_time_us":1001554}
I20260709 13:04:46.952219  8199 rpcz_store.cc:276] 0709 13:04:45.562168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.951159 (+1388991us) service_pool.cc:224] Handling call
0709 13:04:46.951412 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.951577 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:46.951602 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.951640 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:46.951675 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.951725 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.951820 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:46.754261 12516 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:46.754360 12514 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.765506 12648 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.953637 12516 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:46.772220 12568 consensus_meta.cc:287] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.358s	user 0.021s	sys 0.004s
I20260709 13:04:46.954563 12568 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:46.789748  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.008s	sys 0.018s
W20260709 13:04:46.955228  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.008s	sys 0.018s
W20260709 13:04:46.955523  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 1.32298e+06us
I20260709 13:04:46.956146  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:46.804610 12680 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:46.957496  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:46.957770 12674 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:46.957613 12680 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.958042 12687 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.806296  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2061) took 3396 ms. Trace:
W20260709 13:04:46.817752 12621 consensus_meta.cc:287] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.396s	user 0.016s	sys 0.008s
I20260709 13:04:46.949965 12670 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.960635 12621 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:46.962702 12670 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.963299 12621 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:46.822849 12500 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.964059 12500 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.966019 12500 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:46.953220  8193 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:46.966526 12500 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:46.825953 12580 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.966907 12700 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.967370  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:46.967248 12580 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:46.968636 12691 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:46.826357 12476 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:46.969277 12691 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:46.969666 12691 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:46.969623 12476 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.970148 12691 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.971726 12476 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:46.972517 12669 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:46.829320  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 807) took 4783 ms. Trace:
I20260709 13:04:46.973184  8272 rpcz_store.cc:276] 0709 13:04:42.046181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.118192 (+1072011us) service_pool.cc:224] Handling call
0709 13:04:43.217107 (+ 98915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.217291 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:43.445122 (+227831us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.741826 (+296704us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.411541 (+1669715us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003bc860. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:04:45.486604 (+ 75063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.486660 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:45.486712 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.486778 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.829152 (+1342374us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b5400189550. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:46.829264 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1674634,"prepare.queue_time_us":433601,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2843,"raft.queue_time_us":1689163,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8672,"spinlock_wait_cycles":205392000,"thread_start_us":578786,"threads_started":3,"wal-append.queue_time_us":436405,"wal-append.run_cpu_time_us":2473,"wal-append.run_wall_time_us":1212960}
I20260709 13:04:46.849452 12362 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.975292 12362 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:46.975633  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2075) took 1413 ms. Trace:
I20260709 13:04:46.975741 12362 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:46.975957  8193 rpcz_store.cc:276] 0709 13:04:45.562658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.952675 (+1390017us) service_pool.cc:224] Handling call
0709 13:04:46.952917 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.975387 (+ 22470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.975585 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:46.976984  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:46.859616 12684 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:46.860702  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2168) took 2801 ms. Trace:
I20260709 13:04:46.876401 12696 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:46.979094 12696 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:46.895838 12315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.398s	user 0.009s	sys 0.011s
W20260709 13:04:46.900825  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:46.903339  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.270s	user 0.008s	sys 0.015s
I20260709 13:04:46.910099 12698 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.910477 12535 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:46.912660  8088 connection.cc:256] RPC call timeout handler was delayed by -1.1396251509999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:04:45.497107  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2056) took 2457 ms. Trace:
I20260709 13:04:47.133579  8194 rpcz_store.cc:276] 0709 13:04:43.039507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.445301 (+405794us) service_pool.cc:224] Handling call
0709 13:04:43.467855 (+ 22554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.468185 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.468209 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:43.479234 (+ 11025us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.734858 (+255624us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:43.734895 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.734956 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.374908 (+1639952us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:45.495800 (+120892us) raft_consensus.cc:1685] finished
0709 13:04:45.495820 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.497049 (+  1229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3902,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":34324,"spinlock_wait_cycles":6609664,"thread_start_us":147584,"threads_started":1,"wal-append.queue_time_us":370243,"wal-append.run_cpu_time_us":37191,"wal-append.run_wall_time_us":2777565}
I20260709 13:04:46.922101  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2159) took 2928 ms. Trace:
I20260709 13:04:46.934594  8200 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:46.950708  8166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.010s	sys 0.020s
I20260709 13:04:46.953547  8199 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:04:46.819345  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 592) took 2832 ms. Trace:
I20260709 13:04:46.942781  8191 rpcz_store.cc:276] 0709 13:04:45.497746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.499979 (+  2233us) service_pool.cc:224] Handling call
0709 13:04:45.500257 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:45.500464 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.500488 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:45.500901 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:04:46.942149 (+1441248us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:46.942186 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.942249 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.942298 (+    49us) raft_consensus.cc:1685] finished
0709 13:04:46.942308 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.942416 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1440911,"threads_started":1,"wal-append.queue_time_us":163787,"wal-append.run_cpu_time_us":1581,"wal-append.run_wall_time_us":1001593}
I20260709 13:04:46.977566  8193 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:47.139632  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2076) took 1576 ms. Trace:
I20260709 13:04:47.140030  8199 rpcz_store.cc:276] 0709 13:04:45.562894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.953072 (+1390178us) service_pool.cc:224] Handling call
0709 13:04:46.953321 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:47.139316 (+185995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.139565 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.140525  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.141211  8193 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:47.141645  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2077) took 1578 ms. Trace:
I20260709 13:04:46.977906  8123 rpcz_store.cc:276] 0709 13:04:44.059551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.061137 (+  1586us) service_pool.cc:224] Handling call
0709 13:04:45.552859 (+1491722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:46.859496 (+1306637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.860514 (+  1018us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000dd750. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:46.860647 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3392874752}
I20260709 13:04:46.978570  8195 rpcz_store.cc:276] 0709 13:04:43.409834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.024697 (+614863us) service_pool.cc:224] Handling call
0709 13:04:44.024981 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.034342 (+  9361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.034368 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.042467 (+  8099us) log.cc:844] Serialized 26 byte log entry
0709 13:04:46.792279 (+2749812us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b180044e420. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:04:46.804421 (+ 12142us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:46.804462 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.805150 (+   688us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.806024 (+   874us) raft_consensus.cc:1685] finished
0709 13:04:46.806042 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.806240 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6547,"raft.queue_time_us":31981,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":4209,"spinlock_wait_cycles":8243456,"thread_start_us":11902,"threads_started":1,"wal-append.queue_time_us":2753256}
W20260709 13:04:46.981446  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.009s	sys 0.015s
I20260709 13:04:46.981608  8192 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:46.940943  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:46.981405  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 80652.3us
I20260709 13:04:46.944291  8198 raft_consensus.cc:2410] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:04:46.991593  8088 connection.cc:256] RPC call timeout handler was delayed by -1.1378251509999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:04:46.989089  8197 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:04:46.997581 12696 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.994458 12698 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.028841 12686 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.032881 12680 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:46.739329  8273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 820) took 3076 ms (client timeout 2947 ms). Trace:
W20260709 13:04:47.207911  8273 rpcz_store.cc:269] 0709 13:04:43.662651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.665495 (+  2844us) service_pool.cc:224] Handling call
0709 13:04:46.739137 (+3073642us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400211954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:46.739272 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275297664}
I20260709 13:04:46.984958  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:46.989737 12315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.010s	sys 0.012s
W20260709 13:04:46.945268  8295 debug-util.cc:398] Leaking SignalData structure 0x7b08000d77a0 after lost signal to thread 8149
W20260709 13:04:47.269086  8295 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4c00 after lost signal to thread 8224
W20260709 13:04:46.990590  8777 connection.cc:256] RPC call timeout handler was delayed by -1.3101174899999251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2947s for a response
I20260709 13:04:46.994665  8805 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:04:46.867089 12502 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.953706 12514 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.025708 12362 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:46.969166 12580 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.954068 12648 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:47.326157 12648 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.328045 12648 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:45.636284 12668 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.991750 12670 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:04:47.048237 12672 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:46.857553 12673 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.072525 12700 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:46.991139 12674 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.335757 12674 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.337694 12674 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:47.092317 12691 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.339502 12691 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:47.093564  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 1.45921e+06us
I20260709 13:04:47.340930  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:47.097635 12708 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:04:47.098359  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 141203us
W20260709 13:04:47.325053  8295 debug-util.cc:398] Leaking SignalData structure 0x7b080038a8e0 after lost signal to thread 8298
W20260709 13:04:47.342460  8295 debug-util.cc:398] Leaking SignalData structure 0x7b0800097520 after lost signal to thread 8299
I20260709 13:04:47.343068  8163 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:47.343502  8295 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7280 after lost signal to thread 8835
I20260709 13:04:47.116619 12688 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.344679  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.136016  8117 rpcz_store.cc:276] 0709 13:04:43.993562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.028643 (+ 35081us) service_pool.cc:224] Handling call
0709 13:04:44.040201 (+ 11558us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:44.045327 (+  5126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.045373 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:44.052727 (+  7354us) log.cc:844] Serialized 78 byte log entry
0709 13:04:44.227301 (+174574us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:44.241697 (+ 14396us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.250869 (+  9172us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b18003373c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:44.452044 (+201175us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18003373c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:45.435145 (+983101us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b48000801d8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
0709 13:04:46.826881 (+1391736us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18003373c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf 00007fbd24d42038
0709 13:04:46.827111 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:04:46.920828 (+ 93717us) log.cc:844] Serialized 14 byte log entry
0709 13:04:46.921115 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.921189 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.921227 (+    38us) raft_consensus.cc:1685] finished
0709 13:04:46.921239 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.922047 (+   808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2744405,"prepare.queue_time_us":2766368,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":30250,"raft.run_cpu_time_us":20894,"raft.run_wall_time_us":1190567,"spinlock_wait_cycles":83049600,"thread_start_us":123728,"threads_started":2,"wal-append.queue_time_us":178765,"wal-append.run_cpu_time_us":2118,"wal-append.run_wall_time_us":1012118}
I20260709 13:04:47.345224 12688 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:47.142014  8199 rpcz_store.cc:276] 0709 13:04:45.563164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.140819 (+1577655us) service_pool.cc:224] Handling call
0709 13:04:47.141132 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:47.141320 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:47.141369 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:47.141414 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:47.141451 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.141502 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.141595 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.146355  8200 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:47.346135  8200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2072) took 1784 ms (client timeout 2011 ms). Trace:
I20260709 13:04:47.152621  8196 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:47.345503 12700 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:47.346714  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2071) took 1785 ms. Trace:
I20260709 13:04:47.346835 12700 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:47.346349  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.347064  8196 rpcz_store.cc:276] 0709 13:04:45.561655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.940655 (+1379000us) service_pool.cc:224] Handling call
0709 13:04:47.346663 (+406008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.347967  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.348158  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:47.142779  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2078) took 1579 ms. Trace:
I20260709 13:04:47.349478  8193 rpcz_store.cc:276] 0709 13:04:45.563411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.141807 (+1578396us) service_pool.cc:224] Handling call
0709 13:04:47.142074 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:47.142410 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:47.142439 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:47.142484 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:47.142514 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.142570 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.142708 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.350510  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.351022  8193 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:47.351783  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.352396  8193 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:47.353021  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:47.159860  8197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2067) took 1661 ms (client timeout 1570 ms). Trace:
I20260709 13:04:47.160001  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2074) took 1597 ms. Trace:
I20260709 13:04:47.163129 12698 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.169358 12684 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.354470 12700 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:47.150924  8091 connection.cc:256] RPC call timeout handler was delayed by -1.6203417840000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:04:47.191135  8192 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
W20260709 13:04:47.198961  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 60362.4us
W20260709 13:04:47.354135  8197 rpcz_store.cc:269] 0709 13:04:45.498732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.499798 (+  1066us) service_pool.cc:224] Handling call
0709 13:04:47.159793 (+1659995us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:47.355106  8166 connection.cc:256] RPC call timeout handler was delayed by -1.5187399010000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:04:47.355825  8166 connection.cc:256] RPC call timeout handler was delayed by -1.4755816310000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29950000000000004s for a response
I20260709 13:04:47.356004  8197 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:04:47.356166  8091 connection.cc:256] RPC call timeout handler was delayed by -1.2234417839999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:04:47.356494  8091 connection.cc:256] RPC call timeout handler was delayed by -1.1595417839999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 13:04:47.356755  8091 connection.cc:256] RPC call timeout handler was delayed by -1.1577417839999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:04:47.357585  8192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2069) took 1796 ms (client timeout 2094 ms). Trace:
W20260709 13:04:47.358007  8192 rpcz_store.cc:269] 0709 13:04:45.561124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.916766 (+1355642us) service_pool.cc:224] Handling call
0709 13:04:47.357533 (+440767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.359066  8192 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:47.354351  8198 rpcz_store.cc:276] 0709 13:04:45.562419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.943242 (+1380823us) service_pool.cc:224] Handling call
0709 13:04:47.159951 (+216709us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:47.361256  8166 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.534s (SENT)
I20260709 13:04:47.354089 12672 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:47.361732  8163 leader_election.cc:400] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:47.246174  8265 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.363407 12533 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:47.363930  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.364827 12500 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:47.365298  8124 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:47.366633  8125 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:47.362625  8163 leader_election.cc:403] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:47.368316  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.365190 12500 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:47.369095  8125 raft_consensus.cc:2410] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:04:46.982815  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.372430  8192 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:47.272152 12516 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:47.274587  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.374281  8192 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:47.376061  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.376217  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.376631  8266 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:47.377591  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.378172  8269 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:47.379160  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.379742  8120 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:47.380419  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.381067  8271 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:47.379153  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.385829  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.388199  8270 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:47.388506  8274 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:47.391124  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.391676  8117 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.393702  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.394797  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.395257  8266 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.276528  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1888) took 3499 ms. Trace:
I20260709 13:04:47.397631  8268 rpcz_store.cc:276] 0709 13:04:43.777401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.787182 (+  9781us) service_pool.cc:224] Handling call
0709 13:04:43.787431 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:46.671141 (+2883710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:46.671174 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:46.671703 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:04:46.674968 (+  3265us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:46.697074 (+ 22106us) log.cc:844] Serialized 14 byte log entry
0709 13:04:47.276210 (+579136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.276289 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:47.276332 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:47.276343 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.276472 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3462019,"prepare.queue_time_us":21570,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":3476042,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"thread_start_us":24658,"threads_started":2,"wal-append.queue_time_us":700}
W20260709 13:04:47.400233  8020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 282) took 29429 ms (client timeout 15000 ms). Trace:
W20260709 13:04:47.278129  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 329285us
I20260709 13:04:47.403599  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:47.404209  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.404822  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.286901  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.405821  8194 raft_consensus.cc:2410] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:04:47.287988 12261 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.288578  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:47.408252  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.289440  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.410209  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.290238 12626 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:47.411125 12626 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.410903  8118 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:47.412107  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.290675 12530 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.413726 12530 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.415608 12530 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:47.415709  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.407650 12261 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.417917 12261 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.418023  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.361274 12700 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.323073 12502 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:47.281229  8238 connection.cc:256] RPC call timeout handler was delayed by -1.9896938319999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 13:04:47.324988 12514 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:47.427147  8238 connection.cc:256] RPC call timeout handler was delayed by -1.7070938319999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:04:47.427484  8238 connection.cc:256] RPC call timeout handler was delayed by -1.600893831999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:04:47.427747  8238 connection.cc:256] RPC call timeout handler was delayed by -1.5927938319999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
I20260709 13:04:47.428633  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.334829 12673 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.128861  8011 maintenance_manager.cc:643] P b6992e613c544a1db779b61d07fa6870: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.574s	user 0.178s	sys 0.073s Metrics: {"bytes_written":30152,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":14356,"dirs.run_cpu_time_us":374,"dirs.run_wall_time_us":875,"drs_written":1,"lbm_read_time_us":394,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1360148,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":79817,"threads_started":2,"update_count":15,"wal-append.queue_time_us":66195}
I20260709 13:04:47.345604 12688 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.429502 12688 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.323830 12669 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:47.430100 12669 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.431222  8012 maintenance_manager.cc:419] P b6992e613c544a1db779b61d07fa6870: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10058 bytes on disk
W20260709 13:04:47.159611  8088 connection.cc:256] RPC call timeout handler was delayed by -1.1288251510000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 13:04:47.433279  8011 maintenance_manager.cc:643] P b6992e613c544a1db779b61d07fa6870: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":327,"lbm_reads_lt_1ms":4}
W20260709 13:04:47.353535  8200 rpcz_store.cc:269] 0709 13:04:45.561906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.655495 (+ 93589us) service_pool.cc:224] Handling call
0709 13:04:47.346077 (+1690582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.139307  8122 rpcz_store.cc:276] 0709 13:04:43.986997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.987133 (+   136us) service_pool.cc:224] Handling call
0709 13:04:43.999115 (+ 11982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.999351 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.999378 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:43.999969 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:04:44.063695 (+ 63726us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:46.809894 (+2746199us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b18002c8d80. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd248d04bc 00007fbd21c1e48b 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf
0709 13:04:46.810037 (+   143us) log.cc:844] Serialized 14 byte log entry
0709 13:04:46.818946 (+  8909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.819035 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.819073 (+    38us) raft_consensus.cc:1685] finished
0709 13:04:46.819156 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.819291 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125344,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":2168,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":20369664,"thread_start_us":106332,"threads_started":3,"wal-append.queue_time_us":133044,"wal-append.run_cpu_time_us":1654,"wal-append.run_wall_time_us":1016497}
I20260709 13:04:47.437732 12669 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.361716  8166 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:47.437988  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:47.361969 12672 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.362831 12580 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:47.349047  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.439741  8196 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:47.367367  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.369623 12500 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.440563  8116 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.441368 12500 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.360769  8198 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:47.443148 12672 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:47.239468 12687 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.445165  8802 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:47.438756 12696 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:47.438859  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77638.9us
W20260709 13:04:47.446888  8166 connection.cc:256] RPC call timeout handler was delayed by -1.3747399009999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:04:47.447198  8166 connection.cc:256] RPC call timeout handler was delayed by -1.3596352700000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:04:47.446354  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:47.447489  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.447790  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.448155  8166 connection.cc:256] RPC call timeout handler was delayed by -1.2586816310000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32360000000000005s for a response
W20260709 13:04:47.448421  8166 connection.cc:256] RPC call timeout handler was delayed by -1.2423966440000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:04:47.448673  8166 connection.cc:256] RPC call timeout handler was delayed by -1.1425399010000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 13:04:47.449213 12687 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.449661 12687 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.450505  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.451464  8117 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:47.451586  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.452035 12516 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.452342  8808 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:47.452466 12516 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.454244  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.454521 12516 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.457279  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.451586 12687 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:47.458802  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 54036.6us
I20260709 13:04:47.461050 12530 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:47.461524 12502 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.460415  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:47.422536  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.463943 12490 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:47.423481  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.464416 12490 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:47.465037  8121 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:04:47.465770 12673 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:47.449999  8810 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:04:47.463109  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.467633  8808 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:47.467770 12490 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.413168 12626 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:47.250814  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.472024 12688 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.474053 12698 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:47.476518 12675 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.477269 12675 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:47.478078  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 116469us
I20260709 13:04:47.479215 12675 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:47.480098 12675 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.480567 12675 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:47.419773  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 75164.7us
I20260709 13:04:47.483654  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.484189  8193 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:47.484840  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56262.3us
I20260709 13:04:47.422199  8272 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:47.485491  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.486681 12626 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:47.485311  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:47.527524 12626 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.527922 12626 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:47.529011 12533 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:47.529394 12533 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:47.529739 12533 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.534732  8116 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:47.536549 12533 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.538130  8199 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:47.540593  8274 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:47.541538  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:47.490381  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 507592us
I20260709 13:04:47.542712  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.543048  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.543712  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.543844  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:47.544255  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 59027us
I20260709 13:04:47.544677  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.407532  8270 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
W20260709 13:04:47.705821  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 160370us
I20260709 13:04:47.401054  8120 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:47.545241  8274 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:47.563726  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:47.548501  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.549872  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.507198  8807 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:47.508692  8809 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:47.564839  8802 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:47.580503  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.526175  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:47.496202  8166 leader_election.cc:336] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.782s (SENT)
I20260709 13:04:47.513124  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.693971  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.622018  8265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1881) took 3879 ms. Trace:
I20260709 13:04:47.708266  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:47.594339  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 108914us
I20260709 13:04:47.615473  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.692615  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.508682  8266 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:47.585242  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.717922  8808 raft_consensus.cc:2393] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:47.510428  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:47.498420  8197 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:47.716107  8274 raft_consensus.cc:2410] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:04:47.514546  8271 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:04:47.582372  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:47.719573  8804 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.719830  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.504992  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.715432  8265 rpcz_store.cc:276] 0709 13:04:43.742278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.742602 (+   324us) service_pool.cc:224] Handling call
0709 13:04:43.742855 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.900136 (+3157281us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b1800086d00. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d63646 00007fbd24c9d58e 00007fbd24d1ef9e 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:46.913011 (+ 12875us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b58006e69d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d1efe7 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:47.245793 (+332782us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b58006e66d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d1efe7 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:47.614484 (+368691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:47.614514 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:47.614553 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:47.614771 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.621822 (+  7051us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.621960 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82891,"raft.queue_time_us":83016,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":7506694528}
I20260709 13:04:47.720940  8272 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:47.716645  8269 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.718948  8805 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:47.506268  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.505654  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.724153  8117 raft_consensus.cc:2410] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:04:47.502992  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:47.708583  8803 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:47.721588  8166 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:47.740135 12580 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:47.725816  8121 raft_consensus.cc:2376] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15. Re-sending same reply.
W20260709 13:04:47.614952 12539 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:04:47.747988  8269 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:47.748687  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.759509  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.749308  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.749919  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.750378  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.750568  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.751085  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.594561 12621 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:47.765144  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:47.753360  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 79638.2us
I20260709 13:04:47.759388  8267 raft_consensus.cc:606] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:47.765615  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.766006  8267 raft_consensus.cc:614] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:47.767226  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.767830  8271 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:47.768608  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.761478  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.761797  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.762926  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.769666  8265 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.769935  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.770195  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.770943  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.771772  8118 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:04:47.771911  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.710373 12530 raft_consensus.cc:2764] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:47.763734  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.764019  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.547642 12533 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.485694 12687 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:47.784595  8803 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:47.490469 12669 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:47.545981 12674 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:47.753278  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.518349 12688 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.773744  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.800542  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.801062  8117 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.774668  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:47.801198  8116 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.766649  8777 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:47.775175  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.776057  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.546180 12670 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:47.489068 12675 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:47.558274 12672 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.803361  8273 raft_consensus.cc:2410] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:47.776944  8265 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:47.774071  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:47.798374  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.804083  8809 raft_consensus.cc:2376] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14. Re-sending same reply.
I20260709 13:04:47.777940  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.802716  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.742285 12516 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.400614  8020 rpcz_store.cc:269] 0709 13:04:17.971061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.971262 (+   201us) service_pool.cc:224] Handling call
0709 13:04:47.400031 (+29428769us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:41.596514 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:41.615802 (+ 19288us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:41.615844 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:04:41.615862 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:41.617120 (+  1258us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:41.617204 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:41.617231 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:04:41.618360 (+  1129us) tablet.cc:701] Row locks acquired
0709 13:04:41.618405 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:04:41.618568 (+   163us) write_op.cc:270] Start()
0709 13:04:41.618695 (+   127us) write_op.cc:276] Timestamp: P: 1783602281618502 usec, L: 0
0709 13:04:41.618718 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:41.619528 (+   810us) log.cc:844] Serialized 5914 byte log entry
0709 13:04:42.481276 (+861748us) op_driver.cc:464] REPLICATION: finished
0709 13:04:43.201692 (+720416us) write_op.cc:301] APPLY: starting
0709 13:04:43.201785 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:43.202812 (+  1027us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:43.202934 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:43.204187 (+  1253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:43.204582 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 13:04:43.204632 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:43.205024 (+   392us) log.cc:844] Serialized 107 byte log entry
0709 13:04:43.578355 (+373331us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:43.613479 (+ 35124us) write_op.cc:454] Released schema lock
0709 13:04:43.631934 (+ 18455us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:43.682610 (+ 50676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:43.691030 (+  8420us) write_op.cc:454] Released schema lock
0709 13:04:44.255553 (+564523us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
Metrics: {"mutex_wait_us":139338,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":596352,"apply.run_cpu_time_us":13336,"apply.run_wall_time_us":454681,"num_ops":15,"prepare.queue_time_us":235944,"prepare.run_cpu_time_us":12289,"prepare.run_wall_time_us":114244,"raft.queue_time_us":547496,"raft.run_cpu_time_us":11621,"raft.run_wall_time_us":783741,"replication_time_us":782843,"spinlock_wait_cycles":8261504,"thread_start_us":929879,"threads_started":5,"wal-append.queue_time_us":621815,"wal-append.run_cpu_time_us":10770,"wal-append.run_wall_time_us":2731738}]]}
I20260709 13:04:47.778569  8119 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:47.778977  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.500475 12700 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:47.780805  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.814088  8121 raft_consensus.cc:2393] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:47.781446  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.782860  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.786499  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.815515  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.521384 12698 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.244s
I20260709 13:04:47.515033 12696 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.250s
W20260709 13:04:47.787792  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.789880  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.790701  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38292 (request call id 38) took 4001 ms. Trace:
I20260709 13:04:47.831146  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.831437  8267 rpcz_store.cc:276] 0709 13:04:43.778724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.783836 (+  5112us) service_pool.cc:224] Handling call
0709 13:04:47.780240 (+3996404us) spinlock_profiling.cc:243] Waited 3.97 s on lock 0x7b54003b88d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d22853 00007fbd29cf060a 00007fbd232767d4 00007fbd23276762 00007fbd23276691 00007fbd2327660c 00007fbd232758c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:47.780315 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9141366144}
I20260709 13:04:47.784857  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:47.791294  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.832422  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.832894  8269 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:47.793216  8804 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:47.832991  8271 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 7.
I20260709 13:04:47.834930  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.796933  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.798087  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.766310 12648 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.852385  8268 raft_consensus.cc:2368] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
W20260709 13:04:47.852164  8163 connection.cc:256] RPC call timeout handler was delayed by -2.3683674139999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:04:47.854219  8163 connection.cc:256] RPC call timeout handler was delayed by -1.6796750059999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3279s for a response
I20260709 13:04:47.797883 12684 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.807963  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.809244  8806 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:47.811484  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.816154  8119 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:47.815599  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.859433  8125 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:47.773970 12502 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:47.815959  8123 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 9.
I20260709 13:04:47.848543  8116 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:47.831869  8121 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:47.854956  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:47.853713  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.784162 12621 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:47.812122 12670 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.806023  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.765264 12261 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:04:47.773837 12523 consensus_queue.cc:1059] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:04:47.788833 12669 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:47.889415  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.859637  8266 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:47.890429  8269 raft_consensus.cc:2410] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:47.890733  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.861038  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.861217  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:47.862136  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.799873 12674 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:47.860239  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.913404  8273 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:47.859779  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.763048 12626 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.872741  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:47.873960  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 89160.5us
I20260709 13:04:47.875270  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.915558  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.863524  8270 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:47.882719  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:47.915552  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 239527us
I20260709 13:04:47.916272  8269 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:47.916781  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:47.917747  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.886689  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.918823  8274 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:47.888356  8117 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:47.892611  8268 raft_consensus.cc:2376] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13. Re-sending same reply.
I20260709 13:04:47.920151  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.920672  8268 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:47.921445  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.921877  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.922132  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:47.873678 12621 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.914557  8271 raft_consensus.cc:2410] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:04:47.831954 12688 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:47.872505 12700 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:47.891355  8266 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:47.934532  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.939599  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.940233  8269 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:47.935770  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.936586  8270 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:47.922140  8268 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:47.875010 12604 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:47.873014 12527 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.941226  8197 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:47.829504 12516 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:47.941560  8266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:47.942497  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:48.004189  8274 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:04:48.008364  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 241773us
I20260709 13:04:48.019474  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:47.944561  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.021263  8198 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:47.943100  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.954540  8194 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:47.955876  8269 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:47.955547  8774 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:47.911568 12669 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.955518  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:47.946321  8271 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:47.863149 12648 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.960155  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:48.008749  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.954445  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:47.883780 12670 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:48.020131 12218 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:48.015692  8274 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.005437  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.035316  8196 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:48.004907  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.036465  8193 raft_consensus.cc:2410] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:47.701225  8018 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 7 to 11, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 11 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.891355 12687 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:04:48.022317  8806 raft_consensus.cc:2410] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:04:48.016710  8268 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:48.039851  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 173695us
I20260709 13:04:48.014184  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:47.915392 12674 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.880718 12502 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:47.882205 12684 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.047643  8268 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:48.048914  8268 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:48.026422  8271 pending_rounds.cc:85] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 10
I20260709 13:04:48.049518  8271 pending_rounds.cc:107] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:04:48.049772  8271 raft_consensus.cc:2889] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:48.026860  8267 raft_consensus.cc:2368] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:04:47.960534 12700 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:48.037679  8274 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:47.960534  8808 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:48.039767  8273 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:48.002226 12527 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.009101 12732 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:04:48.033123 12736 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:48.024928  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 498776us
I20260709 13:04:48.081703  8195 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:48.080611  8267 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:48.067405  8268 pending_rounds.cc:85] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 10
I20260709 13:04:48.082494  8268 pending_rounds.cc:107] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:48.082811  8268 raft_consensus.cc:2889] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:48.068464  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 572273us
W20260709 13:04:48.074451  8221 debug-util.cc:398] Leaking SignalData structure 0x7b0800373900 after lost signal to thread 7005
I20260709 13:04:48.082998  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.083155  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:48.083460  8221 debug-util.cc:398] Leaking SignalData structure 0x7b0800098d80 after lost signal to thread 7008
I20260709 13:04:48.052063  8266 raft_consensus.cc:606] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.080211  8117 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.084187  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:48.084408  8221 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2720 after lost signal to thread 8057
I20260709 13:04:48.084673  8266 raft_consensus.cc:614] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:48.081313  8089 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:48.085976  8221 debug-util.cc:398] Leaking SignalData structure 0x7b080026ec00 after lost signal to thread 8149
I20260709 13:04:48.090152  8125 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:48.090232  8221 debug-util.cc:398] Leaking SignalData structure 0x7b08000df3c0 after lost signal to thread 8224
I20260709 13:04:48.091192  8118 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:48.091579  8221 debug-util.cc:398] Leaking SignalData structure 0x7b080023ca60 after lost signal to thread 8225
I20260709 13:04:48.093544  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:48.094256  8124 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.097044  8269 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
W20260709 13:04:48.097270  8221 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2b60 after lost signal to thread 8298
I20260709 13:04:48.098485  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:48.119372  8221 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0b00 after lost signal to thread 8299
I20260709 13:04:48.052386 12740 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:48.100855  8269 pending_rounds.cc:85] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 5
I20260709 13:04:48.120757  8125 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.099123  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.098345  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.117735  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.117640  8118 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:48.122321  8120 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:48.122471  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:48.121117  8269 pending_rounds.cc:107] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:04:48.123286  8269 raft_consensus.cc:2889] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:48.085304 12736 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.122797  8123 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:48.130065  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.079413 12516 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:48.089323 12514 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:48.052466 12688 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:04:48.161872 12218 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:48.165982  8117 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:48.170846 12502 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.171190  8018 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 4 to 11, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 11 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.120885 12740 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:48.149863 12672 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:48.166918 12747 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:48.174327 12747 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:48.174786 12747 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:48.052290 12737 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
W20260709 13:04:48.199787  8221 debug-util.cc:398] Leaking SignalData structure 0x7b08004000a0 after lost signal to thread 8835
I20260709 13:04:48.156723 12736 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:48.091007 12533 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 13:04:48.169054 12738 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:04:48.218127  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.173259  8018 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 11, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 11 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:48.174229 12740 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.167819 12742 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:48.225385  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.168705 12748 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:48.227222  8018 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.231385 12648 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.228132 12740 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.233736  8117 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:48.234740  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:48.235319  8122 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:48.232856  8018 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 5 to 9, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:04:48.221740 12700 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.243031  8018 catalog_manager.cc:5697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:48.245388  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.228381 12751 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.246691 12751 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.247165 12684 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.247357 12698 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:48.222324 12745 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:48.247985 12698 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.232897 12539 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:04:48.251721  8124 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
W20260709 13:04:48.254828  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 237312us
I20260709 13:04:48.257892  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:48.258467  8197 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:48.263473  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.229583 12626 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:48.205209 12523 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:04:48.254202 12737 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:48.272622  8237 connection.cc:256] RPC call timeout handler was delayed by -3.2198824280000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:04:48.276070  8237 connection.cc:256] RPC call timeout handler was delayed by -3.0389824279999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:04:48.278007  8237 connection.cc:256] RPC call timeout handler was delayed by -2.9246824279999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:04:48.279632  8237 connection.cc:256] RPC call timeout handler was delayed by -2.8778824280000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:04:48.281505  8237 connection.cc:256] RPC call timeout handler was delayed by -2.8058824280000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 13:04:48.283226  8237 connection.cc:256] RPC call timeout handler was delayed by -2.8031824280000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:04:48.285477  8237 connection.cc:256] RPC call timeout handler was delayed by -2.7896824279999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:04:48.287528  8237 connection.cc:256] RPC call timeout handler was delayed by -2.7653824280000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
W20260709 13:04:48.289086  8237 connection.cc:256] RPC call timeout handler was delayed by -2.7572824279999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:04:48.290666  8237 connection.cc:256] RPC call timeout handler was delayed by -2.7041824280000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:04:48.292223  8237 connection.cc:256] RPC call timeout handler was delayed by -2.6960824280000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
I20260709 13:04:48.260281 12732 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:48.254256 12748 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.266312 12733 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:48.295341  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 131351us
I20260709 13:04:48.248761 12698 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.268054 12604 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:48.296924  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet d4d62387bcf94eaaaf201aeca2c2a48f: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:48.308833  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 353355us
W20260709 13:04:48.305385  8237 connection.cc:256] RPC call timeout handler was delayed by -2.6528824279999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:04:48.306509  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
W20260709 13:04:48.309880  8237 connection.cc:256] RPC call timeout handler was delayed by -2.6321824280000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:04:48.310194  8237 connection.cc:256] RPC call timeout handler was delayed by -2.5916824280000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22540000000000002s for a response
W20260709 13:04:48.310499  8237 connection.cc:256] RPC call timeout handler was delayed by -1.4180824279999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3558s for a response
I20260709 13:04:48.307565  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:48.295825 12732 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:48.314136  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.307003  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:48.293756 12530 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:04:48.303778 12523 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:48.303975 12733 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:48.335003 12733 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.336199 12733 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:48.340348  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.316344  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.340214  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:48.316308 12604 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:48.326956 12691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.010s
W20260709 13:04:48.351833  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.011s
I20260709 13:04:48.328476 12523 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:48.355495  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.003s	sys 0.011s
I20260709 13:04:48.246186  8018 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:48.356557  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 44989.4us
W20260709 13:04:48.356943  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 521617us
I20260709 13:04:48.359833  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.348477 12742 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:48.347523 12698 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:48.353389 12691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.010s
W20260709 13:04:48.365427  8775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.021s	sys 0.034s
W20260709 13:04:48.365984  8775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.021s	sys 0.034s
I20260709 13:04:48.363987  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
W20260709 13:04:48.367157  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 347726us
W20260709 13:04:48.367597  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 641000us
I20260709 13:04:48.369069  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:48.371953  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:48.363359 12530 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:48.361799 12752 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:48.375167  8197 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:48.361297 12527 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:48.369243 12732 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.362080 12533 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:04:48.363520 12261 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:04:48.361155 12218 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:04:48.364902 12748 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.362995 12669 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.353797 12749 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:04:48.364351 12737 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:48.500593  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 160463us
I20260709 13:04:48.381673  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:48.489095  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.528308  8193 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:48.390501  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:48.460986  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 370111us
I20260709 13:04:48.395983  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:48.528885  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 156998us
I20260709 13:04:48.543238  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 838) took 1059 ms. Trace:
I20260709 13:04:48.528642  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1911) took 1012 ms. Trace:
W20260709 13:04:48.527653  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 152952us
I20260709 13:04:48.544661  8270 rpcz_store.cc:276] 0709 13:04:47.483497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.956247 (+472750us) service_pool.cc:224] Handling call
0709 13:04:47.956561 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:48.178178 (+221617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:48.178384 (+   206us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:48.248614 (+ 70230us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b2c0012ef08. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:04:48.249125 (+   511us) log.cc:844] Serialized 52 byte log entry
0709 13:04:48.351614 (+102489us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:48.351655 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.351735 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:48.529000 (+177265us) raft_consensus.cc:1685] finished
0709 13:04:48.529021 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:48.543174 (+ 14153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":259644,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":10647,"spinlock_wait_cycles":57824512,"thread_start_us":298001,"threads_started":2,"wal-append.queue_time_us":126797}
W20260709 13:04:48.546737  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 239244us
W20260709 13:04:48.548455  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 193548us
I20260709 13:04:48.544777  8269 rpcz_store.cc:276] 0709 13:04:47.516237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.023207 (+506970us) service_pool.cc:224] Handling call
0709 13:04:48.023589 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.149525 (+125936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.398039 (+248514us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b5400075154. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:48.528026 (+129987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167767296}
W20260709 13:04:48.549785  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 186712us
I20260709 13:04:48.550140  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:48.551782  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.552371  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:48.553157  8192 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.372437 12626 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:48.556771 12765 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:48.556864 12580 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:48.552439  8193 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:48.531395 12761 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.394166 12745 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:48.500665 12539 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:48.397673 12742 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:48.397704 12673 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:48.580356 12673 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.371932 12754 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:48.398902 12675 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:48.405866 12490 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:48.531478 12752 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:48.389910 12621 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:04:48.546021  8166 leader_election.cc:336] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.095s (SENT)
I20260709 13:04:48.428484 12762 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:48.423630 12751 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.545046 12737 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:48.573807 12765 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:48.406049  8018 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 4 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.558633 12759 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:04:48.558490 12696 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:04:48.576900 12761 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.561209 12626 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:48.405771 12747 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.583711  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:48.584131  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.452636 12670 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.512029 12674 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:48.588264  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.394802 12736 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.685485  8802 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:48.684958 12761 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.686810 12736 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:48.687995  8802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 854) took 1119 ms. Trace:
I20260709 13:04:48.687455  8018 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 5 to 13, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.688320  8802 rpcz_store.cc:276] 0709 13:04:47.569017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.764922 (+195905us) service_pool.cc:224] Handling call
0709 13:04:48.687792 (+922870us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400711454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:48.687942 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114784640}
I20260709 13:04:48.689445 12747 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:48.689900  8807 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:48.613642 12700 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:48.567961 12745 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.600431 12777 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:48.586638 12490 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:48.603790  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:48.712692  8192 raft_consensus.cc:2376] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15. Re-sending same reply.
I20260709 13:04:48.604123  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.604991  8198 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:48.607970  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:48.714365  8200 raft_consensus.cc:2376] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14. Re-sending same reply.
I20260709 13:04:48.614332  8199 raft_consensus.cc:1240] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.586925 12539 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:48.585062 12675 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:48.717751  8089 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:48.718546  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:48.675251  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:48.720188  8194 raft_consensus.cc:2376] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12. Re-sending same reply.
I20260709 13:04:48.720300  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:48.611755  8124 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:04:48.602249 12737 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.595642 12762 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:48.581243 12673 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.679102 12626 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.684906 12741 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:48.691737  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40706 (request call id 850) took 1123 ms. Trace:
I20260709 13:04:48.737860 12741 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.737910  8807 rpcz_store.cc:276] 0709 13:04:47.568132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.765392 (+197260us) service_pool.cc:224] Handling call
0709 13:04:48.691564 (+926172us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54004d7bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:48.691682 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124109184}
I20260709 13:04:48.591370  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:48.738821 12741 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.739809 12684 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:48.739526  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 193519us
W20260709 13:04:48.704100  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 151792us
I20260709 13:04:48.740913  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:48.741339  8166 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.995s (SENT)
I20260709 13:04:48.741994  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:48.741788 12675 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.742841 12675 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:48.702805  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 158794us
I20260709 13:04:48.745224  8807 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:48.713840  8197 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:04:48.731114  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.711581 12772 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:48.715735  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:48.710192 12700 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.731572 12763 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:48.746409 12670 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:48.746836 12763 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.747063 12670 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:48.748126  8166 leader_election.cc:336] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 3.236s (SENT)
W20260709 13:04:48.734046 12768 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:04:48.729174 12539 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.735157 12674 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:48.736258 12490 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.754483  8807 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:48.740090 12741 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:48.746284 12772 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:48.730242 12669 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:48.677146 12742 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:04:48.749284  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:48.711983 12688 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:48.774230 12763 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.774619 12688 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.775969  8804 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:48.776932 12688 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:48.712154 12648 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:48.777666 12648 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.778322 12500 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:48.765681  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:48.778836 12500 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:48.755561  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:48.728120 12762 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.779899 12500 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.784504 12745 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:48.772969  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 176045us
I20260709 13:04:48.786593 12762 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.788160 12673 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.788807 12762 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.753289 12674 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:48.773665  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:48.789994  8806 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:04:48.790166 12732 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:48.799775 12700 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:48.710443 12752 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:48.773994  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:48.733831 12774 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:04:48.800797 12752 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:48.800858  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.752578 12670 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:48.803467  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:48.846004  8270 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:48.846217  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:48.846817  8806 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
I20260709 13:04:48.848441  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:48.849258  8807 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:48.772799 12490 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.770258 12772 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.822332 12753 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:48.843596 12745 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:48.821877 12604 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:48.871398 12696 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:04:48.888253 12753 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:48.918569 12753 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.921567 12753 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:48.925220 12772 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:48.929665 12772 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:48.976354  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.974565  8018 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 5 to 6, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 6 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:04:48.978159  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:48.995683  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.013940  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 426507us
W20260709 13:04:49.015805  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 241740us
I20260709 13:04:49.016607  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:49.019387  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.021898  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.022858  8191 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:04:49.024039  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.025178  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.026064  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.028785  8194 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:49.029260  8191 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.803329  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:49.036566  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:49.049430  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 503515us
I20260709 13:04:49.053269  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:48.984957  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:48.748567  8166 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:48.980715  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 396901us
I20260709 13:04:49.053836  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.084121 12741 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:49.054785  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:49.055277  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:49.086745  8091 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:49.086187 12698 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:04:49.066927 12737 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.087880  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:49.076761 12805 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:04:49.089716  8200 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.091234 12737 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:49.093171 12502 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:49.093715 12502 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:49.094624 12748 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:49.093155 12741 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:49.095599 12741 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:49.094936 12502 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.097115 12502 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.097919 12748 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:49.096937 12741 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.114024 12514 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:49.114993  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:49.115401 12684 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:49.116359  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:49.117753  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:49.119329  8806 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:49.120296 12527 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:48.892557 12604 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:49.124677 12648 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.126701 12261 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:49.130796  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:49.131474 12530 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:49.132273  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 74062.4us
I20260709 13:04:49.134018 12675 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:49.133661 12523 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:49.162545  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.181357  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.170408  8200 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
W20260709 13:04:49.182312  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 197744us
I20260709 13:04:49.177801 12261 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.189664  8805 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:49.134858 12670 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.122421 12748 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.192080 12261 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:49.210130  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 461887us
W20260709 13:04:49.210979  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.007s (SENT) [suppressed 36 similar messages]
I20260709 13:04:49.211711 12748 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:49.212289  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.204391 12604 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.204576 12700 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:49.207703  8270 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
W20260709 13:04:49.208647 12798 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.292s	user 0.003s	sys 0.001s
W20260709 13:04:49.216248 12804 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 13:04:49.214521 12795 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:04:49.203807 12626 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:49.249770  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 163262us
I20260709 13:04:49.250420 12626 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:49.250974  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 197351us
I20260709 13:04:49.252419  8272 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:49.254252  8089 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:49.257858  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.214618 12523 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.212786  8807 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:49.191882 12805 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:49.242340  8196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.016s
I20260709 13:04:49.247035  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.269979 12769 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.257153 12533 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:49.261382 12761 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:49.270783 12769 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.271601 12754 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:49.242717 12700 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:49.283315  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85191.8us
W20260709 13:04:49.285454  8196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.003s	sys 0.019s
I20260709 13:04:49.203701 12778 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:49.288455 12769 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:49.289166 12684 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:49.289813 12684 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.290494  8777 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:49.291616 12776 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:49.292088 12684 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:49.292150 12776 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:49.293375 12776 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.245078 12750 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:49.277667 12700 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.271375 12761 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:49.296859 12533 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:49.292465  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:49.282565 12626 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:04:49.301764 12737 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:49.308764 12514 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:49.315537 12514 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.317435 12750 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.320811 12761 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.322359 12761 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.328399  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.325536  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:49.329715  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 134570us
I20260709 13:04:49.306177 12684 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.330521 12684 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:49.331586  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:49.332783 12684 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.333849  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:49.334875  8807 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:49.341800 12737 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:49.342322 12737 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:49.351063  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.326452 12805 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.358389  8802 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:49.353945  8193 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.020s	sys 0.019s
I20260709 13:04:49.361331 12778 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:49.362092 12514 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:49.362636  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 59869.5us
I20260709 13:04:49.362821 12750 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:49.364668 12673 consensus_meta.cc:287] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.006s
I20260709 13:04:49.365492 12684 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:49.365907 12684 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.366225 12684 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:49.377485  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.379241 12533 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.383401  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:49.384162  8809 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:49.374974 12737 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.374596  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:49.386116  8193 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.020s	sys 0.019s
I20260709 13:04:49.389592 12626 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:49.390058 12626 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:49.390455 12626 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:49.390882  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78229.5us
I20260709 13:04:49.392652  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:49.398228  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.398500  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:49.403880  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.401568 12753 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:49.307363 12754 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:04:49.400578 12626 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.373214 12261 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.424125  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.426084  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.426693  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:49.429481 12745 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:49.429771  8808 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:49.440575  8200 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:49.441330 12261 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:49.441649  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:49.445698  8806 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:49.445209 12490 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:49.452106 12490 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.452468 12490 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.412163 12805 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.450270  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.434394 12750 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:49.470098 12750 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.470589 12750 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:49.471524 12750 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.461512  8199 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:49.463318 12626 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.436201 12753 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:04:49.466312 12805 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:49.468670  8198 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:04:49.469200 12803 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.552s	user 0.002s	sys 0.000s
I20260709 13:04:49.465126  8200 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:49.488780  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 96251.9us
I20260709 13:04:49.490720  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:49.499396  8806 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:49.502043  8802 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:49.503381  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:49.504314  8124 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.504681  8125 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:49.507068 12754 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:49.507721  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:49.508224  8123 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:49.509038 12648 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:49.509809  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:49.510176 12648 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.510558 12648 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.511121 12805 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:49.513485  8198 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:49.507077  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:49.509068 12514 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:49.514954  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.513669  8809 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:49.519274  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:49.523504  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:49.524307  8125 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:49.524525 12514 consensus_queue.cc:1243] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:49.527585  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:49.518658  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.525170 12514 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:49.521750 12261 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:04:49.540443  8123 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.542104  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:49.541281 12261 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:49.546566 12261 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:49.547627 12261 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.548511  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:49.549146 12648 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.551533 12648 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.547570  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:49.551797 12793 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:04:49.552166  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:49.553252 12648 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:49.553681 12648 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:49.548907 12817 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 13:04:49.555735 12648 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.508985 12688 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:04:49.558045 12688 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:49.558413 12688 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:49.559438 12673 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:49.559880 12673 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:49.560127  8088 consensus_peers.cc:597] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 446d688479d34112bfc4ab0afb09d6f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:49.560839  8122 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:49.561131 12502 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:04:49.548388  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.558717  8124 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:49.548951 12261 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.571170  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:04:49.574441 12814 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:04:49.560195 12673 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.542959 12514 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:49.590193  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:49.594187  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49178.2us
I20260709 13:04:49.527256 12700 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.602103  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:49.606585  8809 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.580245 12753 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.569536 12806 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:49.610816  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 63336.5us
I20260709 13:04:49.604035 12778 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:49.615404  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.613286 12806 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:49.631907  8121 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:49.632184  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:49.632319 12514 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:49.633145 12815 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:49.637069  8802 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:49.624796 12748 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:49.642671  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.637384  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:49.654100  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.656642 12696 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:49.657088 12752 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:49.657363 12696 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.657778 12752 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.659559 12696 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.659736 12752 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.660418 12514 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:49.656822 12816 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:04:49.630777 12806 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:49.669389  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:49.644930 12626 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:49.629611 12753 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.630887 12684 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:49.689095  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 150674us
I20260709 13:04:49.662254 12648 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.657200 12490 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:49.695686  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 83557.8us
I20260709 13:04:49.667074 12778 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.687095 12696 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:04:49.704594 12820 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:04:49.705408 12819 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:04:49.701483  8774 leader_election.cc:336] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 2.107s (SENT)
I20260709 13:04:49.709722  8197 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:49.747278  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.844205  8809 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:49.747167  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:49.849858  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 158275us
W20260709 13:04:49.858109  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.859120  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:49.868741 12826 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:04:49.870458  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.871773 12834 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:49.853020 12604 consensus_meta.cc:287] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.008s
I20260709 13:04:49.879403  8192 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:49.897141  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:49.899122 12490 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:49.899812 12777 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:49.900240  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:49.900897 12648 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:49.901214 12754 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:49.902256  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.902529 12754 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:49.903393  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.904018 12754 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:49.904795 12754 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:49.905051  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:49.908319  8199 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:49.915179  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47882.9us
W20260709 13:04:49.916355 12824 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.234s	user 0.002s	sys 0.002s
I20260709 13:04:49.916445  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:49.917196  8805 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.892189 12604 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.877895 12626 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:04:49.918268  8274 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:49.920028 12604 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.924599  8805 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
W20260709 13:04:49.926961  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54994.7us
I20260709 13:04:49.905153 12754 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.910451  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2098) took 1302 ms. Trace:
I20260709 13:04:49.918196 12490 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:49.930056 12754 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:49.932304 12761 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.933029 12761 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:49.907858 12700 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.900095 12834 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.866631 12673 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:49.943848  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 255133us
I20260709 13:04:49.944758  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:49.945405  8272 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:49.906407 12745 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:04:49.949631  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 44643.2us
W20260709 13:04:49.947775 12829 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.302s	user 0.000s	sys 0.004s
I20260709 13:04:49.951360 12490 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:04:49.945971 12684 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:49.959175  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:49.964046  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:49.970561  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:49.962539 12834 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:49.993214  8272 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:49.965251 12490 consensus_queue.cc:1243] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:04:49.995491 12761 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:49.996187  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 824) took 1573 ms. Trace:
I20260709 13:04:49.971127 12775 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:49.931221  8193 rpcz_store.cc:276] 0709 13:04:48.606008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.694240 (+ 88232us) service_pool.cc:224] Handling call
0709 13:04:48.694572 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.694764 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:49.405521 (+710757us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.697910 (+292389us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:49.697979 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:49.863897 (+165918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.892469 (+ 28572us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:49.908003 (+ 15534us) inbound_call.cc:177] Queueing success response
0709 13:04:49.920832 (+ 12829us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
Metrics: {"prepare.queue_time_us":515793,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":279205,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":64,"spinlock_wait_cycles":2105088,"thread_start_us":919284,"threads_started":3,"wal-append.queue_time_us":161360}
I20260709 13:04:49.972537 12753 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.011334  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:50.004317  8267 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
W20260709 13:04:50.004252 12823 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.352s	user 0.005s	sys 0.001s
I20260709 13:04:49.965628 12533 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:04:50.004860 12514 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.957670 12752 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:04:50.039038  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.004926  8196 rpcz_store.cc:276] 0709 13:04:48.422755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.422899 (+   144us) service_pool.cc:224] Handling call
0709 13:04:48.544710 (+121811us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800003098. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:48.544895 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.545090 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:49.297451 (+752361us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.992967 (+695516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:49.995849 (+  2882us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:49.995941 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.996038 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:49.996130 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":665111,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":272597,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"spinlock_wait_cycles":2686720,"thread_start_us":1374262,"threads_started":3,"wal-append.queue_time_us":313439}
I20260709 13:04:50.025974 12761 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.015154 12805 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:50.011600 12786 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:50.014122 12775 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:50.074203  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.077368  8191 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:50.016098 12490 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:04:50.080886  8272 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:50.037145 12840 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:50.085253  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:50.087181 12825 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:04:50.087582  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.088305  8266 raft_consensus.cc:2376] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13. Re-sending same reply.
I20260709 13:04:50.076725 12761 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.089035 12761 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.089332  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.089601  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.089949  8266 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:50.091038  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.092113  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:50.083072 12844 log.cc:927] Time spent T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:04:50.091055  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.094466  8267 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:50.070856 12514 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:50.036859 12261 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:04:50.097414  8266 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:50.099291  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.100966  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.107965  8272 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
W20260709 13:04:50.108325  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.027365 12688 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.097281 12840 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:50.118160  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.112125  8270 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:50.113193  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.097159 12778 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.097872 12218 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:50.120529  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.121693  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.122349  8266 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:50.122303  8272 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 10.
W20260709 13:04:50.122785  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.124061  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 158340us
I20260709 13:04:50.125753  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:50.125445  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 189264us
W20260709 13:04:50.127278  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 173833us
I20260709 13:04:50.124830  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.147689  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.149159  8808 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:50.149699  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 202697us
I20260709 13:04:50.151739  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:50.122308 12673 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.156868  8805 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:50.156991  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.153673  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.152242  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:50.159361  8808 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:50.159408  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.166098  8270 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:50.167388 12490 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:50.167770 12490 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:50.168362 12771 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.169451  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.170027  8273 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.154379 12750 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.171047 12750 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:50.172180  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.172677  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.173025 12750 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.173532  8121 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.181887  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:50.173900  8272 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.176668  8805 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:04:50.145200 12688 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.169186  8123 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:50.178094  8191 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:50.180902  8265 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:50.181608  8124 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:04:50.168709 12490 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.152551 12793 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.197045  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:50.196264  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.199229  8122 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.199993  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:50.215219  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63395.5us
I20260709 13:04:50.225088  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.198886  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.225224 12669 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:50.193259 12806 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.004s
I20260709 13:04:50.229573  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:50.224267 12840 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.228888  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.168947 12514 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.229445  8196 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:50.188134 12777 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.168931 12771 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.223490 12762 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:50.230317  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50157.3us
I20260709 13:04:50.235603  8196 pending_rounds.cc:85] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 8
W20260709 13:04:50.198583  8166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.006s	sys 0.013s
W20260709 13:04:50.238304  8166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.014s
I20260709 13:04:50.236660  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:50.182878 12778 consensus_queue.cc:1059] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:04:50.241839  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:50.239666  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.240525  8193 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:04:50.239054  8196 pending_rounds.cc:107] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:50.230242 12669 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:50.249429  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.250610  8196 raft_consensus.cc:2889] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.253767  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:50.232102 12648 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.237711 12490 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.248854  8192 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:50.240129 12750 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:50.260154  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 848) took 1231 ms. Trace:
I20260709 13:04:50.237962 12754 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:50.302385  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 66940us
I20260709 13:04:50.236339 12806 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.304307  8196 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.279531  8200 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
W20260709 13:04:50.283252  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 646324us
I20260709 13:04:50.157150 12775 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.245309 12533 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.236049 12793 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.239678 12860 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.105s
W20260709 13:04:50.308951  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.283461  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:50.284873  8273 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:50.320444  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:50.327690  8274 rpcz_store.cc:276] 0709 13:04:49.025772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.043279 (+ 17507us) service_pool.cc:224] Handling call
0709 13:04:49.043809 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.918674 (+874865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.252751 (+334077us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54003b9f54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:50.256692 (+  3941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010487168}
I20260709 13:04:50.246111 12762 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.243512 12777 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.343454  8121 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
W20260709 13:04:50.349617  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 83836us
W20260709 13:04:50.382788 12850 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:04:50.383522 12851 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:50.384006 12857 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:50.385067 12861 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:04:50.387310  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 688875us
I20260709 13:04:50.388617  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:50.389528 12797 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:04:50.391129 12771 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.389403 12775 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.300412 12648 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.391254  8200 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:50.425230  8120 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:50.394445  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 155233us
I20260709 13:04:50.303115 12838 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.400184  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.302928 12849 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.404858  8198 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:50.300982 12855 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:04:50.389453 12790 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:50.411067  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.417977  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.434495  8274 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:04:50.434891  8274 pending_rounds.cc:85] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 11
I20260709 13:04:50.401008 12533 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.420854  8271 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:50.436017  8274 pending_rounds.cc:107] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:04:50.436311  8274 raft_consensus.cc:2889] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.425186 12830 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:50.442644  8268 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:50.444643  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.445245  8266 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:50.446799  8271 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:50.422487 12851 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:04:50.449437 12843 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:04:50.450770 12777 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.452512 12762 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.453033 12762 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:50.454555 12849 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.419162 12857 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.456820 12849 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.457574 12857 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.458248  8117 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:04:50.437376 12838 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.460930 12793 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.424666 12875 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:50.432711 12696 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.469826  8122 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:50.472632 12696 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.473053 12696 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.454653 12648 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.421938 12669 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.454787 12762 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:04:50.474001 12669 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.474958  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.437964 12741 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:50.475984  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.459170 12533 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.458439 12806 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.463483 12830 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.479521 12648 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:50.482352 12862 raft_consensus.cc:2764] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:04:50.481673 12865 consensus_queue.cc:1175] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:50.485044 12754 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.488740 12753 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:50.489014  8267 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:04:50.492965  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:50.494306  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.507809  8267 pending_rounds.cc:85] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 11
I20260709 13:04:50.508607  8267 pending_rounds.cc:107] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:04:50.495013  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.508850  8267 raft_consensus.cc:2889] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.440434 12761 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.509152  8274 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:50.515690  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:50.518332  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 106150us
I20260709 13:04:50.492216 12830 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:50.520882  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.524158  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:50.507680 12753 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:50.530208  8271 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:04:50.532734 12761 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.533033 12753 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.534108 12753 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.526233 12849 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.537604  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:50.540205 12673 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:04:50.516577 12855 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:04:50.543356 12793 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:50.544629 12793 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.545007 12855 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:50.545432 12855 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:50.545207 12849 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.546277 12855 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.547477 12849 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.548197 12855 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:50.548849 12874 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:50.550164  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.550987  8777 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.552928 12870 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:50.553301 12870 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.553629 12870 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.556054 12855 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.556427 12855 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.556739 12855 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.540314  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.557770  8197 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:50.506659 12871 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:04:50.575209  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.577541  8806 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:50.576237  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:50.580983  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.582883  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:50.583321  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 145899us
I20260709 13:04:50.580804  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:50.583465  8121 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:04:50.589660 12869 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:50.589839 12876 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:50.590206 12533 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:50.590507  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:50.591014  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.591842  8122 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:50.595113  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 120244us
I20260709 13:04:50.601132  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.545152 12793 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.544577 12696 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.544843 12858 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:04:50.586715 12875 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.584353 12754 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.609951  8806 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:50.611889  8195 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:50.614331  8802 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:50.590245 12876 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.594128 12533 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:50.623816  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:50.616185 12771 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:04:50.623397 12849 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:04:50.626833  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:50.628921  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:50.630080 12533 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.630672 12696 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.631944 12864 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:50.633786 12834 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.636961  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:50.640712  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.628758 12870 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.609025 12869 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:50.644349  8192 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:50.647603  8088 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:50.613629 12261 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.638705 12876 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.667937  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.663077  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:50.663494  8198 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:50.644722 12849 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:50.669042  8802 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.670851  8809 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:50.671252  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:50.676995  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 53446.6us
I20260709 13:04:50.679620 12869 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.680514 12871 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.681171 12871 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.683440 12871 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.684135 12883 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:50.624985 12754 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.661499 12790 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.684585 12883 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.670131 12533 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.729933  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:50.730693  8198 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.731886  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.732450  8124 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:50.729794 12790 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.733753 12790 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.734071 12870 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.738443  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:50.739753  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.740687  8166 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:50.741088  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.741770  8268 raft_consensus.cc:2376] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15. Re-sending same reply.
I20260709 13:04:50.742605 12688 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:50.743216 12688 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:50.744088 12688 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.745595 12514 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:50.745728 12840 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:50.746007 12514 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.746418 12514 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:50.742156 12790 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.668365 12882 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.677410 12490 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.750125  8198 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:50.757761  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.758574  8268 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.758509  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.729696 12883 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.741456 12872 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.757942 12805 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:50.751797 12875 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:50.759356 12870 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.767825 12870 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.768821 12754 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.770160 12870 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.763602 12741 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:50.756026 12490 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.774696  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:50.775554  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.776309  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.777078 12648 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:50.777724 12648 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:50.778040 12648 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.778384 12648 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.780385  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.747993 12261 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.765880 12805 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.783615  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.789038 12669 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:50.790310 12604 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:50.790690 12604 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:50.791502 12604 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.792440 12604 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.780594  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.793617 12834 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.794026 12834 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.795370  8198 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.796962  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.797644  8807 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:50.798043  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.795985 12834 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.796630  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.801369  8271 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:50.801976  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:50.803406  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.803606 12772 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:50.805572 12793 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.774605 12490 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.814854  8124 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:50.816881  8268 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:04:50.765764 12869 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:50.829799  8121 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:50.822376  8120 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:50.822567  8274 raft_consensus.cc:2410] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:04:50.823310  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.766747 12872 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.823781 12855 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.824506 12862 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:50.828826  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.832667  8777 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.833514  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:50.835593  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:50.836236  8806 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:50.836828  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.834259 12862 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:50.837317 12750 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:50.837603 12862 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.837922  8124 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:50.829625 12869 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.839169 12750 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.829031 12261 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:50.839718 12750 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.839550  8804 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.840560 12855 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.840888  8196 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:50.827147 12830 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.841953  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:50.843071  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.843602  8196 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:50.839023 12793 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:50.798468 12669 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:04:50.846144 12793 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:50.846971 12737 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:50.847415 12737 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:50.847600 12793 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.848367 12737 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.845575  8199 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:50.851230  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:50.852088  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.854627  8802 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:50.857048  8088 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:50.817836 12772 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:50.857841 12261 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.858165  8124 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:50.858767 12772 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.859714 12772 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.860198  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:50.861073  8194 raft_consensus.cc:2410] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:04:50.858659 12700 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:50.858280  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.862568  8273 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.857972 12849 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.864003 12849 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:50.865001  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:50.861027 12626 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:50.850196 12737 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.850005 12514 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.875526  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.876674  8166 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.870289  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:50.839568 12869 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.855824 12775 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:50.872797  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.845610 12830 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.838794 12872 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.878185  8237 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:50.931537  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53442.9us
W20260709 13:04:50.931982  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.879997  8273 raft_consensus.cc:2468] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
W20260709 13:04:50.889528  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.904665  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.907142 12514 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:50.886493 12752 raft_consensus.cc:2764] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:04:50.909663 12700 raft_consensus.cc:2764] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:50.914152  8166 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:50.871192 12626 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:50.917603  8163 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.551s (SENT)
W20260709 13:04:50.986909  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 69369.9us
I20260709 13:04:50.876452 12851 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:50.982582  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.934336  8777 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:50.990471  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 56232.5us
I20260709 13:04:50.917425 12876 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:50.991389  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77311.6us
I20260709 13:04:50.995554  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:50.885967 12855 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:50.992029  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:50.995954  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.001398  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:50.996129  8272 raft_consensus.cc:2376] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14. Re-sending same reply.
I20260709 13:04:50.995687 12892 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.002766  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.002691 12892 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:50.913033 12883 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.004722 12892 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.005213 12883 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:50.976825 12775 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:51.033634 12775 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.034037 12775 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.978400 12882 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:51.013111  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.013443  8272 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 16. Ops: []
I20260709 13:04:51.034780  8195 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:04:51.035821  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.036741  8272 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:51.014003 12790 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.038060  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.038740 12849 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.018754 12750 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.010211 12858 raft_consensus.cc:2804] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:51.041810 12858 raft_consensus.cc:697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:51.042686 12858 consensus_queue.cc:237] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.043721  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.044274  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.044975  8122 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.045149  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.043408 12750 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.045784  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.046506  8124 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:51.047667  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:51.047915  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:50.931865 12875 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:50.876257 12834 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.000037 12851 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:51.000340 12855 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.001914 12626 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:51.028434  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.094295  8806 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:51.030804  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.030050 12892 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:51.101558 12648 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.103417 12892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50776 (request call id 87) took 1646 ms. Trace:
I20260709 13:04:51.032990 12876 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:51.011407 12806 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:51.044468  8116 raft_consensus.cc:2368] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:51.046425  8119 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:51.048292  8802 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:51.055792  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.038772  8273 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.021274 12805 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.085491 12772 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:51.087682 12700 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.088713  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.129536  8117 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:04:51.142282  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.142980  8124 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 8.
I20260709 13:04:51.146759  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.105975 12855 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.156172  8198 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:51.158983  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.162613  8273 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:51.152930  8163 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.595s (SENT)
I20260709 13:04:51.153905  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:51.202926  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.161684 12775 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.177748  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:51.177309  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.027s	sys 0.068s
I20260709 13:04:51.250727  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.103870 12892 rpcz_store.cc:276] 0709 13:04:49.515658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.520251 (+  4593us) service_pool.cc:224] Handling call
0709 13:04:49.546499 (+ 26248us) log.cc:844] Serialized 494 byte log entry
0709 13:04:49.916920 (+370421us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18002ac6a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:04:50.247879 (+330959us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b54004725a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24ca1142 00007fbd24c81eaa 00007fbd24c88d53 00007fbd24c88cd9 00007fbd24c88c69 00007fbd24c88c31 00007fbd24c87dfd 000000000038f354 000000000038f199 00007fbd21c3b475
0709 13:04:50.798692 (+550813us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5400472618. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24ce47bc 00007fbd24ce72c0 00007fbd24ce7248 00007fbd24ce71c8 00007fbd24ce7183 00007fbd24ce644c 00007fbd2ab93626 00007fbd2ab8ddd8 00007fbd248cfb41 00007fbd248c2f2a
0709 13:04:51.103336 (+304644us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4423,"raft.queue_time_us":2833,"raft.run_cpu_time_us":7066,"raft.run_wall_time_us":737917,"spinlock_wait_cycles":27441408,"thread_start_us":72912,"threads_started":1,"wal-append.queue_time_us":88817}
I20260709 13:04:51.158429 12700 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.176690  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.202344 12745 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:51.145926 12840 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:04:51.193440  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.265974  8273 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.146349 12772 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:51.256881  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 264936us
I20260709 13:04:51.255898  8802 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
W20260709 13:04:51.258427  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.034s	sys 0.074s
W20260709 13:04:51.264133  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 111234us
W20260709 13:04:51.268852  8163 leader_election.cc:336] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.643s (SENT)
W20260709 13:04:51.258725 12688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.010s
I20260709 13:04:51.269361  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:51.267249  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.279685  8119 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:51.286999  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:51.288908  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.291155  8122 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:04:51.291139  8125 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.289252  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.294957  8273 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:51.281296 12688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.010s
I20260709 13:04:51.240705 12869 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:51.302387  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.303870  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:51.307490  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.309737  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.310300  8268 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.310909  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.311597  8122 raft_consensus.cc:2393] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:51.313980  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:51.315050  8166 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.315953  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.317044  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:04:51.317551 12806 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:51.318078 12806 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.318656 12882 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.319192 12514 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:51.320197 12648 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.321604  8271 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.286857 12754 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.322476 12805 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.285171 12906 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.267341 12745 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:51.326371  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.326916  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.322250 12754 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:51.333714  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.329291  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.328136 12745 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.343606 12700 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.345685  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.346714  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.347199  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.347816  8118 raft_consensus.cc:2376] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12. Re-sending same reply.
I20260709 13:04:51.346758  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.347092  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.363515  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:51.364825  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.365646  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.371039  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.372840  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.373518  8124 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:51.374609  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.261639 12851 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.377830  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:51.373904  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 105110us
I20260709 13:04:51.373659  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:51.321938 12772 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.375820  8116 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:51.382583  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.376029  8268 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:51.377987  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.383152  8119 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.384220  8124 raft_consensus.cc:2376] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12. Re-sending same reply.
I20260709 13:04:51.390858  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:51.391642  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.374317 12846 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:51.394475  8122 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.376418 12892 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:51.386643 12849 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.404276 12849 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.406234 12849 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.407629 12754 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:51.318958 12806 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.394634  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.410945  8116 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:51.397838  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.401378  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.379218 12805 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.403718 12892 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:51.413992  8268 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.414960  8124 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.417838  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:51.422607 12899 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:04:51.425437 12805 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.426362  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.427441 12805 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.428865  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:51.415491 12648 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:51.429864 12648 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:51.430435 12902 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:51.393558 12834 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.431782 12648 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.436189  8802 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:51.437083  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:51.427399  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.438863  8120 raft_consensus.cc:2410] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:04:51.440999  8125 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:51.401723 12846 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.449452  8116 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:04:51.451103  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:51.451630  8193 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.450244  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.463887  8117 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:51.466913  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.468933  8122 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:04:51.469946  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.471192  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.471793  8268 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.477110  8124 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:51.479188  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:51.479434  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.489004  8802 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:51.485996  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.486901  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.453619 12846 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.482461 12906 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:51.491823  8119 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:04:51.490722  8122 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:51.492991  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.496358  8274 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:51.500346  8194 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.502228  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.502794  8274 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:51.503713  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.504225  8273 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.505970  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.489279 12882 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.509573  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.510133  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:04:51.510262  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 133370us
I20260709 13:04:51.472666 12830 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:04:51.511749  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.510344  8272 raft_consensus.cc:2410] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:04:51.510888  8268 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:51.512712  8122 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:51.514647  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.515946  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.518436  8273 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:51.521145  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.557225  8274 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:51.558419  8122 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.560024  8274 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:51.560860  8273 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:51.585443  8274 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:51.586666  8273 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:04:51.586939  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.505331 12892 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.591070  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.595090 12838 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.599134  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.599956  8125 raft_consensus.cc:2410] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:04:51.601019  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.602113  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.603731  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.602205  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.604220  8117 raft_consensus.cc:2368] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:51.606063  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:51.592392 12873 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 1.055s	user 0.015s	sys 0.000s
W20260709 13:04:51.607546  8163 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.932s (SENT)
I20260709 13:04:51.607923  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:51.609028 12806 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.613860  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.556053 12855 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:51.603191 12862 consensus_meta.cc:287] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.001s
I20260709 13:04:51.617449 12862 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.618083 12855 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.619195  8200 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:51.620229  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:51.619542  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e848f577948c470fb4c95fcc2b55b7ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:51.624763 12862 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.627115  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.627898  8117 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:51.628402  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.629093  8119 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:04:51.629462  8119 pending_rounds.cc:85] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 11
I20260709 13:04:51.603008 12502 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.630637  8119 pending_rounds.cc:107] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:04:51.630714  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.631122  8119 raft_consensus.cc:2889] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.633975  8120 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.633332 12502 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.638044 12775 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:51.639119 12502 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.639374  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 863) took 1485 ms. Trace:
I20260709 13:04:51.639781  8267 rpcz_store.cc:276] 0709 13:04:50.154113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.154270 (+   157us) service_pool.cc:224] Handling call
0709 13:04:50.173701 (+ 19431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.515042 (+341341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.639139 (+1124097us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400074c54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:51.639312 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724274560}
I20260709 13:04:51.641575  8267 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:04:51.641899  8267 pending_rounds.cc:85] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 9
I20260709 13:04:51.642165  8267 pending_rounds.cc:107] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:04:51.643946  8271 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:51.649178  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:51.650733  8198 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:51.652778  8125 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.653736  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.655517  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.656512  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.657015  8121 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:51.657815  8119 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:51.658735  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.659310  8119 raft_consensus.cc:2368] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12.
I20260709 13:04:51.659945  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.660429  8119 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.661311  8116 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11.
I20260709 13:04:51.662261  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.663338  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.664167  8116 raft_consensus.cc:2410] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:04:51.664808  8121 raft_consensus.cc:1240] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.662475  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:51.665726  8163 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.950s (SENT)
I20260709 13:04:51.667622  8125 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:51.607719 12882 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.670105  8116 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:51.670836  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.671077  8267 raft_consensus.cc:2889] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.703233  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.679471  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:51.703845  8125 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:51.704233  8118 raft_consensus.cc:2376] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11. Re-sending same reply.
I20260709 13:04:51.683954  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2126) took 1434 ms. Trace:
I20260709 13:04:51.684156  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2130) took 1220 ms. Trace:
W20260709 13:04:51.684955  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 242363us
I20260709 13:04:51.703905  8120 raft_consensus.cc:2376] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13. Re-sending same reply.
I20260709 13:04:51.690985  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50494 (request call id 2133) took 1200 ms. Trace:
I20260709 13:04:51.656775  8193 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:51.696053  8199 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:51.707942  8119 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:04:51.706305  8195 rpcz_store.cc:276] 0709 13:04:50.490712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.647124 (+156412us) service_pool.cc:224] Handling call
0709 13:04:51.690825 (+1043701us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540014c3d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:51.690929 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842264832}
I20260709 13:04:51.705145  8197 rpcz_store.cc:276] 0709 13:04:50.463899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.464070 (+   171us) service_pool.cc:224] Handling call
0709 13:04:51.683928 (+1219858us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b540014c8d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:51.684029 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181556992}
I20260709 13:04:51.705029  8192 rpcz_store.cc:276] 0709 13:04:50.249627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.328679 (+ 79052us) service_pool.cc:224] Handling call
0709 13:04:50.403307 (+ 74628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.650249 (+246942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.683647 (+1033398us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400366d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:51.683888 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549501312}
I20260709 13:04:51.702242  8194 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:51.685297 12868 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:51.723990  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.726621  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.726812  8272 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:04:51.727284  8117 raft_consensus.cc:2368] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12.
I20260709 13:04:51.728075  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.720321  8238 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:51.731711  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.731666  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.732893  8271 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:51.733199  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.733757  8118 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.734849  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:51.740345  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.741394  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.743728  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:51.744304  8272 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.745278  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.721767 12868 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:51.748769  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:51.750541  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:51.751030  8166 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:51.731097 12876 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.755946 12868 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.756816 12700 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:51.772866 12876 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.773264 12700 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.773905 12834 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:51.774201 12700 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.738799 12862 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:51.774883 12876 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.775211 12862 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:51.775522 12840 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:51.775614 12862 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.747701 12830 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:51.778699 12830 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.767521  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.779052 12830 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.779832  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.768117 12648 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:04:51.768693  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.751219 12838 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:51.719820 12858 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:04:51.753443 12906 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:51.769971  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.782737 12805 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:51.783339 12805 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:51.783996 12838 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.754752 12913 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:04:51.784850 12838 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.785641 12913 consensus_queue.cc:1243] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:04:51.786232 12913 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:51.729365 12846 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.786546 12913 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.737016 12750 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.743139 12875 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:51.776072 12868 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.820597 12750 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.821686 12906 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:51.822082 12906 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.823006 12750 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.822816 12906 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.823930 12906 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.827582  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:51.790017  8272 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:51.787163  8124 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:51.772289 12872 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:04:51.811470  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.829515  8118 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:51.787323 12913 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.830606 12913 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:51.858703  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 109941us
I20260709 13:04:51.797224 12830 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.864137  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.866909 12750 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:51.867408 12750 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.869256 12750 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:51.870644 12830 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.876644 12261 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.877089 12261 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.881942  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.882441 12869 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:51.882612  8268 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:04:51.883569  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.884567  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.885061  8268 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:04:51.886130  8268 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:51.887023 12897 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.884990  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:51.892298  8267 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:51.888827  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.894920  8774 leader_election.cc:400] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12.
I20260709 13:04:51.895248  8774 leader_election.cc:403] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:51.890333  8272 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:04:51.897099  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.923810  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 59748.6us
I20260709 13:04:51.927873  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:51.934386  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 44965.3us
I20260709 13:04:51.910784 12846 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.914245 12830 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.857920 12862 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.933950 12776 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.948511  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.947755  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:51.948102  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.887481 12927 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:04:51.949162 12700 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:51.951740  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.897192 12897 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.955765 12830 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:51.983645 12830 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:51.972795 12700 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:51.987474 12896 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.767s	user 0.004s	sys 0.000s
I20260709 13:04:51.955876 12759 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.988883  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2337) took 1301 ms. Trace:
I20260709 13:04:51.989234  8123 rpcz_store.cc:276] 0709 13:04:50.687289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.687420 (+   131us) service_pool.cc:224] Handling call
0709 13:04:50.729997 (+ 42577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.751956 (+ 21959us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:50.766005 (+ 14049us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.874426 (+108421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.884610 (+ 10184us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.884764 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:50.884797 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.884862 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.986936 (+1102074us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:51.988602 (+  1666us) raft_consensus.cc:1685] finished
0709 13:04:51.988691 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.988815 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19663,"prepare.queue_time_us":12388,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":25069,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":14235,"spinlock_wait_cycles":29426048,"thread_start_us":68227,"threads_started":1,"wal-append.queue_time_us":348214}
I20260709 13:04:51.988016 12759 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.969199 12771 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.974363 12261 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.991899 12771 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.993099 12261 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:51.975893  8194 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:51.993878 12771 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:51.981168  8197 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:51.969422 12870 consensus_queue.cc:1059] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:04:51.983989  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.994988 12870 raft_consensus.cc:3055] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:51.995333 12870 raft_consensus.cc:740] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:51.995363  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:51.996383 12870 consensus_queue.cc:260] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:51.996851  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:51.997273 12745 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:51.998111  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50433.3us
W20260709 13:04:51.998643  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46990.5us
I20260709 13:04:51.957005  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:51.997502 12533 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:51.999336  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:51.953612 12855 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.954671 12840 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.002544  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:52.011144  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54215us
I20260709 13:04:52.016687  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:52.012727  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:52.003921 12533 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:52.022994 12533 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.002928 12502 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:52.027832 12745 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:52.004395 12684 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:52.002024 12932 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:52.006157 12838 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.010315 12870 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.029647 12777 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:04:52.015470 12771 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:52.036221 12771 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:52.018884 12872 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:52.037070 12771 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.033159  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:52.067692  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 51071us
I20260709 13:04:52.068094  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.068413  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:52.007418 12929 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:04:52.032289 12684 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:52.034231 12855 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:52.078771  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.069005 12806 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:52.085997  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.087488 12838 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:52.079461 12855 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.087896 12838 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:52.087996 12786 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:52.088930 12838 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.091149  8804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 795) took 1528 ms. Trace:
I20260709 13:04:52.091497  8804 rpcz_store.cc:276] 0709 13:04:50.562444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.562556 (+   112us) service_pool.cc:224] Handling call
0709 13:04:50.583082 (+ 20526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.840335 (+257253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.090906 (+1250571us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540049f554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:52.091066 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589422976}
I20260709 13:04:52.093438 12759 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:52.102521 12772 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:52.102787 12502 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:52.103407 12745 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:52.104051 12626 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.103992 12772 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:52.104574 12772 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:52.104506 12915 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:52.104974 12684 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.105532 12772 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.106225 12684 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.106594 12772 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.111424 12776 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12.
I20260709 13:04:52.112416  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:52.101454 12870 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:52.112877 12838 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.117484 12897 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:52.117595 12870 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.119477 12786 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:52.119899  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:52.119174 12838 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:52.120538  8191 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:52.121273 12856 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:52.121394  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:52.121863 12856 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.123593 12793 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:52.124688 12793 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:52.124998 12793 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:52.125556  8199 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:52.126150  8198 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:52.125593  8195 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:52.127628  8191 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:52.128800 12870 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:52.123839 12856 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:52.132457  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.133291  8804 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:52.134568  8197 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:52.135962  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:52.136503  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49902.6us
I20260709 13:04:52.137065  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.139566  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.097508 12855 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.142223  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:04:52.142602  8194 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:52.141296  8163 leader_election.cc:400] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:52.143468  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:52.145506  8163 leader_election.cc:403] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:52.147272  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:52.148846  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:52.138440  8806 raft_consensus.cc:2955] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:52.147420  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:52.149459  8195 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.153434  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:52.154789  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:52.156589  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:52.157903  8191 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:52.158756  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.143895 12806 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:52.159734  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.144405 12684 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:52.148088 12748 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:52.153076 12847 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:52.150027 12762 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:52.151623 12786 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:52.171034  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:52.175172  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:52.143908 12745 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:04:52.159148 12838 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12.
I20260709 13:04:52.182624  8196 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:52.183635  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.157091 12741 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:04:52.166085 12748 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.163221 12533 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:52.189530  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 176887us
I20260709 13:04:52.177043 12786 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:52.165767 12847 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.157332 12846 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:04:52.200824  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:52.178807 12834 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:52.204064  8274 raft_consensus.cc:1240] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:52.204777  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50062.7us
I20260709 13:04:52.206403  8809 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:52.206647  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.208110  8272 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:52.211416  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.204181 12847 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.205803 12806 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:04:52.221297  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:52.198408 12748 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.225199  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:52.225322  8200 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:04:52.225881  8200 pending_rounds.cc:85] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:04:52.226084  8200 pending_rounds.cc:107] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:04:52.226312  8200 raft_consensus.cc:2889] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:52.228399  8265 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:52.230218  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:52.230767  8809 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:52.198169 12932 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:52.209196 12869 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:52.229523  8237 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:52.205988 12830 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:52.200352 12786 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.238445  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:52.240475  8197 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:52.177178 12793 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.242019  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:52.243026  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:52.243515  8265 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:52.245517 12883 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:52.249841 12790 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:52.250571 12790 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:52.251233 12790 consensus_queue.cc:1243] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:52.234081 12762 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:52.252228 12762 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:52.253078 12762 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.253692 12745 raft_consensus.cc:2764] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:04:52.254359 12745 raft_consensus.cc:3055] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:52.254667 12745 raft_consensus.cc:740] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:52.255357 12745 consensus_queue.cc:260] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.232018 12750 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:52.256611 12750 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.257531 12869 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:52.258515 12869 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.258972 12750 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:52.261049  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:52.215196 12927 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:52.224810 12872 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:52.261092  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.274786  8195 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
W20260709 13:04:52.275349  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45896.3us
I20260709 13:04:52.223102 12533 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:52.281949  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:52.282174  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:52.282305  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.284288  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.284607  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:52.284647  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:52.278831  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.285334  8118 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:52.284965  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:52.239893 12830 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:52.298316  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 64015.3us
I20260709 13:04:52.326892  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:52.297464  8265 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:52.328070  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:52.328634  8265 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:52.332320  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:52.333777  8125 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:52.274518 12856 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:52.294379  8166 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:52.340359  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 61615.8us
I20260709 13:04:52.342233  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:52.342355  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:52.342785  8117 raft_consensus.cc:2376] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 11. Re-sending same reply.
I20260709 13:04:52.343240  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:52.343616  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:52.344410  8121 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:04:52.345001  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50725.1us
I20260709 13:04:52.345803  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.342456  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:52.347333  8809 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:52.277064 12938 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:52.282681 12929 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:52.349539  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:52.351884  8271 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:52.353369  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:52.353484  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 71400.6us
I20260709 13:04:52.358129  8270 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:52.292989 12775 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:52.327950 12762 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.341503 12830 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.345220 12737 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.347508 12684 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.371668  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:52.371776  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:52.357903 12700 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.375686  8805 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.348167 12840 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.380741  8120 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:52.280169 12927 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.403895  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:52.362457 12897 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.404695  8120 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:52.371980 12868 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:52.366655 12882 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:52.426548  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:52.382386 12913 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.520s	user 0.001s	sys 0.008s
I20260709 13:04:52.434100  8805 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:52.375414 12851 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:52.442039  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.421917 12946 ts_tablet_manager.cc:933] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:04:52.406730 12626 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:04:52.480053  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:52.427875 12871 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.427999 12754 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.427695 12929 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:52.436228 12882 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:52.375952 12737 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.365630 12938 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.385388 12533 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.572564 12748 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.440600 12868 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:52.438341 12949 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:52.437417 12865 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:52.605520 12870 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:52.610020  8200 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:52.404155 12872 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.617470  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:52.626344  8271 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:52.610020 12948 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:04:52.561671 12871 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.489513 12851 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:52.631240 12940 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:04:52.404002 12932 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.560864 12754 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.631156 12870 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.739759 12775 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:52.740381 12775 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.741813 12956 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.742281 12956 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.744091 12883 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:52.751858  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:52.627835 12865 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.760784  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:52.793783  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.794524  8191 raft_consensus.cc:2393] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:52.822216  8271 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
W20260709 13:04:52.832557  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.832746 12871 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:52.833284 12871 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:52.833742 12871 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:52.834683 12871 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:52.839993 12942 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.840525 12942 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:52.841296 12953 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:04:52.842620 12942 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:52.843313  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.849745  8271 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:52.883172  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.927671  8088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.005s	sys 0.017s
I20260709 13:04:52.632827 12949 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:52.928078  8088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.005s	sys 0.017s
W20260709 13:04:52.932135  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.002s
W20260709 13:04:52.931929  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 604612us
W20260709 13:04:52.932469  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.002s
W20260709 13:04:52.932736  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 607460us
W20260709 13:04:52.934208  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.010s	sys 0.000s
W20260709 13:04:52.934492  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.000s
W20260709 13:04:52.934995  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 728448us
I20260709 13:04:52.936833  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:52.938133  8088 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:52.848440 12700 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:52.937486  8200 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 8.
I20260709 13:04:52.753509 12882 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:52.931921 12913 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.961597  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:52.933425 12927 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:52.836707 12868 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.029723  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:53.030506  8118 raft_consensus.cc:2393] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:53.031291  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:53.031769  8118 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.033970 12927 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:53.026513  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.026940  8271 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:53.027864  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:53.113453  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 87205.2us
I20260709 13:04:52.749293 12929 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:53.028266  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.021s
I20260709 13:04:52.959118 12883 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:53.028940 12913 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.114480  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:52.940572 12869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.009s	sys 0.005s
W20260709 13:04:53.116672  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.021s
I20260709 13:04:53.114449 12737 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.034447 12927 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.118736  8118 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:53.119578  8123 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:04:52.960680 12858 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:04:53.125058  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 364343us
I20260709 13:04:52.959810 12790 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:04:52.958981 12942 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 13:04:53.133405 12748 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:53.142874 12869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.011s	sys 0.005s
W20260709 13:04:53.144155 12786 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.000s
I20260709 13:04:53.165023 12786 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.148221 12952 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.166002 12952 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.167078 12786 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.167667 12786 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.168012 12786 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.168339 12786 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.168519 12952 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.145470 12957 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:53.169735  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.124759 12883 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.172855 12883 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.159582 12737 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:53.144541 12261 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:53.142392  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 800031us
I20260709 13:04:52.960721 12777 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:53.113957 12932 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:53.152683  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:53.158272  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.190665  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.191681  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:53.124653 12946 tablet_copy_client.cc:323] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:04:53.127148  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:53.185519  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 151028us
I20260709 13:04:53.184502  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:53.180372 12951 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.506s	user 0.001s	sys 0.000s
I20260709 13:04:53.154084 12963 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.133592 12941 consensus_queue.cc:1059] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:04:53.140331  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 178789us
W20260709 13:04:53.189673 12958 log.cc:927] Time spent T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:04:53.221429  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 283380us
W20260709 13:04:53.224902  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.229547  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.230338  8274 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 7.
I20260709 13:04:53.161514 12858 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.197939 12777 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.197904 12906 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:53.236439  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.198096 12805 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:53.233323  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:53.235357  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.208341 12851 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.208455 12965 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:53.219995 12955 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
I20260709 13:04:53.208539 12963 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.244407  8199 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:53.214700 12868 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:53.251642  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.211866 12737 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:04:53.257368  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:53.208217 12957 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:04:53.231945 12865 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.219314 12806 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:53.207477 12932 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.262451  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:53.248451 12906 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:53.250607 12868 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.311403  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.245699 12965 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:53.321759  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 365180us
W20260709 13:04:53.307253  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49984.7us
I20260709 13:04:53.259876 12938 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:53.322191  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 207805us
I20260709 13:04:53.319628 12972 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:53.357889  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:53.358503  8802 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 8.
I20260709 13:04:53.358999 12972 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.361501  8271 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:53.364385  8271 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:04:53.260812 12882 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:53.370289  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1961) took 1167 ms. Trace:
I20260709 13:04:53.370428  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:53.250092 12963 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.302619 12700 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.314069 12684 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:53.374399  8774 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:53.246747 12805 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:53.380533  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 158469us
I20260709 13:04:53.381887  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:53.353014  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 90648.4us
I20260709 13:04:53.370914  8267 rpcz_store.cc:276] 0709 13:04:52.202453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.203151 (+   698us) service_pool.cc:224] Handling call
0709 13:04:52.211637 (+  8486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:52.261513 (+ 49876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.261541 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:52.261961 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:04:52.776657 (+514696us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:53.143261 (+366604us) log.cc:844] Serialized 14 byte log entry
0709 13:04:53.143488 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.143568 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.370051 (+226483us) raft_consensus.cc:1685] finished
0709 13:04:53.370071 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.370226 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49504,"prepare.queue_time_us":442784,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3478,"raft.queue_time_us":54407,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7166,"thread_start_us":665635,"threads_started":2,"wal-append.queue_time_us":653038}
I20260709 13:04:53.315034 12868 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.387137  8089 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:53.367486 12949 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.364923 12851 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:53.370014 12942 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:53.393752  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 890) took 1161 ms. Trace:
I20260709 13:04:53.391845  8271 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.394506  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:53.395653  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 156112us
I20260709 13:04:53.385679 12938 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.398458 12938 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.399318 12737 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:53.399660  8802 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:53.399964 12957 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:53.400460 12957 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.401254 12938 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.402326 12957 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.395144 12858 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.396729  8272 rpcz_store.cc:276] 0709 13:04:52.232789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.277242 (+ 44453us) service_pool.cc:224] Handling call
0709 13:04:52.287179 (+  9937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:52.353967 (+ 66788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.353995 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:52.354394 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:04:52.423577 (+ 69183us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:52.423626 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.423688 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.393466 (+969778us) raft_consensus.cc:1685] finished
0709 13:04:53.393486 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.393682 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83381,"raft.queue_time_us":86598,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":10128,"thread_start_us":38708,"threads_started":1,"wal-append.queue_time_us":261485}
W20260709 13:04:53.410796  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 196732us
I20260709 13:04:53.416822  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.417474  8272 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:53.389673 12882 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:04:53.391067 12684 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:53.422180  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.423329  8272 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:53.424292  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.386502 12700 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.429016  8272 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:53.429243  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 74316.8us
I20260709 13:04:53.439116  8271 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:53.410823 12980 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:53.411278 12869 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:53.440461  8267 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:53.411227 12979 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.425285 12975 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:04:53.430626 12927 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.442582  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:53.461282  8803 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:04:53.443152  8134 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 446d688479d34112bfc4ab0afb09d6f5 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:04:53.445637 12777 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.447280 12972 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:53.448813 12840 consensus_meta.cc:287] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.027s	user 0.008s	sys 0.000s
I20260709 13:04:53.449550 12913 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.442379  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:53.405334 12868 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.420217 12949 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:53.399447 12942 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.457818 12869 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:53.457588 12862 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:53.475373  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.471321  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 84279.9us
I20260709 13:04:53.468850  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:53.478144  8271 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.469250  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.465085 12978 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:04:53.469729 12970 log.cc:927] Time spent T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:04:53.450929 12786 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.407207 12965 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.447209 12963 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.489941 12786 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.490548 12963 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.475373 12869 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:53.462780 12979 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.492996 12979 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.493643 12997 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:53.494145 12997 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.483614  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:53.477149 12830 consensus_meta.cc:287] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.084s	user 0.009s	sys 0.000s
I20260709 13:04:53.485468  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:53.477725 12762 consensus_meta.cc:287] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.105s	user 0.005s	sys 0.005s
I20260709 13:04:53.467887 12983 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:04:53.480020 12855 consensus_meta.cc:287] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.324s	user 0.009s	sys 0.002s
W20260709 13:04:53.504487 12962 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:04:53.504884 12855 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.506825 12855 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.432578 12906 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.469251  8134 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 446d688479d34112bfc4ab0afb09d6f5 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-446d688479d34112bfc4ab0afb09d6f5
W20260709 13:04:53.509503 12966 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:04:53.510376  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:53.511245  8808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 860) took 1157 ms. Trace:
I20260709 13:04:53.511546  8808 rpcz_store.cc:276] 0709 13:04:52.353583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.353701 (+   118us) service_pool.cc:224] Handling call
0709 13:04:53.510217 (+1156516us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:53.511164 (+   947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4246912}
I20260709 13:04:53.512429  8274 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:53.512913  8808 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:53.504580 12942 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.515550 12997 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.516249  8274 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:53.473410 12840 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:53.490566  8806 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:04:53.482309 12847 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.268s	user 0.011s	sys 0.000s
I20260709 13:04:53.486534  8271 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:53.503026  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:53.503679  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:53.520982  8271 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:53.475203 12915 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:53.522301  8271 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:53.527212  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:53.528681  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 56261.5us
I20260709 13:04:53.459386 12980 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.499017 12929 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:53.537042  8803 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:53.527695 12965 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.540633  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:53.541193  8810 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:53.523185 12978 consensus_queue.cc:1175] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 13 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:53.542256  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.543195  8191 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:53.544288 12959 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:53.545001 12990 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:53.523867 12847 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.547253 12847 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.547919  8123 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 16: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:53.548902  8123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2354) took 1220 ms. Trace:
I20260709 13:04:53.526940 12741 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:04:53.502230 12830 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.550004  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:53.545511 12980 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.549201  8123 rpcz_store.cc:276] 0709 13:04:52.328714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.158333 (+829619us) service_pool.cc:224] Handling call
0709 13:04:53.548739 (+390406us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54000e33d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:53.548853 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868154624}
I20260709 13:04:53.498250 12684 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:53.553162  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:53.536284 12805 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.532325 12913 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:04:53.558398  8191 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:53.536077 12840 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:04:53.533484 12862 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:04:53.570988 12700 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.571046  8191 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:53.572696  8134 tablet_copy_source_session.cc:215] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:53.534241 12929 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.569443 12959 consensus_queue.cc:1243] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:53.545547 12990 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:53.584229  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:53.594336  8199 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:53.567103 12745 raft_consensus.cc:3060] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:53.595342 12990 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.583845 12932 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.585067 12772 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:53.586961  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2274) took 1300 ms. Trace:
I20260709 13:04:53.587572 12830 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.588994  8810 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:53.589493 12929 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.589722  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:53.590127 12700 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:53.602075 12700 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:53.602962 12700 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.604090 12700 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.590548  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.605219  8123 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:53.606184  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.606696 12869 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.599676  8118 rpcz_store.cc:276] 0709 13:04:52.286692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.224811 (+938119us) service_pool.cc:224] Handling call
0709 13:04:53.225145 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.395853 (+170708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.395887 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.398266 (+  2379us) log.cc:844] Serialized 26 byte log entry
0709 13:04:53.471690 (+ 73424us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:53.471739 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.471800 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.586760 (+114960us) raft_consensus.cc:1685] finished
0709 13:04:53.586781 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.586906 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37598,"raft.queue_time_us":181753,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8764,"thread_start_us":243142,"threads_started":2,"wal-append.queue_time_us":104661}
I20260709 13:04:53.608845 12869 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.608959  8269 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:53.610467  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.599406 12772 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.626837  8809 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:53.615003  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.628511  8125 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:53.615386  8267 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:04:53.629244  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 146132us
I20260709 13:04:53.606703  8123 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:53.632493  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.633152  8195 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:04:53.634126  8191 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:53.636547  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:53.626427 12947 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.223s	user 0.009s	sys 0.010s
I20260709 13:04:53.630800  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:53.608886  8266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1929) took 2613 ms (client timeout 2018 ms). Trace:
I20260709 13:04:53.638460  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:53.639056  8195 raft_consensus.cc:2410] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:04:53.640064  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:53.637990  8266 rpcz_store.cc:269] 0709 13:04:50.995561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.996196 (+   635us) service_pool.cc:224] Handling call
0709 13:04:53.608680 (+2612484us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003b92d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:53.608806 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2954701696}
I20260709 13:04:53.642534  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.643193  8195 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:53.641904 12961 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.520s	user 0.001s	sys 0.000s
I20260709 13:04:53.598946 12913 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:53.612313 12945 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.182s	user 0.012s	sys 0.029s
I20260709 13:04:53.645695  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 1964) took 1440 ms. Trace:
I20260709 13:04:53.646009  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:53.646974  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.650630  8191 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.649525  8268 rpcz_store.cc:276] 0709 13:04:52.205739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.206249 (+   510us) service_pool.cc:224] Handling call
0709 13:04:52.206757 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:52.207088 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.207113 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:52.210876 (+  3763us) log.cc:844] Serialized 499 byte log entry
0709 13:04:52.227178 (+ 16302us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:52.227212 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.227271 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.625689 (+1398418us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:53.645443 (+ 19754us) raft_consensus.cc:1685] finished
0709 13:04:53.645462 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.645641 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6900608,"thread_start_us":15940,"threads_started":1,"wal-append.queue_time_us":67810}
I20260709 13:04:53.652554  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:53.653062  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.618288 12754 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.654635 12856 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:04:53.659878  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.660604  8195 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:53.645812 12669 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:53.627401 12772 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:04:53.665913  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.668516  8199 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:53.666098  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:53.654277 12998 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:53.672848  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.666525 12669 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.678668 12669 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:53.638165 12790 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:04:53.682569 12772 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:53.673645 12929 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.684089  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:53.685792 12991 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:04:53.686568 12992 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:53.687001 12982 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.673497 12998 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.642550 12959 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:04:53.641755 12748 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:04:53.693286  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 219073us
I20260709 13:04:53.654801 12847 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:53.697759  8125 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:53.695806  8200 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:53.651245 12913 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.708076  8191 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:53.711376  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:53.711972  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:53.721450 12834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.014s	sys 0.020s
I20260709 13:04:53.724375 12862 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:53.745267  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:53.746374  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:53.748150  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.752285  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 882) took 2739 ms. Trace:
I20260709 13:04:53.753801  8269 rpcz_store.cc:276] 0709 13:04:51.004464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.004967 (+   503us) service_pool.cc:224] Handling call
0709 13:04:53.608794 (+2603827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.626114 (+ 17320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.743969 (+117855us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b54003b92d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:53.744111 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5988247936}
I20260709 13:04:53.702550 12790 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.754848 12790 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:53.681612 12949 consensus_queue.cc:1175] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "afd11cff97554063a80d743fdf2b934d" responder_term: 9 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 8. Current term is 9. Ops: [8.6-8.6]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:04:53.756628  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54068us
I20260709 13:04:53.757884  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:53.707831 12737 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.755237 12790 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.761483  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 652) took 1474 ms. Trace:
I20260709 13:04:53.750672 12975 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:53.751348 12869 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.764740  8125 rpcz_store.cc:276] 0709 13:04:52.287183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.751879 (+1464696us) service_pool.cc:224] Handling call
0709 13:04:53.752183 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.761139 (+  8956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.761171 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.761212 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:53.761250 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.761310 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.761429 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8593,"raft.queue_time_us":9452}
W20260709 13:04:53.766943  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.767158 12980 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:53.767370 13007 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.767683 12737 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.758793 12754 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:53.778211  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:53.779028  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:53.763499  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51210.7us
I20260709 13:04:53.755950 12959 consensus_queue.cc:1243] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:53.700713 12929 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:53.758303 12834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.014s	sys 0.020s
I20260709 13:04:53.772697  8125 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:04:53.764793 12261 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.785089  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 656) took 1497 ms. Trace:
I20260709 13:04:53.786655 13008 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:53.707347 12858 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:04:53.787380 12965 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:53.788363 12959 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:53.789121 12959 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.789933 12959 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.769158 12862 consensus_queue.cc:1243] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:53.793828 12862 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:53.794265 12862 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.794618  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:53.795182  8119 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.771710  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:53.797701  8089 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:53.799487 12997 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:53.799602 12913 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.800024 12997 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.760993 12748 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.800922 12997 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.801800 12941 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:53.801620 12748 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.750237 12982 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.760090 12533 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:53.800132 12969 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 13:04:53.802909  8274 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:53.785430  8125 rpcz_store.cc:276] 0709 13:04:52.288127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.772183 (+1484056us) service_pool.cc:224] Handling call
0709 13:04:53.772473 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.784858 (+ 12385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.785039 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:53.804309  8191 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:53.706744 12992 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.786849  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 657) took 1498 ms. Trace:
I20260709 13:04:53.773785 12851 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.811888  8117 rpcz_store.cc:276] 0709 13:04:52.288347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.774605 (+1486258us) service_pool.cc:224] Handling call
0709 13:04:53.786414 (+ 11809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.786573 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.786598 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.786634 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:53.786674 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.786720 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.786802 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:53.814603  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.808629  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:53.802137 12775 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.810406  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.770284 12975 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.772426 12932 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:53.818547  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.786979 12929 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.821120  8198 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:04:53.827641 12984 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.814256 12533 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.829638 12748 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.794739 12737 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.805903 12261 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.843329  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:53.844839  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.845515  8191 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:53.774595 12869 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.784763 12978 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:53.787057 13008 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.787005 12793 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.824923  8120 raft_consensus.cc:2393] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 11: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:53.824384  8125 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:53.847467 12261 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:53.850051  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45820.5us
I20260709 13:04:53.847697  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:53.858217 12975 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.860106  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.869424  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.865615  8119 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
W20260709 13:04:53.821847  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 76534.8us
I20260709 13:04:53.870747  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:53.788820 12973 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 13:04:53.848333 12892 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.874116  8267 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:53.869776  8198 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
W20260709 13:04:53.878809  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.857246 12862 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.880826  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2352) took 1585 ms. Trace:
I20260709 13:04:53.823076 12851 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.806200 13007 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.860103 12978 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:53.830296 12932 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.887081  8119 rpcz_store.cc:276] 0709 13:04:52.295245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.879551 (+1584306us) service_pool.cc:224] Handling call
0709 13:04:53.880199 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.880373 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.880395 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.880432 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:53.880466 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.880656 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.880761 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:53.862774 12533 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.889650  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2270) took 1285 ms. Trace:
I20260709 13:04:53.888839  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:53.822650 13025 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:04:53.878556 12748 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:04:53.828152 12984 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.908434  8117 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.913558 12669 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.915599 12669 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.917754  8119 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:53.917646  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:53.918826  8268 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:53.881122 12847 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.890209  8273 rpcz_store.cc:276] 0709 13:04:52.604378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.842739 (+238361us) service_pool.cc:224] Handling call
0709 13:04:52.843009 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:52.843308 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.843335 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:52.843737 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:04:53.028624 (+184887us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:53.028663 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.028721 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.799614 (+770893us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:53.886504 (+ 86890us) raft_consensus.cc:1685] finished
0709 13:04:53.886524 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.889584 (+  3060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4772,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":64774,"spinlock_wait_cycles":3378432,"thread_start_us":184524,"threads_started":1,"wal-append.queue_time_us":354729}
I20260709 13:04:53.921511  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2353) took 1623 ms. Trace:
I20260709 13:04:53.924867  8119 rpcz_store.cc:276] 0709 13:04:52.295505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.913317 (+1617812us) service_pool.cc:224] Handling call
0709 13:04:53.917532 (+  4215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.918377 (+   845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.918573 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:53.890142 12978 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:53.927534  8117 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:53.930845 12992 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.932785 12932 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.933950 12851 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.936615 12956 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.890148 12941 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:53.948318  8268 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:04:53.951239  8125 raft_consensus.cc:1275] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:53.885764 12892 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:53.949810  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 60962.4us
I20260709 13:04:53.958562  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:53.924178 12847 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.926345 12869 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:53.928002 12748 consensus_queue.cc:1243] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:53.932696 12790 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.937902 12984 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.941993 12762 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:04:53.950105 12973 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:53.973960 12982 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.960213 12990 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.984732 12990 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.978374  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.979236 12754 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:53.981468  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.981658  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:53.964152 12669 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:53.982431 12790 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.963124 12847 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.988176  8200 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.992303  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:53.992488 13025 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.993575 12502 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:53.993914 12892 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:53.994707 13007 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:53.984956 12941 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:53.926805 13008 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:53.976531 12973 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:54.012537  8270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 1933) took 2985 ms (client timeout 1813 ms). Trace:
W20260709 13:04:54.028851  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 143771us
I20260709 13:04:54.032758  8200 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:54.035053 12973 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:54.033867  8270 rpcz_store.cc:269] 0709 13:04:51.026608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.030529 (+  3921us) service_pool.cc:224] Handling call
0709 13:04:54.012366 (+2981837us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003ffa54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:54.012471 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733535488}
I20260709 13:04:53.990212 12906 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:54.013183 12502 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:54.012364 12669 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:54.050117 12261 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.015738 13025 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.055904  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:54.061681 12502 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.062546 13025 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.062861 12502 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.064414  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.060196 12906 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.067272 12669 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.071038  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.071695  8194 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:54.074177  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.074996  8194 raft_consensus.cc:2410] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:04:54.078446  8089 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.087533  8269 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:54.092278 12862 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.092859 12862 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.093240 12261 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:54.094998 12862 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.067329 12906 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.100426  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.090703  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:54.115592  8804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 859) took 1766 ms (client timeout 1789 ms). Trace:
W20260709 13:04:54.116014  8804 rpcz_store.cc:269] 0709 13:04:52.349627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.349745 (+   118us) service_pool.cc:224] Handling call
0709 13:04:54.100240 (+1750495us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03a22 00007fbd2ab1cc09 00007fbd29c76ee0 00007fbd29d400ab 00007fbd29d40131 00007fbd29cee0a0 00007fbd29ced984 00007fbd232686d4 00007fbd23268662
0709 13:04:54.115526 (+ 15286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7415040}
I20260709 13:04:54.077744 12882 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:54.090051 13025 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.120347 12990 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.122779  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2358) took 1694 ms. Trace:
I20260709 13:04:54.123165  8119 rpcz_store.cc:276] 0709 13:04:52.428407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.925767 (+1497360us) service_pool.cc:224] Handling call
0709 13:04:53.926841 (+  1074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.950331 (+ 23490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.950360 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.950873 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.069231 (+118358us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:54.069265 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.070653 (+  1388us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5400149954. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:54.070694 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:54.122482 (+ 51788us) raft_consensus.cc:1685] finished
0709 13:04:54.122501 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.122699 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20351,"raft.queue_time_us":20772,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":6375680,"thread_start_us":117999,"threads_started":1,"wal-append.queue_time_us":163062}
I20260709 13:04:54.125646 13030 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.119647 12790 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:54.127655 12790 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:54.128484 12790 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.129302 13008 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:54.136629 12978 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.139904 12973 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.144382  8194 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:54.149307  8117 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:54.150409  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2275) took 1116 ms. Trace:
I20260709 13:04:54.150710  8117 rpcz_store.cc:276] 0709 13:04:53.033592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.146576 (+1112984us) service_pool.cc:224] Handling call
0709 13:04:54.149154 (+  2578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.149720 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.149843 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.154897  8117 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.155373  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2276) took 1121 ms. Trace:
I20260709 13:04:54.155579  8117 rpcz_store.cc:276] 0709 13:04:53.033834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.153559 (+1119725us) service_pool.cc:224] Handling call
0709 13:04:54.154757 (+  1198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.155224 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.155338 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:54.163815 12974 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.811s	user 0.000s	sys 0.005s
I20260709 13:04:54.167389  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2359) took 1685 ms. Trace:
I20260709 13:04:54.167819  8122 rpcz_store.cc:276] 0709 13:04:52.482332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.995306 (+1512974us) service_pool.cc:224] Handling call
0709 13:04:53.995613 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:54.010372 (+ 14759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.010402 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:54.010930 (+   528us) log.cc:844] Serialized 52 byte log entry
0709 13:04:54.115322 (+104392us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:54.115369 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.115440 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:54.167122 (+ 51682us) raft_consensus.cc:1685] finished
0709 13:04:54.167146 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.167318 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14377,"raft.queue_time_us":16568,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":13015,"spinlock_wait_cycles":1307008,"thread_start_us":79421,"threads_started":1,"wal-append.queue_time_us":118840}
I20260709 13:04:54.170140  8122 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:54.169042  8124 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:54.171473  8117 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:54.145926 12998 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.172726  8122 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:54.173804  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:54.174387  8195 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:54.179994 12998 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:54.180866 12973 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.148244 12882 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.183960  8195 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:54.185004 12978 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.185725  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:54.186991  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:54.188714  8122 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:54.187899  8089 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.188081 12862 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:54.188495 12838 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.187808 13001 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.190369  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.189333  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2360) took 1578 ms. Trace:
I20260709 13:04:54.190510 13001 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.190120 12862 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.191205  8119 rpcz_store.cc:276] 0709 13:04:52.610513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.124877 (+1514364us) service_pool.cc:224] Handling call
0709 13:04:54.125160 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.125337 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:54.128035 (+  2698us) log.cc:844] Serialized 14 byte log entry
0709 13:04:54.188793 (+ 60758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:54.188924 (+   131us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:54.188997 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.189070 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.189276 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2191,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":961,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":60455,"threads_started":1}
W20260709 13:04:54.193038  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.194319 12862 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.195145 13001 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.195654 13001 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.196888 12978 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:54.197436 12978 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:54.199340  8195 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 10: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:54.190187 12838 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.196945 12870 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.150126 13008 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:04:54.203804  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.203974  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.199692 12834 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.238174 12834 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.239464  8198 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:54.240880  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.241273  8198 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:04:54.241979  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.245663  8019 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 12, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:54.198697 12978 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.204862  8191 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:54.248073  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.248904  8195 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.249040  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.249987  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.205093  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 659) took 1916 ms. Trace:
I20260709 13:04:54.250578  8125 rpcz_store.cc:276] 0709 13:04:52.288798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.878081 (+1589283us) service_pool.cc:224] Handling call
0709 13:04:53.878348 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.958081 (+ 79733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.204893 (+246812us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b540026b1d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:54.205042 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166917376}
I20260709 13:04:54.251608  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2277) took 1217 ms. Trace:
I20260709 13:04:54.251965  8117 rpcz_store.cc:276] 0709 13:04:53.034077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.156007 (+1121930us) service_pool.cc:224] Handling call
0709 13:04:54.158910 (+  2903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.171773 (+ 12863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.251388 (+ 79615us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54000852d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:54.251547 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28355840}
I20260709 13:04:54.204692 12862 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.207399  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.253058 12862 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.255071  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.207949  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:54.255849  8197 raft_consensus.cc:2410] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:54.255946  8802 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:54.256814  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45111us
I20260709 13:04:54.208277  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:54.257580  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:54.258040  8199 raft_consensus.cc:2393] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 8: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:54.208542  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.209206  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.209796  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.206954  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.208878 12975 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.185137 12882 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.211401  8116 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.210402  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.217151  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.279973  8196 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:54.224424  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:54.226447  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.281055  8192 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:04:54.242421  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.281837  8200 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:54.244243  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.282578  8811 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:54.245288  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.208946 12847 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.250077  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.205744  8193 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:54.316943  8193 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:54.255190 12862 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.207597  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.318827  8804 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:54.210307  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.251749  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.258497  8803 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:54.259212  8808 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:04:54.246927  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:54.294329  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58952.9us
I20260709 13:04:54.344719 12882 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:54.317880  8193 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.348603  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.349691  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.446486  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.394402  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:54.449503  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 56968.2us
I20260709 13:04:54.350409  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:54.350101  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.447060  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.450862  8270 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:54.396095  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:54.451377  8272 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.450289  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.451857  8118 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:04:54.408294  8120 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:04:54.445454  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.452886  8120 pending_rounds.cc:85] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 8
I20260709 13:04:54.453164  8120 pending_rounds.cc:107] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:04:54.453438  8120 raft_consensus.cc:2889] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.433317  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.438711  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.388687  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.442683  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:54.444335  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.457696  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:54.459110  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 234796us
I20260709 13:04:54.459358  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 861) took 1102 ms. Trace:
I20260709 13:04:54.453226  8121 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:54.446735  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.459203  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:54.393630  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.462745  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.463791  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:54.319849  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:54.395603  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.454414  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.458443  8266 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:54.588337  8273 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:54.588455  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.589026  8271 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.466148 12261 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.592855  8272 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:54.593653  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:54.593884  8802 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:54.597014  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:54.598198  8237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.789s (SENT) [suppressed 38 similar messages]
I20260709 13:04:54.599411  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.600207  8272 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
W20260709 13:04:54.603022  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 143156us
I20260709 13:04:54.604197  8088 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:54.605765  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.605077  8270 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:54.607852  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.263857 12838 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.583376  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.584667  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:54.584800  8122 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:54.610617  8123 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:54.611159  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:54.379709 13016 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.585168  8808 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:04:54.583793  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 121375us
I20260709 13:04:54.599568 12956 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.475574  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:54.629134  8809 raft_consensus.cc:1813] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Handling vote request from an unknown peer 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:54.629714  8809 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:04:54.467147 12906 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:54.475163  8197 raft_consensus.cc:2393] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 12: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:54.459724  8806 rpcz_store.cc:276] 0709 13:04:53.357132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.357262 (+   130us) service_pool.cc:224] Handling call
0709 13:04:53.357591 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.518303 (+160712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.459120 (+940817us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400107cd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:54.459305 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305346432}
I20260709 13:04:54.474579  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:54.438213 12882 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.469291  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:54.585071  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.634279  8265 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:54.591118  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.634799  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:54.443050 12876 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.609021 12834 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.589538 12983 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:54.612977  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.613157  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.620658  8198 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:54.624495 12838 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.586380  8267 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:04:54.610539  8118 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:54.676862  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.678339  8118 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:54.624089 12868 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.679244  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.630357 13016 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.679852  8118 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:54.683629  8804 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:54.685473  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.687759  8118 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:54.638484  8191 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:04:54.468323  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.621740 12870 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:04:54.640681 12906 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:04:54.642868 12882 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.644317  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.703027  8117 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:04:54.644484  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2361) took 1454 ms. Trace:
I20260709 13:04:54.703650  8116 rpcz_store.cc:276] 0709 13:04:53.190045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.167852 (+977807us) service_pool.cc:224] Handling call
0709 13:04:54.168134 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.279479 (+111345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.644240 (+364761us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5400392e54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:54.644433 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99146112}
I20260709 13:04:54.645236  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.645735 12876 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.646507  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:54.652395 13007 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.653975 12669 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:54.658210  8807 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:04:54.660547 12946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446d688479d34112bfc4ab0afb09d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.632975  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:54.621634  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:54.626464 13026 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:54.674306  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:54.699976  8195 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:54.633879 12261 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:04:54.701916  8118 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:54.640992 12750 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:04:54.634975 12956 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.686849 13016 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.709793  8194 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:54.709937  8195 pending_rounds.cc:85] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 6
W20260709 13:04:54.713090  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 261672us
I20260709 13:04:54.735152  8195 pending_rounds.cc:107] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:54.735177  8269 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:54.735478  8195 raft_consensus.cc:2889] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.680552 12838 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.724013  8122 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:54.729280  8118 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:04:54.710161  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 77286.7us
I20260709 13:04:54.736019  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:54.747489  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:54.749060  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:54.752741  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:54.756861  8118 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:54.754163  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.761363  8163 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.763339  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.722632 12990 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:54.709270 12669 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:54.723008 12870 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:54.872646  8199 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:54.755965 13016 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:54.766814 13026 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.769829 13001 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:54.711285 13007 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:54.885746 13016 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:54.791369 12834 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:54.887089  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2279) took 1111 ms. Trace:
I20260709 13:04:54.868494 12870 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.867952 12669 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.757723 12976 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:54.891376  8124 rpcz_store.cc:276] 0709 13:04:53.775253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.176017 (+400764us) service_pool.cc:224] Handling call
0709 13:04:54.189165 (+ 13148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.195404 (+  6239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.195434 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:54.195857 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.587614 (+391757us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:54.587650 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.587716 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:54.886896 (+299180us) raft_consensus.cc:1685] finished
0709 13:04:54.886916 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.887035 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5891,"raft.queue_time_us":6831,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":391476,"threads_started":1,"wal-append.queue_time_us":532970}
I20260709 13:04:54.869750 12990 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:54.877599 12868 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:54.896528  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 141099us
I20260709 13:04:54.901314  8194 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
W20260709 13:04:54.903028  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 276783us
I20260709 13:04:54.903470  8117 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:54.904099  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.886551 13026 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.893862 12834 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.895634 12870 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:54.902897 13038 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 13:04:54.904778 13001 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:54.908002 13042 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:04:54.915343  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 306029us
I20260709 13:04:54.907794 12834 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:54.913637  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 315467us
I20260709 13:04:54.915097  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:54.910990 12750 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:54.920066  8237 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:54.915839 13042 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.916606 13001 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.913931 12869 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:04:54.911252 12261 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:04:54.933472 13001 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.919855 12750 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.926065 13042 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:54.936666  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 301957us
W20260709 13:04:54.990424  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 227171us
I20260709 13:04:54.941625 12927 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:54.995522  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:54.994433  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:54.996592  8200 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:04:54.944870 12750 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.907012 12995 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:04:54.918821 13016 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:54.941120 12882 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:54.998587  8123 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:55.003152  8197 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:54.904175 12976 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.028203  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:54.999882 12927 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:55.030085  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.014731 12870 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.004604 12876 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.947453 13044 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.025578  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.042824  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.044395  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:54.996419 12838 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:54.920728 12990 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.049788  8193 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.054059  8091 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.062377  8193 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:55.075702  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.039597 12927 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:55.050036 12876 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.040025 12956 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.093400  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.090651  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.049364 12741 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:55.047143 13044 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:55.056632 12983 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:55.046363 12882 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:04:55.101011  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.101272  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.102320  8268 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:55.074834 13045 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.090029 12990 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:55.089756 12700 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:04:55.076713 12984 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.115717 12750 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.077273 12838 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:04:55.118006 12750 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:55.046204 13046 consensus_queue.cc:1048] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:04:55.095513 12876 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.102972 13044 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:55.121280  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.122531 13046 consensus_queue.cc:1243] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:55.124279 13001 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.130929 13001 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.127055 12876 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:55.122292 12870 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.134277 12976 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.103276 12983 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.135702 12983 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.142314 13021 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.143126 13021 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:55.143458 13021 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:55.143790 13021 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:55.154502 12669 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:55.100025  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.085206 13007 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.089505 12502 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:55.156670 12669 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.156769  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.105438 12786 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:55.157380  8200 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:55.157820 13044 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.054927 12973 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:55.112305  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 195999us
I20260709 13:04:55.160943  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:55.048979 13050 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:55.161831  8123 raft_consensus.cc:2410] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:55.162117  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.173733  8200 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:04:55.174906  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.092653 12868 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:55.115751 13048 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:55.178593  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:55.177172  8200 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:55.181104  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.181763  8200 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:55.183461  8166 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.157289 12669 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.160166 13026 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.175974 12786 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:55.188118 12882 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:55.193164  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 202042us
W20260709 13:04:55.199324  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 300342us
I20260709 13:04:55.180548 12745 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:04:55.192763 13051 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:55.201483  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.199846  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:55.177109 13050 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.221952  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:55.222705  8122 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.226297  8124 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:04:55.225324 12786 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.229828 12882 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:55.231081 12882 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.231514 12882 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.229167 13051 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:04:55.188288 12868 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.233318 12882 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.250046 13050 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.234900 13051 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:55.242146 12990 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:04:55.248035 13042 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.252662  8193 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:55.248766 12669 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:04:55.254136 13042 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.254375 12983 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.256763 12983 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.257578 13044 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.209522 12834 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.248311  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:55.259343 12669 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:55.259799 12669 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:55.260654 12669 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.261857  8122 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:55.195976 13001 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:04:55.264734  8804 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:55.210076 13063 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:55.266180 13063 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:55.265252  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.261037  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:55.271431  8805 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:55.275017  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:55.276501  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 356826us
I20260709 13:04:55.277149  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:04:55.282473  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 252476us
I20260709 13:04:55.283318  8775 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.289675  8088 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.291127  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:55.319541  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.321650  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:04:55.233058 12927 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.288611 13053 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:04:55.324323 12927 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.324858 13050 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:55.325984 13050 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:55.326421 13050 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:55.327201 13050 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.260006 12834 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:55.330169  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:55.319082 12941 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:04:55.319098 13062 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.334249  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.335119  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:55.335700  8807 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:55.343423  8088 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.344691 12741 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:55.345396 12741 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:55.271679  8810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19747a1b37df480faebc96d93689cda5"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:04:55.348793  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.349879  8810 raft_consensus.cc:606] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.350857  8810 raft_consensus.cc:614] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:55.321064 12983 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:55.336180 12793 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:55.347280  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 56232.5us
I20260709 13:04:55.363395  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.341694 13062 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:55.347651 12927 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.390362 12876 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.391055 13045 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:55.397931 13045 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:55.398288 13045 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:55.399058 13045 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.400265 13045 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.407261 12847 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.345961 12978 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:04:55.411690 12979 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:55.364902 12793 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.412127 12979 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:55.412331 12793 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:55.421765  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:55.422382  8271 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.361940 12762 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.429641  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:55.434669  8270 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:55.445940  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49291.6us
I20260709 13:04:55.373121 13062 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.433487 12876 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.466198  8807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:04:55.470366  8270 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:55.470574  8807 raft_consensus.cc:606] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:55.471041  8807 raft_consensus.cc:614] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:55.471913  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.478142  8271 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:55.396099 13016 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:04:55.476253  8091 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:55.484680  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.482326  8091 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:55.487777  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.452201 12762 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.454095 12927 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:04:55.494074 12976 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:55.494477 12976 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.494802 12976 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:55.495004 12762 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.486372 12790 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:55.497879 12790 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:55.498724 12790 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.501899  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2289) took 1087 ms. Trace:
I20260709 13:04:55.502282  8269 rpcz_store.cc:276] 0709 13:04:54.414498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.444073 (+ 29575us) service_pool.cc:224] Handling call
0709 13:04:55.501717 (+1057644us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400076a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:55.501820 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637047040}
I20260709 13:04:55.491201 13058 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.507545 12793 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.483959 12956 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:55.512956  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.519088  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.525261  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.528955 12745 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:55.523030 13025 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.530474 12745 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.530978 12793 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.466748 12871 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:04:55.480424 12750 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:04:55.533954  8200 raft_consensus.cc:1240] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:55.488340 12941 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:55.534607  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.481032 12876 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.539611  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.539825  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.522768 12762 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:55.483062 13021 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.532044 13058 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:55.532840 13060 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.551779  8269 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:04:55.489648 12979 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.543291 12941 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:55.548635 13058 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.543897 13045 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.533967 13059 consensus_queue.cc:1059] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:04:55.548048 12869 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:55.530558 13025 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:04:55.542919 12956 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:04:55.547529 12762 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.562044 13058 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.586115  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.588706 13046 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.591125  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.591755  8270 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:55.593235  8265 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:55.596606  8273 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:55.599294  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:55.599905  8272 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:55.613288  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 403724us
I20260709 13:04:55.569530 12979 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:55.569120 13059 consensus_queue.cc:1243] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:55.631430  8272 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:55.653513  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:55.656978  8777 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:55.664606  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.673866 13016 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:55.677791 13016 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.678164 13016 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:55.679076  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.683216  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.683748  8200 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:55.687111  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.694237  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.695551  8191 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:55.696187 13016 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.707420  8120 pending_rounds.cc:85] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 8
I20260709 13:04:55.707712  8120 pending_rounds.cc:107] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:04:55.707975  8120 raft_consensus.cc:2889] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:55.708405 13016 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.616219  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:55.709766  8265 raft_consensus.cc:2393] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:55.710443 12847 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.710927 12847 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.712939 12847 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.623097  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:55.714123  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:55.714680  8124 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:55.716006  8125 raft_consensus.cc:1240] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:55.716210 13063 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.625118  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.717625  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:55.718418  8117 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:55.720404  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.720975  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:55.721592  8124 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:55.698628 12261 raft_consensus.cc:3055] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:55.722112 12261 raft_consensus.cc:740] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:55.722942 12261 consensus_queue.cc:260] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.724053 12261 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.701020  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.726749 12869 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.727044 13059 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:55.727597 13059 consensus_queue.cc:1243] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:55.702337 12984 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:55.703301 12978 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:55.729024 12978 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.731030 12978 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:55.705438  8805 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:55.731803  8805 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:55.732477  8805 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:55.615113  8270 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:55.734917  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.726812  8238 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:55.736756 12748 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:55.734504  8019 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 11 to 13, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:55.737418  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:55.738827 12980 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:55.739372 12980 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:55.739492  8019 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.740252 12980 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.741269  8019 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 11 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.741606 12869 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:55.747550 12869 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:55.747958 12869 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:55.736768 12978 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:04:55.738253  8238 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:55.756217 13059 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:55.756664 13059 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.757016 13059 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:55.758095  8019 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:55.763971  8018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 247) took 29027 ms (client timeout 15000 ms). Trace:
I20260709 13:04:55.745090  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.746848  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:55.766845  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.768817  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.769258 12502 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:55.769686 12502 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.770030 12502 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:55.772243 13059 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.775055 13059 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:55.775925  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:55.776486  8194 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:55.773962  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.780318 12998 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:55.780748 12998 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.781152 12998 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:55.787287  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 87003.9us
I20260709 13:04:55.789448  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.789783  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.789410  8775 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:55.790544  8193 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:55.755631 12978 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:55.793447  8193 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:55.792205  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:55.793130  8200 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:55.795888  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:55.800904  8270 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:55.801692  8273 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:55.652807 12983 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:55.805699  8019 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 11, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.614234  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.809262  8194 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:55.811311  8200 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:55.811443  8193 raft_consensus.cc:1240] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:55.812821  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 198685us
I20260709 13:04:55.813517  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:55.814700  8193 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:55.812073  8238 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:55.815874  8193 pending_rounds.cc:85] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 5
I20260709 13:04:55.818567  8193 pending_rounds.cc:107] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:04:55.819401  8193 raft_consensus.cc:2889] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:55.829010  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:55.840755  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51477.8us
I20260709 13:04:55.798511 12978 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:55.810746 12847 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.826610 12990 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.787305 12669 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:04:55.809231 12865 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:04:55.865139 13048 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:55.846490 13060 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:55.830421 12983 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.655846 12941 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:55.826879 12995 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:04:55.816290 13026 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:04:55.875684 13021 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:55.847586 13052 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:55.826800 12973 consensus_queue.cc:1059] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:04:55.867055 12847 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:55.893429  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:55.852084 13053 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:55.884995 12876 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:55.893635  8019 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 10, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:56.019425  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.898962  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 85479.6us
I20260709 13:04:55.945304 13025 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:55.946693 13049 log.cc:927] Time spent T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:55.896202 13060 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:55.966310 12847 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.924726 12990 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:56.021639  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:56.044399  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:56.026377 12946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40700 (request call id 811) took 3773 ms. Trace:
I20260709 13:04:55.927510 12868 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:04:56.060240  8019 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 5 to 7, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 7 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.897174 12978 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.035419 12762 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.069948  8019 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:56.074434  8123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.065s
W20260709 13:04:56.075245  8123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.008s	sys 0.065s
I20260709 13:04:56.049304 12754 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.101545  8019 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.051786 13077 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:56.052389 12862 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:04:56.121013  8019 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 11, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 11 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:04:56.054632 12838 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:04:56.095806 13053 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:56.116154 13077 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.103233 13084 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:56.070029 12869 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:56.126520 13041 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.030s	user 0.004s	sys 0.002s
I20260709 13:04:56.118884 12978 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:56.133637  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.136466  8019 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 9, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.148733  8019 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 12, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 12 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:56.136691  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.021s	sys 0.057s
I20260709 13:04:56.100000 12502 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:56.150331  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.022s	sys 0.057s
W20260709 13:04:56.152699  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 608015us
I20260709 13:04:56.129503 12913 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:56.135233 13080 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:04:56.153373  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.105672 12754 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:56.161926 13079 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:04:56.163239 12754 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.164870 12502 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.167739 12745 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:56.160384 13078 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:04:56.160034  8019 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:04:56.160934 13076 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:04:56.171828 12998 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.172632  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2530) took 1251 ms. Trace:
I20260709 13:04:56.161512 12876 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:04:56.173234 13073 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 13:04:56.173516 12876 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:56.173949 12876 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:56.176532  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2534) took 1071 ms. Trace:
I20260709 13:04:56.171264  8019 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 8, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 8 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.173008  8195 rpcz_store.cc:276] 0709 13:04:54.921150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.921290 (+   140us) service_pool.cc:224] Handling call
0709 13:04:54.922933 (+  1643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.196693 (+273760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.196723 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.203346 (+  6623us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.539693 (+336347us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:55.539734 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.539799 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.172433 (+632634us) raft_consensus.cc:1685] finished
0709 13:04:56.172451 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.172579 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":187522,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":22710,"thread_start_us":609052,"threads_started":2,"wal-append.queue_time_us":689873}
I20260709 13:04:56.137902 13077 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:56.176890  8192 rpcz_store.cc:276] 0709 13:04:55.105081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.105256 (+   175us) service_pool.cc:224] Handling call
0709 13:04:55.113554 (+  8298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:55.113919 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.113945 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:55.114501 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:04:55.518180 (+403679us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:55.518232 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.522354 (+  4122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.172746 (+650392us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:56.176268 (+  3522us) raft_consensus.cc:1685] finished
0709 13:04:56.176289 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.176479 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17604,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":9074944,"thread_start_us":403310,"threads_started":1,"wal-append.queue_time_us":561960}
I20260709 13:04:56.179961 12990 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:56.161451 13075 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:04:56.153043 12983 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:56.173647 13085 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:04:56.135799 13053 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.197028  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2531) took 1275 ms. Trace:
I20260709 13:04:56.197433  8196 rpcz_store.cc:276] 0709 13:04:54.921842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.921971 (+   129us) service_pool.cc:224] Handling call
0709 13:04:54.922239 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.091744 (+169505us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:55.450559 (+358815us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.837520 (+386961us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.839713 (+  2193us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.839907 (+   194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:55.839940 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.840042 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.196839 (+356797us) raft_consensus.cc:1685] finished
0709 13:04:56.196858 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.196975 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13592,"prepare.queue_time_us":320297,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":171309,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":27708,"thread_start_us":867331,"threads_started":3,"wal-append.queue_time_us":672851}
I20260709 13:04:56.201479 12980 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:56.202252 12980 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:04:56.203540 12869 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.204413 12980 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:56.204993 12754 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:56.205505 12754 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.207360 12754 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.148607 13084 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.210330 12754 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:56.210979 13084 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:56.210880 12754 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.212813 12754 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:56.187434 12892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.008s	sys 0.035s
W20260709 13:04:55.765004  8018 rpcz_store.cc:269] 0709 13:04:26.736246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.736476 (+   230us) service_pool.cc:224] Handling call
0709 13:04:55.763756 (+29027280us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:49.638074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:49.901641 (+263567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:49.901698 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:04:49.901729 (+    31us) tablet.cc:662] Decoding operations
0709 13:04:49.902784 (+  1055us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:49.902887 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:49.902912 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:04:49.903817 (+   905us) tablet.cc:701] Row locks acquired
0709 13:04:49.903864 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:04:49.904055 (+   191us) write_op.cc:270] Start()
0709 13:04:49.904224 (+   169us) write_op.cc:276] Timestamp: P: 1783602289903978 usec, L: 0
0709 13:04:49.904261 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:04:49.904916 (+   655us) log.cc:844] Serialized 3986 byte log entry
0709 13:04:50.447829 (+542913us) op_driver.cc:464] REPLICATION: finished
0709 13:04:50.661518 (+213689us) write_op.cc:301] APPLY: starting
0709 13:04:50.687491 (+ 25973us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:50.787199 (+ 99708us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:50.787317 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:51.166543 (+379226us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:51.267211 (+100668us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:04:51.278325 (+ 11114us) write_op.cc:312] APPLY: finished
0709 13:04:51.393105 (+114780us) log.cc:844] Serialized 97 byte log entry
0709 13:04:51.592768 (+199663us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.592904 (+   136us) write_op.cc:454] Released schema lock
0709 13:04:51.592975 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:51.595473 (+  2498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.595502 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6447,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":200513,"apply.run_cpu_time_us":35596,"apply.run_wall_time_us":945094,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39767,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":20409,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":10,"prepare.queue_time_us":191384,"prepare.run_cpu_time_us":42314,"prepare.run_wall_time_us":487674,"raft.queue_time_us":271699,"raft.run_cpu_time_us":26027,"raft.run_wall_time_us":137104,"replication_time_us":543419,"thread_start_us":618736,"threads_started":5,"wal-append.queue_time_us":480074,"wal-append.run_cpu_time_us":28351,"wal-append.run_wall_time_us":2090390}]]}
I20260709 13:04:56.216610  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.178001  8019 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:56.186901  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 357872us
I20260709 13:04:56.218379  8019 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.220772  8272 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:56.221020  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.221400  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:56.221935  8268 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.225111  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.230590  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.234081  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.234717  8196 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:56.238879  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.240788  8019 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 9, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:56.195183 13062 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.001s
I20260709 13:04:56.244153  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.055928 12946 rpcz_store.cc:276] 0709 13:04:52.210390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.210492 (+   102us) service_pool.cc:224] Handling call
0709 13:04:52.493907 (+283415us) ts_tablet_manager.cc:934] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
0709 13:04:54.612783 (+2118876us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:55.323515 (+710732us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:55.323631 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:55.818295 (+494664us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:55.875916 (+ 57621us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:55.927966 (+ 52050us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:55.983624 (+ 55658us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9099,"tablet-copy.queue_time_us":114859,"thread_start_us":251735,"threads_started":2}
I20260709 13:04:56.240293 12980 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:04:56.249769 12980 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:04:56.250839 13089 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:04:56.251402 12980 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:56.229988 12754 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:56.256804  8196 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:56.240605 13052 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:04:56.259637 12976 consensus_meta.cc:287] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.000s
I20260709 13:04:56.134692 13060 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.189147 12990 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.257447  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.261155 13053 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.270192  8195 raft_consensus.cc:2368] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16.
I20260709 13:04:56.274261  8268 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
W20260709 13:04:56.262946 13093 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:04:56.262365 13058 consensus_meta.cc:287] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.006s
W20260709 13:04:56.263844 12750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.020s	sys 0.009s
I20260709 13:04:56.267637 13069 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:56.248162 13062 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.275095 12946 tablet_copy_client.cc:806] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:56.370038 12998 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.385476 13046 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.267777 12976 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.390829 13069 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:04:56.406391  8265 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:56.411142  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.018s	sys 0.080s
W20260709 13:04:56.412145  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.018s	sys 0.080s
W20260709 13:04:56.412983  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 585691us
W20260709 13:04:56.430586  8166 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.026s	sys 0.085s
W20260709 13:04:56.431042  8166 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.026s	sys 0.086s
W20260709 13:04:56.431316  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 588963us
I20260709 13:04:56.389741 13058 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.443184  8269 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:04:56.401155 13007 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:56.448120  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.458709  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.459851  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.465562  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.467058  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.467391  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.468050  8195 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:04:56.487115  8274 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:04:56.443315 12946 tablet_copy_client.cc:670] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
W20260709 13:04:56.504993  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.520144  8197 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:04:56.520705  8197 pending_rounds.cc:85] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 10
I20260709 13:04:56.521104  8197 pending_rounds.cc:107] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:04:56.521733  8197 raft_consensus.cc:2889] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.457598 13007 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:04:56.526197  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.004s	sys 0.007s
W20260709 13:04:56.526705  8090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.012s	sys 0.000s
W20260709 13:04:56.526998  8090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.012s	sys 0.000s
W20260709 13:04:56.525087  8088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.004s	sys 0.008s
W20260709 13:04:56.528187  8088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.008s
W20260709 13:04:56.525918  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.000s	sys 0.011s
W20260709 13:04:56.529487  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.000s	sys 0.012s
W20260709 13:04:56.526597  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.004s	sys 0.007s
I20260709 13:04:56.486387 12502 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.497579 13025 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.451769 12998 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:04:56.540515  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.544472  8200 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 9: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:56.522316 13096 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.290s	user 0.000s	sys 0.000s
I20260709 13:04:56.486624 12892 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:56.541581  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:04:56.523102 13087 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:04:56.463204 12978 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:04:56.549441  8810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:44830
W20260709 13:04:56.573113 13082 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.703s	user 0.000s	sys 0.003s
I20260709 13:04:56.578578  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 678) took 1303 ms. Trace:
I20260709 13:04:56.581671  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:56.583150 13101 log.cc:927] Time spent T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:04:56.578943  8118 rpcz_store.cc:276] 0709 13:04:55.275297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.275402 (+   105us) service_pool.cc:224] Handling call
0709 13:04:55.275686 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.294888 (+ 19202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.294921 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.295404 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.523033 (+227629us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:55.523069 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.523131 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.399062 (+875931us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:56.578314 (+179252us) raft_consensus.cc:1685] finished
0709 13:04:56.578334 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.578520 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18814,"raft.queue_time_us":19965,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12137,"spinlock_wait_cycles":9015680,"thread_start_us":227349,"threads_started":1,"wal-append.queue_time_us":506250}
I20260709 13:04:56.586031 13062 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:56.587767 12976 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:56.572995  8810 raft_consensus.cc:606] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:56.595811  8810 raft_consensus.cc:614] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:56.594501  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:56.599104  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.603106  8199 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:56.604776  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 837) took 1135 ms. Trace:
I20260709 13:04:56.605669  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.605911  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.606742  8807 raft_consensus.cc:2410] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:04:56.605137  8806 rpcz_store.cc:276] 0709 13:04:55.468973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.469101 (+   128us) service_pool.cc:224] Handling call
0709 13:04:55.720227 (+251126us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b580014dc98. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c03eee 0000000000375939 00007fbd29c771e0 00007fbd29d400c4 00007fbd29d40131 00007fbd29d01fc0 00007fbd29cec929 00007fbd29cec3d2 00007fbd23263bd4
0709 13:04:55.720387 (+   160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.808048 (+ 87661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.808078 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.819645 (+ 11567us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.275769 (+456124us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:56.275809 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.275873 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.604518 (+328645us) raft_consensus.cc:1685] finished
0709 13:04:56.604538 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.604723 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88576,"raft.queue_time_us":106385,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":19992,"spinlock_wait_cycles":2220672,"thread_start_us":398635,"threads_started":1,"wal-append.queue_time_us":754520}
W20260709 13:04:56.608470  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.610855  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.611759  8810 raft_consensus.cc:2410] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:04:56.612334  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.538681 12876 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.617108  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.617790  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:56.617913  8804 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:56.620368  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.012s	sys 0.015s
W20260709 13:04:56.620671  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.015s
I20260709 13:04:56.596771 12745 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:56.619475  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 387954us
I20260709 13:04:56.544999 12502 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.549608 13025 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:56.608031 13103 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:04:56.625273  8088 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:56.626549  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.013s	sys 0.013s
W20260709 13:04:56.631808  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.013s	sys 0.013s
W20260709 13:04:56.632616  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 791128us
I20260709 13:04:56.634277  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:56.634809  8274 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:56.635380  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.635939  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.637142  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2285) took 2224 ms. Trace:
I20260709 13:04:56.635946  8270 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:04:56.638108  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.637629  8119 rpcz_store.cc:276] 0709 13:04:54.409415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.409682 (+   267us) service_pool.cc:224] Handling call
0709 13:04:54.433285 (+ 23603us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:54.604989 (+171704us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:54.622367 (+ 17378us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.503768 (+881401us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b180042d720. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c823a 00007fbd24d32a2a
0709 13:04:56.221596 (+717828us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:56.222176 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:04:56.222330 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:56.232452 (+ 10122us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.232685 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.246256 (+ 13571us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.632897 (+386641us) raft_consensus.cc:1685] finished
0709 13:04:56.632919 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.633035 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187373,"prepare.queue_time_us":18806,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":7679,"raft.queue_time_us":228551,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":17409,"spinlock_wait_cycles":2287872,"thread_start_us":701247,"threads_started":2,"wal-append.queue_time_us":1509571}
I20260709 13:04:56.657821  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:56.643633  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:56.631963 12978 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:56.526387 13069 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.629303  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.674539  8809 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:04:56.620949  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 806195us
I20260709 13:04:56.623461 12745 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.677124  8237 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.639209 12983 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:56.693176  8271 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:56.693358  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.607851 13007 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.671664 12906 raft_consensus.cc:2764] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:04:56.626405 13084 consensus_queue.cc:1059] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:04:56.671077 13117 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:56.703910  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 159525us
I20260709 13:04:56.678591 12978 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.713024 12978 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:56.705433 12979 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.070s	user 0.008s	sys 0.003s
I20260709 13:04:56.714130  8810 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
W20260709 13:04:56.715453 13077 consensus_meta.cc:287] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.000s
I20260709 13:04:56.715814 13077 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.639258 13107 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:04:56.717538 12754 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:56.717904 13107 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:56.718261 13107 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:56.718992 13107 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.720068 13107 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:56.636917 12892 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.724288 12892 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.720208 12978 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:04:56.726475 12978 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:56.721030  8091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.728751  8119 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:56.730691  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:56.731228  8118 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:56.732177  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:56.732738  8116 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:04:56.732965  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:56.712023 13124 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:04:56.712297  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.735394  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.735957  8200 raft_consensus.cc:2368] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:04:56.736312 12502 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.736644  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.736856 12502 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.721009 12983 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.680886 12862 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:56.737370  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:56.737720  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:56.737931  8121 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:56.738272  8118 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:56.737726 12862 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.740952 12862 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.722375 13025 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.731297  8123 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:56.722078  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.743216  8197 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:56.744165 12876 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.744781 12876 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:56.745469 12876 consensus_queue.cc:1243] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:56.746145 13077 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.746852 13121 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.747351 13121 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.749548 12983 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.750169 12851 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:56.750527 12851 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:56.751412 13117 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.749848 13084 consensus_queue.cc:1243] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:56.752403  8119 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:56.751294 12851 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.753404 13117 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.732992 12990 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.755380 12745 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.733055 13058 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:56.707993  8809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:04:56.756515  8809 raft_consensus.cc:606] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.756841  8809 raft_consensus.cc:614] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:56.759120  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.707500  8273 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:04:56.760373  8273 pending_rounds.cc:85] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 11
I20260709 13:04:56.760618  8273 pending_rounds.cc:107] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:04:56.760831  8273 raft_consensus.cc:2889] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.762217  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:56.762785  8807 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.763898  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:56.769402  8274 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:04:56.772078  8268 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:56.773442  8270 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:56.790162  8270 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:56.778712  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:56.781931  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.791427  8196 raft_consensus.cc:2393] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:56.791986  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:56.792145  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.788582  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:56.782361  8197 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:56.793185  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:56.794454  8196 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:56.794305  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:56.794713  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:56.795222  8804 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:56.796119  8125 raft_consensus.cc:2410] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:04:56.794397  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.751544 12983 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:56.771991 12847 consensus_meta.cc:287] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.003s
I20260709 13:04:56.718195 12754 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:56.791258 13103 log.cc:927] Time spent T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
I20260709 13:04:56.813215  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:56.817852  8124 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:56.818416  8122 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:56.812463  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:56.820576  8805 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:56.833186  8196 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:56.838466  8270 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.839368  8270 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.820989  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.821847  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.841452  8200 raft_consensus.cc:2393] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 15: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:56.843596 12976 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.844065 12976 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.846135 12976 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.846889  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:56.847440  8271 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.849363  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.849943  8266 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:04:56.850690  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:56.851351  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53207.3us
I20260709 13:04:56.851605  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.852694  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.823902  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:56.828521  8116 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:56.790886 13120 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
W20260709 13:04:56.829272  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 197237us
I20260709 13:04:56.867045 13108 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:56.867542 13108 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.867908 12941 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.868350 12941 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.870185 12941 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:56.871134  8272 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:56.871985  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.872977  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.873929 13108 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:56.873800  8272 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:56.875078  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.875383  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.875833  8272 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:56.876389  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:56.832229  8121 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:56.771881 12745 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.772197 13121 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:56.856027  8238 leader_election.cc:400] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:04:56.884481  8238 leader_election.cc:403] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:56.863143  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:56.864012  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:56.864261 12892 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:56.888131  8804 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:04:56.877252  8273 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:56.878539  8805 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:04:56.880396  8807 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:04:56.737357 12502 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.881518  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:56.881760  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61610.4us
I20260709 13:04:56.890621  8272 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:04:56.882673  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 70294.4us
I20260709 13:04:56.883644  8166 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:56.882177  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2195) took 2161 ms. Trace:
I20260709 13:04:56.889222  8805 pending_rounds.cc:85] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 10
I20260709 13:04:56.894929  8805 pending_rounds.cc:107] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:04:56.895202  8805 raft_consensus.cc:2889] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.895851  8805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 834) took 1557 ms. Trace:
I20260709 13:04:56.889585  8271 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:04:56.860941  8270 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:56.898808  8270 pending_rounds.cc:85] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 10
I20260709 13:04:56.899185  8270 pending_rounds.cc:107] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:56.899431  8270 raft_consensus.cc:2889] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:56.901284  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 88156.3us
I20260709 13:04:56.901592  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:56.892400  8198 rpcz_store.cc:276] 0709 13:04:54.693945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.695514 (+  1569us) service_pool.cc:224] Handling call
0709 13:04:55.425865 (+730351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.426185 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.426211 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.446949 (+ 20738us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.802829 (+355880us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:55.802869 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.802926 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.257992 (+455066us) raft_consensus.cc:1685] finished
0709 13:04:56.258011 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.822348 (+564337us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002071d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:56.855290 (+ 32942us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7231,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5580,"spinlock_wait_cycles":1679055616,"thread_start_us":316330,"threads_started":1,"wal-append.queue_time_us":645063}
I20260709 13:04:56.904621  8775 leader_election.cc:400] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16.
I20260709 13:04:56.904946  8775 leader_election.cc:403] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:04:56.896143  8805 rpcz_store.cc:276] 0709 13:04:55.338174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.339639 (+  1465us) service_pool.cc:224] Handling call
0709 13:04:55.339915 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.705324 (+365409us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400711c20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9fdc0 00007fbd24d2a1c0 00007fbd24d2b231 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c
0709 13:04:55.818966 (+113642us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b58004148d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d1efe7 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4
0709 13:04:56.820102 (+1001136us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b5400711c20. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9da1d 00007fbd24c841a4 00007fbd24d06447 00007fbd24d1efe7 00007fbd24d207de 00007fbd24d2ab49 00007fbd24d2b416 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419
0709 13:04:56.895624 (+ 75522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.895801 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337777152}
I20260709 13:04:56.881007 13122 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:56.900651 12978 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:56.913048  8272 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:04:56.919094  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:56.915000  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:04:56.900806 12870 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:04:56.914322  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 231187us
I20260709 13:04:56.919312 13021 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16.
W20260709 13:04:56.914772  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 213770us
I20260709 13:04:56.892134 13121 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:04:56.925491  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:56.854688 12847 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:56.923682  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.893024 13111 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:56.884224 13084 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:04:56.976387  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.903847 12838 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:56.882488 12984 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:04:56.971998  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:56.993824  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:56.993997  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:56.994453  8124 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:56.994763  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:56.903971 12979 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:56.890256 12990 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:04:56.908529 12793 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:56.911242 12913 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:56.998904  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.996922  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:57.000008  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 108187us
I20260709 13:04:56.890064 12745 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:56.996785  8805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:04:57.022531  8805 raft_consensus.cc:606] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.022889  8805 raft_consensus.cc:614] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.023219  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:56.969560 13117 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:57.011612  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.018085  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 99789.5us
I20260709 13:04:57.018944  8091 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:56.911185 13053 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:04:57.007783  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 682) took 1301 ms. Trace:
I20260709 13:04:56.971237 12978 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:57.046294  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.046720  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.046976  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.047668  8272 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:56.996356 13122 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:57.053557  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 129988us
I20260709 13:04:56.969110 13059 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:04:56.911056 12862 consensus_queue.cc:1059] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:04:57.055708  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.056046  8273 raft_consensus.cc:2376] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17. Re-sending same reply.
I20260709 13:04:57.057088  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.066769  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:57.051170  8120 rpcz_store.cc:276] 0709 13:04:55.706498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.706955 (+   457us) service_pool.cc:224] Handling call
0709 13:04:55.707240 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:55.708736 (+  1496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.708765 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:55.709267 (+   502us) log.cc:844] Serialized 52 byte log entry
0709 13:04:56.139766 (+430499us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:56.155116 (+ 15350us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.155473 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.169945 (+ 14472us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180044ff80. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:04:56.170104 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.170185 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.007576 (+837391us) raft_consensus.cc:1685] finished
0709 13:04:57.007600 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.007730 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6906,"prepare.queue_time_us":27932,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":31000,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8097,"spinlock_wait_cycles":24530688,"thread_start_us":415019,"threads_started":1,"wal-append.queue_time_us":777980}
I20260709 13:04:57.067838  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:57.055584  8270 raft_consensus.cc:2393] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:57.005689 12793 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:57.068559 13088 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:57.017184 13133 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.005158 13128 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:57.016469 12750 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:57.152856 13069 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.131335  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.156332  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:57.132164  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 76533us
W20260709 13:04:57.111552 13076 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:57.158535  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.157830  8124 raft_consensus.cc:2393] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 17: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:57.133981  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 122690us
I20260709 13:04:57.112397  8116 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:57.117658  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:57.162098  8120 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.117020  8266 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:57.055475 12838 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.006489 12979 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:57.150480 13123 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:04:57.150815 13133 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.152400 12851 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:57.163040  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 109876us
I20260709 13:04:57.159637  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:57.132210 12793 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.178819  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.206769  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.207360  8124 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:57.208174  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:57.208658  8124 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.116341 13114 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:57.055760 13117 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.169973 13111 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:04:57.233930  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 74383.7us
I20260709 13:04:57.234576  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:57.234637  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:57.236855  8122 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:57.234874  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.236208  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.073776 13122 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.244635  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.245332  8120 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:57.222445 12990 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:57.263449  8124 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:04:57.214156 12913 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:57.207037 13110 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:57.238235 12750 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:57.239318 13109 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:57.299266  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.287717  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.238906 12838 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:57.270907 13132 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:04:57.322414  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:57.256048 13139 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:57.290867 13126 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.271217 12502 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:57.271636 13058 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:57.237931 13084 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:04:57.312899  8124 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:04:57.340378  8124 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:04:57.312516 13109 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:57.317720 12983 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:57.341704 13109 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.345809 13137 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:57.346589 13148 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:57.347050 13148 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:57.272823  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.347532 13148 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.348075 12838 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:57.246856 13107 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:57.332698  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.217953 12978 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:04:57.264623 12990 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:04:57.338964 13151 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:04:57.294919 12949 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:57.350375  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 105813us
I20260709 13:04:57.354075  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:57.320017 13046 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:57.364565  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.346506 13137 consensus_queue.cc:1243] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:57.372094 13137 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:57.372622 13137 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.375377 13137 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.376770 13137 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:57.334977 12847 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:04:57.365439  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 92748.5us
I20260709 13:04:57.378245  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.377256 13137 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.341264 13128 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:57.395998  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 132919us
I20260709 13:04:57.353519 13107 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.360110 12990 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.357905 12745 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.402042  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.393253 13046 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.334676 13165 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:04:57.361977 13157 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:04:57.415096  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 347350us
W20260709 13:04:57.400712 13130 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:04:57.398736 13107 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.416778  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2216) took 1685 ms. Trace:
I20260709 13:04:57.417117  8194 rpcz_store.cc:276] 0709 13:04:55.731542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.814708 (+ 83166us) service_pool.cc:224] Handling call
0709 13:04:55.815688 (+   980us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.817249 (+  1561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.817279 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.817715 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.592754 (+775039us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b18003165a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:04:56.791588 (+198834us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:56.791623 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.791680 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.416506 (+624826us) raft_consensus.cc:1685] finished
0709 13:04:57.416524 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.416723 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4592,"raft.queue_time_us":156,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":12051,"spinlock_wait_cycles":22814592,"thread_start_us":198679,"threads_started":1,"wal-append.queue_time_us":1253472}
W20260709 13:04:57.417944  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53715.1us
I20260709 13:04:57.404937 12941 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.420343  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.427644  8091 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.430642  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.414804 13136 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:57.422739 13165 consensus_queue.cc:1243] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:57.440282  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.442159  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.435747 12983 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:57.490942  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.491668 13045 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:57.492172 13045 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:04:57.491644  8274 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:57.446120  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.493654  8200 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:57.493973  8200 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:57.398123 13128 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.530622  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:04:57.447860 13127 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:04:57.451462 12868 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:57.340619 13111 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.457705 12946 tablet_copy_client.cc:538] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:57.396430 12913 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.461800 12941 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:57.433073 12979 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:57.559151  8265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:04:57.559725  8265 raft_consensus.cc:606] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:57.464946 13133 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.432938 12261 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:57.489243  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49030us
I20260709 13:04:57.566329  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.491605  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:57.567225  8268 raft_consensus.cc:2393] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:57.567917  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2220) took 1120 ms. Trace:
I20260709 13:04:57.568293  8191 rpcz_store.cc:276] 0709 13:04:56.447237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.448464 (+  1227us) service_pool.cc:224] Handling call
0709 13:04:56.464454 (+ 15990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.464764 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.464791 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.465247 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.910490 (+445243us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:56.910528 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.910588 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.567732 (+657144us) raft_consensus.cc:1685] finished
0709 13:04:57.567751 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.567864 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74947,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":30672,"thread_start_us":368955,"threads_started":1,"wal-append.queue_time_us":757270}
I20260709 13:04:57.567845 12983 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:57.570802 12983 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.571151 12983 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.573807 13161 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:04:57.521728  8266 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:57.500635  8200 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.492980 13045 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.580219  8200 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:57.555716 13172 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:04:57.435111 13169 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:57.437759 12745 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.599409 12745 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.601411 12745 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.587512 12261 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.603515 12261 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:57.604604 13159 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.605095 13159 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.606153  8806 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:04:57.604485 12983 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.607373 13159 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:57.607880 13159 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:57.608331 13159 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.592657 13170 raft_consensus.cc:2764] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:04:57.612053 12741 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:04:57.613554 12793 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.614467 12983 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.615593 12793 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:57.563377 12941 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.618083 12941 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:57.598037 13137 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.561195  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:57.582753  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:57.560067  8265 raft_consensus.cc:614] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.497500 12906 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:57.419710 13157 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.592327 13122 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.592718 13121 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:57.643663  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:57.644176  8268 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.644457  8192 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:57.595562 13109 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.544821 13117 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.652673  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:57.598098 13128 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:57.598902 13169 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:04:57.641438  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:57.646040  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 84908.8us
I20260709 13:04:57.555564 13107 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.532254 13165 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.654094  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.655728  8271 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:57.640314 12745 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.653326  8268 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:57.652704  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:57.662588 12892 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.012s
I20260709 13:04:57.662940  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.663985  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.664155 13126 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:57.664850  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.656396  8775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.007s	sys 0.005s
I20260709 13:04:57.641270 12906 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:57.695763  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2303) took 1479 ms. Trace:
W20260709 13:04:57.694768  8775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.006s
I20260709 13:04:57.646317 12851 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:57.696336  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 679016us
I20260709 13:04:57.696144  8269 rpcz_store.cc:276] 0709 13:04:56.216537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.217536 (+   999us) service_pool.cc:224] Handling call
0709 13:04:56.217815 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.451998 (+234183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.695518 (+1243520us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400406ad4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:57.695704 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517413248}
I20260709 13:04:57.653611  8200 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:04:57.693181 12892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.016s
W20260709 13:04:57.751091  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 53854.4us
I20260709 13:04:57.653204 13171 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:57.765092  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:57.668448 13121 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:57.765949  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.875128  8199 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:04:57.769471  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.694197 13117 consensus_queue.cc:1059] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:04:57.658325 13136 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:04:57.770526  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:57.773638  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.777961 13159 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:57.764742 13062 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.772704  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.699615  8120 raft_consensus.cc:2393] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:04:57.782797  8163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.004s	sys 0.029s
W20260709 13:04:57.886109  8163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.005s	sys 0.029s
W20260709 13:04:57.886390  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 780818us
I20260709 13:04:57.793669  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:57.750054 12851 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.892477  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:57.893110  8117 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:57.893891 12851 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.709822 13046 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.678586 13165 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.895851 13046 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:57.897195 13165 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.699544 13126 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.899243 13126 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:57.809396  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.797156 13122 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.899886  8195 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:04:57.900081 13122 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.783937 13169 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.902011  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:57.903021  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.813386 13154 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:04:57.903512  8195 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:04:57.903956 13154 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:57.904294 13154 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:57.904393  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.905019 13154 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.906167 13154 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.814349 13157 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.816834 12946 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:04:57.819566  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2302) took 1026 ms. Trace:
I20260709 13:04:57.828613  8269 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:04:57.839669  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:57.786123 13155 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:57.831508 12980 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:57.825461 13052 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:57.831316 12754 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:57.835731 12876 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:57.869468  8200 pending_rounds.cc:85] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:04:57.924785  8200 pending_rounds.cc:107] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:04:57.925079  8200 raft_consensus.cc:2889] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:57.925833  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2239) took 1001 ms. Trace:
W20260709 13:04:57.912436 13141 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.767s	user 0.004s	sys 0.000s
I20260709 13:04:57.838209 13069 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:04:57.836212 13147 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:04:57.877447  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.870110 13109 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:57.879426 13143 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.541s	user 0.000s	sys 0.010s
I20260709 13:04:57.874575 13171 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.885048  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.910246  8117 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:57.850253 13107 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:57.909828  8125 rpcz_store.cc:276] 0709 13:04:56.814956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.816336 (+  1380us) service_pool.cc:224] Handling call
0709 13:04:56.816690 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.861462 (+ 44772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.861491 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.862593 (+  1102us) log.cc:844] Serialized 26 byte log entry
0709 13:04:57.301701 (+439108us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:57.334003 (+ 32302us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.336281 (+  2278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.336347 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.819341 (+482994us) raft_consensus.cc:1685] finished
0709 13:04:57.819361 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.819496 (+   135us) inbound_call.cc:177] Queueing success response
0709 13:04:57.819721 (+   225us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b18004342c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
Metrics: {"mutex_wait_us":51754,"prepare.queue_time_us":37799,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":48891,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":19461,"spinlock_wait_cycles":22574464,"thread_start_us":385098,"threads_started":1,"wal-append.queue_time_us":751727}
I20260709 13:04:57.914367 13155 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:57.917096  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:57.917789  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:57.918799  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:57.926128  8200 rpcz_store.cc:276] 0709 13:04:56.924685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.925168 (+   483us) service_pool.cc:224] Handling call
0709 13:04:56.992149 (+ 66981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.493573 (+501424us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400453ba0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c9fdc0 00007fbd24d2a1c0 00007fbd24d2b231 00007fbd24d27d8f 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c
0709 13:04:57.925568 (+431995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.925775 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491196288}
I20260709 13:04:57.873073  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:57.868847 12990 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.967958 12990 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:57.968570  8194 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:57.934329  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:04:57.934592  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:57.938058  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:57.927147 13180 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.885604  8119 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
W20260709 13:04:57.931696 13077 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:04:57.970563  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:57.939339  8199 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:57.971661  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:57.972447  8274 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:57.980827  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46582.3us
I20260709 13:04:57.914654 13062 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.981653  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:57.983951  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:57.982304  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 109316us
I20260709 13:04:57.987537  8119 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:57.951936 13171 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.931232 12876 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:57.929311 12980 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.986836 12990 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.932190 13052 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.931818 12754 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:57.988090 13137 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:58.007911  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2542) took 2242 ms. Trace:
I20260709 13:04:58.010753  8116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 691) took 1151 ms. Trace:
I20260709 13:04:58.013757  8116 rpcz_store.cc:276] 0709 13:04:56.859079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.859193 (+   114us) service_pool.cc:224] Handling call
0709 13:04:56.863521 (+  4328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.162814 (+299293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.010543 (+847729us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400299854. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:58.010698 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484650880}
I20260709 13:04:58.012946  8193 rpcz_store.cc:276] 0709 13:04:55.765839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.815403 (+ 49564us) service_pool.cc:224] Handling call
0709 13:04:55.815682 (+   279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:55.821526 (+  5844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.821554 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:55.822012 (+   458us) log.cc:844] Serialized 52 byte log entry
0709 13:04:56.582960 (+760948us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4800002dd8. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd29c51aa1 00007fbd29c48b37 00007fbd29c489ca 00007fbd29d4026f 00007fbd29d3ff37 00007fbd29d5455c 00007fbd29d54508 00007fbd29d54488 00007fbd29d54443 00007fbd29d536ec 00007fbd28c7da96
0709 13:04:56.759647 (+176687us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b18004b6dc0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:04:56.971654 (+212007us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.971690 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.971763 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.834116 (+862353us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:04:58.007664 (+173548us) raft_consensus.cc:1685] finished
0709 13:04:58.007688 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.007850 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":693,"raft.run_cpu_time_us":42395,"raft.run_wall_time_us":756014,"spinlock_wait_cycles":24203136,"thread_start_us":211818,"threads_started":1,"wal-append.queue_time_us":1516565}
W20260709 13:04:57.995013 12862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.014s	sys 0.005s
I20260709 13:04:57.988242 13160 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:57.998157 13175 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:04:58.022533 13137 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:58.008476 13122 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:58.008067 13179 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:58.031219 13052 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:58.040805  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:57.980804 13180 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.039644 13062 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:58.023010 12862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.015s	sys 0.006s
I20260709 13:04:58.043202  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:58.044651  8193 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:04:58.008191 13157 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:04:58.037786 13160 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:04:58.091028 13183 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:04:58.095790  8197 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:04:58.096276 12876 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:57.996893 13155 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.097153 13155 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:58.097358  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:58.098270 13186 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:04:58.098582 12980 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:58.105262 13195 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:58.109531 13137 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.147799 13052 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:58.148241  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:58.148620 13052 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.152026 13052 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:58.174566 13052 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:58.187649 13052 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.191872 13052 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:58.047124  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 63236.2us
I20260709 13:04:58.195639 13160 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.202165  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2557) took 1289 ms. Trace:
I20260709 13:04:58.228166  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:58.202605  8198 rpcz_store.cc:276] 0709 13:04:56.913183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.917088 (+  3905us) service_pool.cc:224] Handling call
0709 13:04:56.917374 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.917569 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:56.992947 (+ 75378us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.201727 (+1208780us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b180037fe40. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd248d04bc 00007fbd21c1e48b 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287
0709 13:04:58.201830 (+   103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:58.201879 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:58.201926 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.201991 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.202107 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2972,"prepare.queue_time_us":234047,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":207753,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":6447,"spinlock_wait_cycles":8388992,"thread_start_us":296161,"threads_started":2}
W20260709 13:04:58.221307 13148 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.873s	user 0.013s	sys 0.000s
W20260709 13:04:58.234306  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 538945us
I20260709 13:04:58.235214  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2393) took 1219 ms. Trace:
I20260709 13:04:58.238271  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:04:58.239764 13189 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:04:58.239953  8272 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:58.242555  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:58.243151  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 47551.9us
I20260709 13:04:58.245800  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:58.241205 13148 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.250907 13148 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:58.251384 13180 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:58.253557 12978 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.253813  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2387) took 1240 ms. Trace:
W20260709 13:04:58.253726  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.253245  8272 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:04:58.254101 12978 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.255870  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:58.259207 13188 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:04:58.260383 13106 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.258713  8124 rpcz_store.cc:276] 0709 13:04:57.013744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.341087 (+327343us) service_pool.cc:224] Handling call
0709 13:04:57.341398 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:57.351199 (+  9801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.351231 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:57.351752 (+   521us) log.cc:844] Serialized 52 byte log entry
0709 13:04:57.649723 (+297971us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:57.696912 (+ 47189us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.253520 (+556608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.253591 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.253629 (+    38us) raft_consensus.cc:1685] finished
0709 13:04:58.253641 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.253762 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586095,"prepare.queue_time_us":116950,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":569844,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2777,"spinlock_wait_cycles":1200384,"thread_start_us":253027,"threads_started":1,"wal-append.queue_time_us":474596}
I20260709 13:04:58.263134  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.263842  8124 raft_consensus.cc:2410] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:04:58.259011 12502 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:58.267210  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2402) took 1034 ms. Trace:
I20260709 13:04:58.267596  8120 rpcz_store.cc:276] 0709 13:04:57.232523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.263531 (+ 31008us) service_pool.cc:224] Handling call
0709 13:04:58.267024 (+1003493us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000affd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:58.267157 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887554944}
I20260709 13:04:58.267658  8238 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:58.235590  8121 rpcz_store.cc:276] 0709 13:04:57.016245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.400694 (+384449us) service_pool.cc:224] Handling call
0709 13:04:57.401015 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.410829 (+  9814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.410858 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:57.411288 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:04:57.648536 (+237248us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:57.657758 (+  9222us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.234065 (+576307us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b180043d200. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:04:58.234261 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.234338 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.234381 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:58.235022 (+   641us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.235158 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79990,"prepare.queue_time_us":49829,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1376,"raft.queue_time_us":9590,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4524,"spinlock_wait_cycles":65264000,"thread_start_us":214298,"threads_started":1,"wal-append.queue_time_us":428525}
I20260709 13:04:58.269078  8120 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:04:58.299976  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 44190.9us
I20260709 13:04:58.270326  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:58.305958  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60247us
I20260709 13:04:58.304309 13062 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:58.310559 13062 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:58.310913 13062 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:58.312842  8193 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:04:58.315001  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.316262  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.317584  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.260918 13106 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.322875 13106 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:58.324952  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.319448  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.320724 13152 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:58.334142 13152 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.313537 12838 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.329196  8120 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:04:58.330394 13164 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:58.339655 13164 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:58.340449 13164 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.341602 13164 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.332741 13062 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.336905 13152 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:58.338335 12754 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:58.329665  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:58.343163  8121 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:58.313799 12927 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:58.345116 13062 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:58.349516 12927 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.349911 12927 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:58.356607  8806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40718 (request call id 878) took 1739 ms (client timeout 1975 ms). Trace:
W20260709 13:04:58.357056  8806 rpcz_store.cc:269] 0709 13:04:56.616734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.617560 (+   826us) service_pool.cc:224] Handling call
0709 13:04:58.356447 (+1738887us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54004d7bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:58.356547 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239878400}
I20260709 13:04:58.363293  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2382) took 1370 ms. Trace:
I20260709 13:04:58.363698  8122 rpcz_store.cc:276] 0709 13:04:56.993155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.994557 (+  1402us) service_pool.cc:224] Handling call
0709 13:04:58.363101 (+1368544us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000dd754. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:58.363219 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555032960}
I20260709 13:04:58.364822  8117 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:04:58.365150  8117 pending_rounds.cc:85] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 6
I20260709 13:04:58.365358  8117 pending_rounds.cc:107] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:04:58.365573  8117 raft_consensus.cc:2889] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:58.367080  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2399) took 1184 ms. Trace:
I20260709 13:04:58.367358  8117 rpcz_store.cc:276] 0709 13:04:57.182812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.978626 (+795814us) service_pool.cc:224] Handling call
0709 13:04:58.364492 (+385866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.365941 (+  1449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.366916 (+   975us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000dd750. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:04:58.367030 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861699456}
W20260709 13:04:58.374702  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58954us
I20260709 13:04:58.375478  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:04:58.415525  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 430120us
W20260709 13:04:58.415716  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 114038us
I20260709 13:04:58.416419  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:58.418855  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.419286  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.421859  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 430210us
I20260709 13:04:58.421856 13077 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:58.422808 13077 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.425946  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.427506  8122 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:58.430722  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:04:58.431963  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.433300 13060 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.438604  8269 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:04:58.440284  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 64906us
I20260709 13:04:58.447880  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.449445  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.451148  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.452939  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.454672  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.458938  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.374145 13007 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.461858  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:58.461890  8274 raft_consensus.cc:2393] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 10: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:04:58.489593  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:58.497650  8192 raft_consensus.cc:1813] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Handling vote request from an unknown peer 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:58.475382  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.499614  8273 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:04:58.500777  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:04:58.501355  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.501879  8117 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:04:58.504058  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:58.504153  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.505051  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.505517  8806 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:58.507345  8192 raft_consensus.cc:2393] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:04:58.509155  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.509757  8802 raft_consensus.cc:1813] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Handling vote request from an unknown peer 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:04:58.510289  8802 raft_consensus.cc:2410] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:04:58.511989  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:04:58.512300  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:58.410710 13126 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:58.460687 12870 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:04:58.517243  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:58.516779 12870 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.517683  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:04:58.518375  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:58.448467 13154 consensus_meta.cc:287] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.007s
I20260709 13:04:58.520807  8269 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: [13.8-16.9]
I20260709 13:04:58.434576 13169 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:58.460016 13077 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:58.460266 13147 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.460608 13155 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:58.528702  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:58.460182 13159 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:58.460316 12862 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:58.528594  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.500761 13025 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:58.542011  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:58.549959  8811 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
W20260709 13:04:58.552023  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 239389us
I20260709 13:04:58.551961  8198 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:58.553637  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:58.523290 12976 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.556521  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:04:58.521128 12995 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:58.529489 13115 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:58.546880 13171 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.008s
I20260709 13:04:58.565367  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:04:58.534978 13109 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:58.496253 13060 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.575671  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.541314 13155 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:04:58.547343 12876 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:58.584482  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:58.586830  8197 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:58.591825  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.550911 13107 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:58.527619 13126 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.601861  8806 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:58.550434 13173 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:04:58.614576  8267 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:04:58.614040  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.550604 12862 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.599905 13155 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:58.580041 12978 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:58.566270 13059 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:04:58.565100 12754 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:04:58.553403 13159 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.572026 13050 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:04:58.635339  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:58.605507 13138 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.550374 13147 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.569569 13053 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:04:58.637917  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:04:58.606608 13084 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:58.582389 12976 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:04:58.561666 13025 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.573101 12995 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.577494 13171 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:58.627074 13106 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:58.658152  8806 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:58.594091 13109 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:58.689100  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.660657 12892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.009s	sys 0.020s
W20260709 13:04:58.707198  8195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.019s	sys 0.059s
I20260709 13:04:58.657094 12876 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:58.779949  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.632126 13107 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:58.782416  8195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.019s	sys 0.059s
I20260709 13:04:58.785032  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:04:58.646727 13150 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
W20260709 13:04:58.811220 13197 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:04:58.813987  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:04:58.814657  8806 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:04:58.802191 12892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.012s	sys 0.026s
I20260709 13:04:58.785434 12876 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:04:58.827077  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 270637us
I20260709 13:04:58.836941 12913 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:58.837442 12913 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:04:58.838299 12913 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:58.839288 12913 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:58.841915 12870 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:58.842602 12870 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.840507 12927 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:58.919260  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.923656  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 77134.4us
W20260709 13:04:58.957384  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 400152us
W20260709 13:04:59.016577  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 451293us
W20260709 13:04:59.032588  8272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.025s
W20260709 13:04:59.033133  8272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.005s	sys 0.025s
I20260709 13:04:58.843036 12870 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.032848 12871 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:59.160748  8089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.018s	sys 0.018s
W20260709 13:04:59.177649  8089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.018s	sys 0.018s
W20260709 13:04:59.178460  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 759925us
W20260709 13:04:59.174075  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 166768us
W20260709 13:04:59.163764  8124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.009s	sys 0.026s
W20260709 13:04:59.047199 13068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.016s	sys 0.041s
W20260709 13:04:59.159081  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:59.180621  8124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.010s	sys 0.026s
I20260709 13:04:59.179137  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:04:59.180171  8119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.032s
W20260709 13:04:59.186594  8119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.008s	sys 0.032s
I20260709 13:04:59.047850 13154 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.184229  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:04:59.135190 13160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.026s	sys 0.024s
I20260709 13:04:59.183683  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:04:59.184170  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:59.161429 13201 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.580s	user 0.000s	sys 0.001s
I20260709 13:04:59.156774 13115 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.158020 12871 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.207568 12906 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:59.233930 12906 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:59.234169 12956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.008s	sys 0.030s
W20260709 13:04:59.234596 12956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.008s	sys 0.030s
W20260709 13:04:59.235339 12984 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.016s	sys 0.027s
W20260709 13:04:59.235700 12984 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.016s	sys 0.027s
I20260709 13:04:59.183512 13062 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:59.194075 13169 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.159282 13077 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:59.198516 13160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.027s	sys 0.025s
W20260709 13:04:59.183903 13068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.020s	sys 0.042s
I20260709 13:04:59.181493 13128 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.175436 12980 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:59.158815 13159 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:59.158918 12838 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:59.180644 12869 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:59.184840 13126 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:04:59.210068  8194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.009s	sys 0.034s
I20260709 13:04:59.189121 12750 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:04:59.221963 13050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.017s	sys 0.019s
W20260709 13:04:59.258978  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.000s	sys 0.030s
W20260709 13:04:59.244728 13200 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.584s	user 0.001s	sys 0.000s
W20260709 13:04:59.262712  8194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.034s
W20260709 13:04:59.246678 12502 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.015s	sys 0.014s
I20260709 13:04:59.176383 12876 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:59.265086  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.238963 12754 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:04:59.243898 13205 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:59.272185  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.000s	sys 0.030s
I20260709 13:04:59.220181 12976 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:59.245795 13062 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:59.336745  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 702811us
I20260709 13:04:59.339762  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:04:59.273797  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:04:59.321487  8804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.018s	sys 0.014s
W20260709 13:04:59.341542  8804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.019s	sys 0.015s
I20260709 13:04:59.262732 12995 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:59.336508 13205 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.348308 13205 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:04:59.276027 13050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.020s
W20260709 13:04:59.310899 13204 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.602s	user 0.001s	sys 0.001s
I20260709 13:04:59.350643  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 905) took 1469 ms. Trace:
I20260709 13:04:59.350981  8200 rpcz_store.cc:276] 0709 13:04:57.881447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.981474 (+100027us) service_pool.cc:224] Handling call
0709 13:04:57.981756 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.982064 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.982092 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:57.986342 (+  4250us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.411453 (+425111us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:58.411496 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.411571 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.350441 (+938870us) raft_consensus.cc:1685] finished
0709 13:04:59.350463 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:59.350588 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3285,"raft.queue_time_us":236,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":5349,"thread_start_us":400834,"threads_started":1,"wal-append.queue_time_us":633437}
I20260709 13:04:59.319008 13108 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:59.352860 13108 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.353205 13108 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.313704 13059 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:59.367974  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.275296  8197 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 16. Current term is 17. Ops: []
W20260709 13:04:59.342671 13210 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
I20260709 13:04:59.343423 13062 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:59.344540  8272 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:59.336184 12754 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:04:59.315229 12502 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.015s	sys 0.014s
I20260709 13:04:59.369082  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:59.370637  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:04:59.372080  8274 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:59.317420 13171 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:59.252939 13077 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.211844 13154 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:59.320308 13109 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:59.261266 12980 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:59.258330 13128 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.264608 12838 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:04:59.325423 13173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.021s	sys 0.026s
W20260709 13:04:59.436422 13173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.021s	sys 0.027s
I20260709 13:04:59.264619 12869 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:59.273218 12750 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:04:59.451220  8273 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:59.329571 12871 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:59.404867 13062 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:59.431445  8270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 952) took 1603 ms. Trace:
I20260709 13:04:59.449097  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:59.336244 12876 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:59.459566  8270 rpcz_store.cc:276] 0709 13:04:57.828466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.829311 (+   845us) service_pool.cc:224] Handling call
0709 13:04:57.829627 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.910509 (+ 80882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.910536 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:57.910937 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.050740 (+139803us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:58.050782 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.333315 (+282533us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b5400189554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:04:58.333380 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.431159 (+1097779us) raft_consensus.cc:1685] finished
0709 13:04:59.431183 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:59.431388 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":13051,"spinlock_wait_cycles":185261824,"thread_start_us":100101,"threads_started":1,"wal-append.queue_time_us":628521}
I20260709 13:04:59.463707  8117 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:04:59.428174 12956 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:59.504675  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 910) took 1516 ms. Trace:
I20260709 13:04:59.463095  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2299) took 2673 ms. Trace:
I20260709 13:04:59.433250 13171 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:04:59.505175  8195 rpcz_store.cc:276] 0709 13:04:57.987900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.995707 (+  7807us) service_pool.cc:224] Handling call
0709 13:04:58.011549 (+ 15842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.011852 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.011881 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.012288 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.803382 (+791094us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:58.803422 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.803486 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.504441 (+700955us) raft_consensus.cc:1685] finished
0709 13:04:59.504461 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:59.504612 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11932,"raft.queue_time_us":7064,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":961,"thread_start_us":761740,"threads_started":1,"wal-append.queue_time_us":1283583}
I20260709 13:04:59.506008  8118 rpcz_store.cc:276] 0709 13:04:56.789244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.789365 (+   121us) service_pool.cc:224] Handling call
0709 13:04:56.789630 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.793701 (+  4071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.793727 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.820118 (+ 26391us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.229680 (+1409562us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18004a3740. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:04:58.596011 (+366331us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:58.596049 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.596114 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.455081 (+858967us) raft_consensus.cc:1685] finished
0709 13:04:59.455105 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:59.463031 (+  7926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3736,"raft.queue_time_us":12266,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":13580,"spinlock_wait_cycles":23417728,"thread_start_us":366158,"threads_started":1,"wal-append.queue_time_us":1965942}
W20260709 13:04:59.509620 13215 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:04:59.409830 13060 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:59.505520 12838 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:59.505892 13062 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.456189 13025 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:59.440932 12927 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:04:59.450731 13147 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:04:59.548862 12956 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:04:59.453720 13223 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.438s
W20260709 13:05:00.235900  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.045s	sys 0.058s
W20260709 13:05:00.082592  8193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.009s	sys 0.024s
W20260709 13:05:00.237032  8193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.011s	sys 0.030s
W20260709 13:04:59.567310  8810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.012s	sys 0.012s
W20260709 13:05:00.237783  8810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.431s	user 0.020s	sys 0.039s
W20260709 13:05:00.216710  8237 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.019s	sys 0.023s
W20260709 13:05:00.239283  8237 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.020s	sys 0.024s
W20260709 13:05:00.239661  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 997695us
I20260709 13:04:59.733973  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:00.241132  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:04:59.945050  8774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.012s	sys 0.014s
W20260709 13:04:59.912648  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:00.243222  8774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.018s	sys 0.024s
W20260709 13:05:00.243607  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 1.42951e+06us
W20260709 13:05:00.244467  8199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.874s	user 0.016s	sys 0.044s
W20260709 13:05:00.244824  8199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.875s	user 0.016s	sys 0.044s
I20260709 13:05:00.215276  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 959) took 1779 ms. Trace:
I20260709 13:05:00.247337  8266 rpcz_store.cc:276] 0709 13:04:58.435963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.436631 (+   668us) service_pool.cc:224] Handling call
0709 13:04:58.436923 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.437246 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.437274 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.437708 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.803784 (+366076us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:58.803820 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.803875 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.215046 (+1411171us) raft_consensus.cc:1685] finished
0709 13:05:00.215068 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.215208 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3171,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":18708,"thread_start_us":365809,"threads_started":1,"wal-append.queue_time_us":882919}
W20260709 13:05:00.236474  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.045s	sys 0.059s
I20260709 13:05:00.238608  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 845) took 1680 ms. Trace:
W20260709 13:05:00.268303  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 534405us
I20260709 13:05:00.267356  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:00.002436 12983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.008s	sys 0.021s
W20260709 13:04:59.608597 13211 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.824s	user 0.000s	sys 0.014s
W20260709 13:05:00.182324 13208 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.857s	user 0.000s	sys 0.001s
W20260709 13:05:00.166306 13053 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.385s	user 0.020s	sys 0.035s
W20260709 13:05:00.036760 13224 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.426s	user 0.000s	sys 0.000s
W20260709 13:05:00.216295 13108 consensus_meta.cc:287] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.000s
W20260709 13:04:59.567446 13106 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.001s	sys 0.020s
W20260709 13:05:00.245640 12261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.000s	sys 0.010s
I20260709 13:05:00.105854 13246 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:59.510197 13077 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:04:59.550027 12870 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:00.242873 12976 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:00.292394 12754 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:00.270026 12927 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.391285 12927 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:00.393415 12927 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:00.394810 12927 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:00.379081 13164 consensus_meta.cc:287] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 2.037s	user 0.012s	sys 0.000s
W20260709 13:05:00.312649 13007 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.797s	user 0.006s	sys 0.005s
I20260709 13:05:00.299296  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:00.300813  8811 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:00.269232 13060 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:00.276021 13233 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.561566 13171 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:00.414037 13233 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:00.275784 13243 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:00.415597 13243 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:00.275329 13179 consensus_meta.cc:287] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 2.233s	user 0.013s	sys 0.005s
I20260709 13:05:00.299966 13128 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:00.298312 12261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.000s	sys 0.010s
I20260709 13:05:00.290385 13235 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:00.311331 12502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.029s	sys 0.013s
I20260709 13:05:00.297822 12750 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:00.267699 13218 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.311887 13050 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.418629 13153 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.385998 12869 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:00.420336 12502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.030s	sys 0.013s
W20260709 13:05:00.293215 12983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.012s	sys 0.029s
I20260709 13:05:00.385263 13255 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.383275 13246 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:00.390867 12976 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:00.418191 13062 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:00.388487 13220 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.829s	user 0.000s	sys 0.001s
I20260709 13:05:00.388291 13247 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:00.413130 13060 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:00.304292 13173 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.299069 13106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.002s	sys 0.022s
I20260709 13:05:00.428122 13179 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:00.295301 13135 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.230s
W20260709 13:05:00.296316 13053 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.516s	user 0.020s	sys 0.039s
W20260709 13:05:00.294499  8274 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.014s	sys 0.022s
W20260709 13:05:00.303532  8268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.001s	sys 0.023s
I20260709 13:05:00.412066  8807 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:05:00.294994 12984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.021s	sys 0.029s
W20260709 13:05:01.180629 12984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.944s	user 0.031s	sys 0.032s
W20260709 13:05:00.983192  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:01.189658  8240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.009s	sys 0.026s
W20260709 13:05:00.998658  8238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.002s	sys 0.000s
W20260709 13:05:00.941169  8119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.721s	user 0.013s	sys 0.014s
W20260709 13:05:00.964207  8166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.714s	user 0.003s	sys 0.007s
W20260709 13:05:00.950434  8125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.741s	user 0.039s	sys 0.048s
W20260709 13:05:00.961855  8194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.647s	user 0.009s	sys 0.011s
W20260709 13:05:01.196457  8238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.002s	sys 0.013s
W20260709 13:05:01.199653  8240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.009s	sys 0.026s
W20260709 13:05:01.200344  8166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.950s	user 0.018s	sys 0.010s
W20260709 13:05:01.090164 12946 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.003s
I20260709 13:05:00.967008  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 917) took 2326 ms. Trace:
W20260709 13:05:00.442723 12876 consensus_meta.cc:287] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.938s	user 0.010s	sys 0.000s
W20260709 13:05:01.209062  8119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.999s	user 0.020s	sys 0.021s
W20260709 13:05:01.209623  8274 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.634s	user 0.017s	sys 0.032s
W20260709 13:05:01.210547  8194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.896s	user 0.016s	sys 0.022s
W20260709 13:05:01.210986  8125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.002s	user 0.046s	sys 0.058s
W20260709 13:05:00.517689 13244 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:05:00.671522 13239 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:05:01.091675 12956 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:00.710690 13059 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 1.327s	user 0.003s	sys 0.007s
W20260709 13:05:00.673815 13138 consensus_meta.cc:287] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.967s	user 0.008s	sys 0.003s
W20260709 13:05:00.670147 13238 log.cc:927] Time spent T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:05:00.603101 13155 consensus_meta.cc:287] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 1.957s	user 0.007s	sys 0.002s
W20260709 13:05:01.211874 12946 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.007s	sys 0.007s
I20260709 13:04:59.732748  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.033077  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:01.032938  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:00.943449  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.220717 13106 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:01.214649  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 1.96485e+06us
W20260709 13:04:59.561105  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 366806us
W20260709 13:05:01.239353 13068 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.002s	sys 0.008s
I20260709 13:05:01.237658 13227 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:05:01.230360  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:04:59.596599  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:05:01.234661  8268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.741s	user 0.007s	sys 0.043s
I20260709 13:05:00.950323  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:01.243078 13068 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.002s	sys 0.008s
I20260709 13:05:01.209062  8192 rpcz_store.cc:276] 0709 13:04:58.639950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.640906 (+   956us) service_pool.cc:224] Handling call
0709 13:04:58.641216 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.710038 (+ 68822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.710069 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:58.710155 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:58.710192 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.966340 (+2256148us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b5400028fd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:00.966424 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.966739 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157692544}
I20260709 13:05:01.254699 12956 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.255844 12956 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.261801 13169 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:01.262651 13169 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.263161  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2063) took 1807 ms. Trace:
I20260709 13:05:01.263650  8268 rpcz_store.cc:276] 0709 13:04:59.455499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.455665 (+   166us) service_pool.cc:224] Handling call
0709 13:04:59.455912 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:59.458405 (+  2493us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:59.458649 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.261565 (+1802916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.261680 (+   115us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.261796 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.262632 (+   836us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5400075154. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:01.262697 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.262994 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4547,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":75871232,"thread_start_us":1789974,"threads_started":1,"wal-append.queue_time_us":1724852}
W20260709 13:05:01.266041  8088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.68:34433 timed out after 1.783s (SENT) [suppressed 5 similar messages]
W20260709 13:05:01.267400 13234 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.164s	user 0.010s	sys 0.006s
I20260709 13:05:01.268013 13253 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:01.269191 13253 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.239643  8774 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:01.225626 13171 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:00.671794 13246 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.277799 13138 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:00.303781 13108 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.286042 13233 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:01.286381  8118 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:05:01.286798 13243 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:01.265033 12906 consensus_meta.cc:287] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 2.031s	user 0.005s	sys 0.010s
W20260709 13:05:01.274920  8163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.894s	user 0.002s	sys 0.022s
W20260709 13:05:01.281001  8237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.002s	sys 0.015s
W20260709 13:05:01.276702  8091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.004s	sys 0.011s
W20260709 13:05:01.277952  8117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 701) took 1673 ms (client timeout 1717 ms). Trace:
W20260709 13:05:01.278198  8116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 703) took 1671 ms (client timeout 2089 ms). Trace:
W20260709 13:05:01.280927  8165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.049s	user 0.008s	sys 0.022s
W20260709 13:05:01.291946  8117 rpcz_store.cc:269] 0709 13:04:59.604168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.604291 (+   123us) service_pool.cc:224] Handling call
0709 13:05:01.276714 (+1672423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.272351 13052 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:01.292737  8116 rpcz_store.cc:269] 0709 13:04:59.606368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.665022 (+ 58654us) service_pool.cc:224] Handling call
0709 13:05:01.275353 (+1610331us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:01.294378  8163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.980s	user 0.003s	sys 0.023s
W20260709 13:05:01.292479  8090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.007s	sys 0.012s
I20260709 13:05:01.221400 13173 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:01.293897  8091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.004s	sys 0.011s
W20260709 13:05:01.294548  8237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.002s	sys 0.015s
I20260709 13:05:00.469408 13153 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:01.296221  8165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.134s	user 0.008s	sys 0.022s
W20260709 13:05:01.295011  8120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 704) took 1576 ms (client timeout 1604 ms). Trace:
W20260709 13:05:01.302498  8120 rpcz_store.cc:269] 0709 13:04:59.665477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.665593 (+   116us) service_pool.cc:224] Handling call
0709 13:05:01.241496 (+1575903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.234913 13242 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:05:01.302924  8090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.943s	user 0.008s	sys 0.013s
W20260709 13:05:01.306882  8120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2325) took 1638 ms (client timeout 1530 ms). Trace:
I20260709 13:05:01.307847  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:01.308647  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 1.06761e+06us
W20260709 13:05:01.309805  8120 rpcz_store.cc:269] 0709 13:04:59.668120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.306504 (+1638384us) service_pool.cc:211] Skipping call since client already timed out
0709 13:05:01.306695 (+   191us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:05:01.311965  8120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 705) took 1646 ms (client timeout 1628 ms). Trace:
W20260709 13:05:01.310002  8117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 706) took 1640 ms (client timeout 1620 ms). Trace:
W20260709 13:05:01.312425  8120 rpcz_store.cc:269] 0709 13:04:59.665876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.311711 (+1645835us) service_pool.cc:211] Skipping call since client already timed out
0709 13:05:01.311887 (+   176us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:05:01.313380  8117 rpcz_store.cc:269] 0709 13:04:59.666110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.306524 (+1640414us) service_pool.cc:211] Skipping call since client already timed out
0709 13:05:01.306695 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:05:01.297747 13052 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:01.315425 13155 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:01.316115  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.316656  8195 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:01.317332 13164 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.317490  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.308918  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.322507  8125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2394) took 4272 ms. Trace:
I20260709 13:05:01.250258 13247 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:01.307097  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 1.42979e+06us
I20260709 13:05:01.330103 13059 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:01.331579 12906 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:01.332612  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 295578us
I20260709 13:05:01.333168  8117 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:01.331386  8122 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:01.333878  8117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2320) took 1666 ms (client timeout 2006 ms). Trace:
W20260709 13:05:01.337911  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.338581 13106 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.332455 12906 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.342753  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2566) took 3448 ms. Trace:
I20260709 13:05:01.344631 12906 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.343173  8199 rpcz_store.cc:276] 0709 13:04:57.894055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.983291 (+ 89236us) service_pool.cc:224] Handling call
0709 13:04:57.983535 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.983835 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.983861 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:57.984261 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.369909 (+385648us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b1800247ea0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:05:00.245225 (+1875316us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:00.245268 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.245338 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.342180 (+1096842us) raft_consensus.cc:1685] finished
0709 13:05:01.342218 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.342556 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8398,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3942,"spinlock_wait_cycles":2747776,"thread_start_us":1875123,"threads_started":1,"wal-append.queue_time_us":2447948}
I20260709 13:05:01.346150 13242 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.349380  8196 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:05:01.349761  8191 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:01.337651  8117 rpcz_store.cc:269] 0709 13:04:59.667037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.316526 (+1649489us) service_pool.cc:224] Handling call
0709 13:05:01.333780 (+ 17254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.353519  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.354315  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:01.315562 13154 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.326632 13164 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:01.356344  8121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 702) took 1699 ms (client timeout 1792 ms). Trace:
W20260709 13:05:01.357860 12913 consensus_meta.cc:287] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 2.518s	user 0.014s	sys 0.010s
I20260709 13:05:00.502022 13255 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.361913  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:01.362378 13250 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260709 13:05:01.362215 13233 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:01.363142  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 56777.5us
I20260709 13:05:00.446749 13218 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:05:01.369834  8121 rpcz_store.cc:269] 0709 13:04:59.604469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.606063 (+  1594us) service_pool.cc:224] Handling call
0709 13:05:01.299391 (+1693328us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:01.371519  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 133440us
I20260709 13:05:01.377254  8194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2575) took 2890 ms. Trace:
I20260709 13:05:01.349167 13155 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.386471  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.387384  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:01.385968 13233 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.388279 13114 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:01.389647 12949 consensus_queue.cc:1059] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:01.389979 13233 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.390511 13154 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:01.391120 13180 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:01.391677 13180 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:01.392098 13160 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:01.392557 13160 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.393177  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.392984 13180 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.394131 13243 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.394937 13243 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.395386 13180 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:01.396499 12862 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.393648 13173 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.397511 13255 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:01.391623  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 80627.6us
I20260709 13:05:01.398157  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:01.400688  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:01.400835 12745 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:01.401677 12745 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.391180 13154 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.390200 13253 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.402724  8192 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:01.404850 13154 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.392961 13160 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.402225 12949 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:01.406033 12949 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:01.407160 13247 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.409004  8122 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:01.405472  8195 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:01.376523  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 2.1003e+06us
I20260709 13:05:01.394080  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2317) took 1727 ms. Trace:
I20260709 13:05:01.402165 12745 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:01.414954  8117 rpcz_store.cc:276] 0709 13:04:59.666359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.374126 (+1707767us) service_pool.cc:224] Handling call
0709 13:05:01.394015 (+ 19889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.414805  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2060) took 1962 ms. Trace:
I20260709 13:05:01.327397  8125 rpcz_store.cc:276] 0709 13:04:57.052517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.952578 (+900061us) service_pool.cc:224] Handling call
0709 13:04:57.952924 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:58.557231 (+604307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.557286 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:59.208064 (+650778us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b2c00000f48. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd23621a11 00007fbd23631372 00007fbd24d63a01 00007fbd24d2843a 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2
0709 13:04:59.208616 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:05:01.310419 (+2101803us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:01.321545 (+ 11126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.321677 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.321730 (+    53us) raft_consensus.cc:1685] finished
0709 13:05:01.321742 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.322310 (+   568us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":451591,"raft.queue_time_us":370136,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":71,"spinlock_wait_cycles":6731136,"thread_start_us":2251671,"threads_started":2,"wal-append.queue_time_us":1283315}
I20260709 13:05:01.407526 12949 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.419133  8274 rpcz_store.cc:276] 0709 13:04:59.452794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.457285 (+  4491us) service_pool.cc:224] Handling call
0709 13:04:59.558438 (+101153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:59.558662 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:01.237787 (+1679125us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.414268 (+176481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.414357 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:01.414454 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.414546 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.414747 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1775,"prepare.queue_time_us":70957,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":32921,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":111,"thread_start_us":1783078,"threads_started":2}
I20260709 13:05:01.414465 13218 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.397261 13243 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.425951 13263 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:01.418069  8193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2574) took 2807 ms. Trace:
I20260709 13:05:01.392099 13164 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:01.428658  8122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 700) took 1832 ms (client timeout 1556 ms). Trace:
I20260709 13:05:01.430955  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:01.429854  8122 rpcz_store.cc:269] 0709 13:04:59.596274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.596380 (+   106us) service_pool.cc:224] Handling call
0709 13:05:01.425041 (+1828661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.379179  8194 rpcz_store.cc:276] 0709 13:04:58.486658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.487483 (+   825us) service_pool.cc:224] Handling call
0709 13:04:58.487747 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.487950 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:59.314146 (+826196us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.280327 (+1966181us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.294571 (+ 14244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.298261 (+  3690us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.310751 (+ 12490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.325906 (+ 15155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.377197 (+ 51291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54448,"prepare.queue_time_us":1465377,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":1658,"raft.queue_time_us":25281,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":4511,"thread_start_us":2639908,"threads_started":2,"wal-append.queue_time_us":1274851}
I20260709 13:05:01.423141 12949 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:01.389102 13114 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.434614  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:01.439592  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2572) took 3120 ms. Trace:
I20260709 13:05:01.440059  8198 rpcz_store.cc:276] 0709 13:04:58.318858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.420198 (+101340us) service_pool.cc:224] Handling call
0709 13:04:58.420503 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.553972 (+133469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.439007 (+2885035us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001ae5d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:01.439386 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296598400}
I20260709 13:05:01.428678 13263 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:01.430650 12956 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.448024 13108 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:01.448879  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.450933  8120 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:01.450713  8809 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:01.451442  8120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2323) took 1783 ms (client timeout 2179 ms). Trace:
W20260709 13:05:01.451856  8120 rpcz_store.cc:269] 0709 13:04:59.667679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.448485 (+1780806us) service_pool.cc:224] Handling call
0709 13:05:01.451367 (+  2882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.450271  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.449875  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.455459  8122 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:01.452088  8199 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:05:01.460242 13263 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.427110  8193 rpcz_store.cc:276] 0709 13:04:58.485552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.485700 (+   148us) service_pool.cc:224] Handling call
0709 13:04:58.486026 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.486244 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:59.007385 (+521141us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.219497 (+2212112us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.258417 (+ 38920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.274010 (+ 15593us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.277642 (+  3632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.278509 (+   867us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.292742 (+ 14233us) inbound_call.cc:177] Queueing success response
0709 13:05:01.395024 (+102282us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b18003fa2a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
Metrics: {"mutex_wait_us":12525,"prepare.queue_time_us":1252693,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":834436,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":502,"spinlock_wait_cycles":13192960,"thread_start_us":1966221,"threads_started":3,"wal-append.queue_time_us":1403783}
I20260709 13:05:01.451341 13115 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:05:01.463835  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.463411 13115 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.467321  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:01.467905  8121 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:05:01.468684  8192 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:01.469067  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:01.473558 12892 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:01.474700 13050 consensus_meta.cc:287] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 1.035s	user 0.008s	sys 0.008s
I20260709 13:05:01.474393 12892 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.475171 13050 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:01.476275 13152 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.477097 12976 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:00.257810  8810 rpcz_store.cc:276] 0709 13:04:58.557827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.558331 (+   504us) service_pool.cc:224] Handling call
0709 13:04:58.575293 (+ 16962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.575470 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:58.806269 (+230799us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.238234 (+1431965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:00.238296 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:00.238342 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.238410 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.238548 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":658948,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":7439,"thread_start_us":1646455,"threads_started":2}
W20260709 13:05:01.466627 13261 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.282s	user 0.003s	sys 0.000s
W20260709 13:05:01.485939  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 85497.8us
I20260709 13:05:01.472368  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2318) took 1803 ms. Trace:
I20260709 13:05:01.486584  8121 rpcz_store.cc:276] 0709 13:04:59.666580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.411199 (+1744619us) service_pool.cc:224] Handling call
0709 13:05:01.452595 (+ 41396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.469814 (+ 17219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.469957 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.488651  8121 raft_consensus.cc:1240] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:05:01.490114 13219 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 1.880s	user 0.009s	sys 0.017s
W20260709 13:05:01.493922 13212 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 2.304s	user 0.011s	sys 0.035s
I20260709 13:05:01.466555 13114 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:01.532287 13258 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:01.533108 13258 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.535604 13258 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:01.532179  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.496076  8195 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:01.502166  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2401) took 4292 ms. Trace:
I20260709 13:05:01.503675 12956 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:01.504395  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.477089 13152 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.505867 13107 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:01.509308  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.509717  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.510747  8268 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:01.511793  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.512621  8271 raft_consensus.cc:1240] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:01.510744  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.515558  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:01.518893  8191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2573) took 3033 ms. Trace:
I20260709 13:05:01.554939  8192 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:01.520891 13084 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:01.523300  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.526656 13247 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.527297  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.556056 13115 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.556661  8273 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:01.498550  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2321) took 1828 ms. Trace:
I20260709 13:05:01.555536  8191 rpcz_store.cc:276] 0709 13:04:58.485081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.485224 (+   143us) service_pool.cc:224] Handling call
0709 13:04:58.522733 (+ 37509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.375390 (+2852657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.518636 (+143246us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b5400029ed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:01.518838 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6501150976}
I20260709 13:05:01.557765  8121 rpcz_store.cc:276] 0709 13:04:59.667262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.487460 (+1820198us) service_pool.cc:224] Handling call
0709 13:05:01.488153 (+   693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.495115 (+  6962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.495315 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.487054  8163 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:01.557034 13218 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:01.556677 13247 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.559121  8117 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
W20260709 13:05:01.561312  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 72540.1us
I20260709 13:05:01.557271 13084 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:01.561872  8273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44562 (request call id 2065) took 1969 ms (client timeout 2042 ms). Trace:
I20260709 13:05:01.568434  8266 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:01.568794  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.569823  8274 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:01.571120  8200 raft_consensus.cc:2410] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:05:01.565372  8273 rpcz_store.cc:269] 0709 13:04:59.588200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.522847 (+1934647us) service_pool.cc:224] Handling call
0709 13:05:01.557509 (+ 34662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.571576  8120 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:01.569736  8193 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 9.
I20260709 13:05:01.574944  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.575954  8192 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:01.576058 13084 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.578284 13084 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.579141  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2324) took 1911 ms. Trace:
I20260709 13:05:01.579548  8121 rpcz_store.cc:276] 0709 13:04:59.667899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.561119 (+1893220us) service_pool.cc:224] Handling call
0709 13:05:01.578134 (+ 17015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.578623 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.578653 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.578713 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:01.578865 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.578946 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.579066 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.581465  8123 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:01.588514 13060 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.591521 13268 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.592229 13268 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.594646 13268 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.595988 13160 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.597743 13218 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.599094 13152 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:01.569621  8270 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:01.601024 13169 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:01.602037  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 86674us
I20260709 13:05:01.603199 13255 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:01.540999  8119 rpcz_store.cc:276] 0709 13:04:57.210158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.989132 (+778974us) service_pool.cc:224] Handling call
0709 13:04:57.998346 (+  9214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.269593 (+271247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.269623 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.270054 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.566455 (+296401us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:59.187311 (+620856us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.283765 (+2096454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.303102 (+ 19337us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.493072 (+189970us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:01.501761 (+  8689us) raft_consensus.cc:1685] finished
0709 13:05:01.501872 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.502079 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336767,"prepare.queue_time_us":700349,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2040,"raft.queue_time_us":1185541,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":106262,"spinlock_wait_cycles":7006080,"thread_start_us":2892875,"threads_started":3,"wal-append.queue_time_us":551869}
I20260709 13:05:01.569007 13135 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.597151 12745 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:01.627880  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.562471  8237 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:01.632501  8120 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:01.634573  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.635344  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.640336  8273 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:01.625100 13255 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.643492  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.646780  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:01.631989 13155 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.654299 12745 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.649720 13154 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.655112 13106 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:01.661230 13271 log.cc:927] Time spent T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:05:01.655826  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 201562us
I20260709 13:05:01.661567 13106 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.662595  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:01.654446  8225 heartbeater.cc:646] Failed to heartbeat to 127.6.215.126:41935 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.215.126:41935 timed out after 15.000s (SENT)
I20260709 13:05:01.663724 12913 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:01.661428 13154 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.667368 13154 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.635358 13258 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.669679 13258 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.671097  8193 raft_consensus.cc:2410] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:05:01.674152  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 90859.7us
I20260709 13:05:01.658156  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:01.655038  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 102581us
I20260709 13:05:01.656199  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.655268 13157 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.655704  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.648097 13255 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:01.676455  8200 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:05:01.692210  8197 raft_consensus.cc:2410] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:05:01.693082  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.695940  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.696704  8194 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:05:01.699047 13115 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.691763 13157 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.651281 13253 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.703388 13253 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.705968  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2054) took 2347 ms. Trace:
I20260709 13:05:01.706899 13108 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:01.657302 13171 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:01.702777 13173 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:01.710692 13173 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:01.711464  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:01.649194 13242 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:05:01.714845 13173 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.716429 13157 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.691658 13053 consensus_queue.cc:1059] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:05:01.717581 13106 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.720171  8270 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:01.674455 13164 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:01.718412 13245 raft_consensus.cc:3055] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:01.723349 13245 raft_consensus.cc:740] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:01.723677 13218 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:01.674028 13135 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:01.727334  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77210.6us
I20260709 13:05:01.728259  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:01.718591  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.722877  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:01.706465  8267 rpcz_store.cc:276] 0709 13:04:59.358055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.358207 (+   152us) service_pool.cc:224] Handling call
0709 13:04:59.358531 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:59.439274 (+ 80743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.439315 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:59.439378 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:59.439426 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.705511 (+2266085us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b54004088d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:01.705585 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.705761 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184697600}
W20260709 13:05:01.717552 12946 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:05:01.729722  8273 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
W20260709 13:05:01.719456  8774 connection.cc:256] RPC call timeout handler was delayed by -1.42083212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:05:01.737286  8774 connection.cc:256] RPC call timeout handler was delayed by -1.377632119999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:05:01.737916  8774 connection.cc:256] RPC call timeout handler was delayed by -1.3632321199999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:05:01.738335  8774 connection.cc:256] RPC call timeout handler was delayed by -1.3560321200000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:05:01.738642  8774 connection.cc:256] RPC call timeout handler was delayed by -1.2759321199999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:05:01.739476  8774 connection.cc:256] RPC call timeout handler was delayed by -1.2084321199999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:05:01.741109  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:01.741604  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:01.740734  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:01.702617 13068 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.747056 13169 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:01.744321  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 110673us
I20260709 13:05:01.755203  8116 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:01.727689 13135 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.759884  8810 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:01.761168 13213 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.709170 12980 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.859436  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:01.757777  8199 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:01.901127  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.027637  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:01.992542  8804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 852) took 3364 ms. Trace:
I20260709 13:05:01.777520  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:01.993206  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.062197  8088 connection.cc:256] RPC call timeout handler was delayed by -1.6914146500000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:05:02.062835  8088 connection.cc:256] RPC call timeout handler was delayed by -1.4607134939999469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:05:02.063150  8088 connection.cc:256] RPC call timeout handler was delayed by -1.3888613659999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 13:05:02.063422  8088 connection.cc:256] RPC call timeout handler was delayed by -1.3743446490000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2911s for a response
W20260709 13:05:02.014250  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 351657us
W20260709 13:05:02.034629  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.066995  8802 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:05:01.748247 13160 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:01.765944 13270 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.319s	user 0.000s	sys 0.003s
I20260709 13:05:02.073127  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:01.991295  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:01.910032  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.089085  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.089843 13213 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:02.090962  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.098165  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.056686  8804 rpcz_store.cc:276] 0709 13:04:58.627836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.627970 (+   134us) service_pool.cc:224] Handling call
0709 13:04:58.628296 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.645271 (+ 16975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.645301 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.645717 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:04:59.341914 (+696197us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:59.341963 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:59.342028 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.266386 (+1924358us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:01.761683 (+495297us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b24003ad078. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21ac19c4 00007fbd21abfacb 00007fbd21c7adc9 00007fbd21c7aa55 00007fbd21c79fb0 00007fbd248f0488 00007fbd248f0be8 00007fbd248c8398 00007fbd248c376a 00007fbd248c2bb6
0709 13:05:01.763599 (+  1916us) raft_consensus.cc:1685] finished
0709 13:05:01.763620 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.992363 (+228743us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23396,"raft.queue_time_us":17324,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9355,"spinlock_wait_cycles":370869760,"thread_start_us":695888,"threads_started":1,"wal-append.queue_time_us":1456811}
W20260709 13:05:02.100262  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 107395us
I20260709 13:05:01.765656 13152 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:02.088490 12995 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:01.753783 12956 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:01.923827  8809 raft_consensus.cc:2376] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16. Re-sending same reply.
I20260709 13:05:01.766213  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:01.742412 13155 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:01.759191 13263 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:01.953887 13059 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:02.124287  8199 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:05:02.126883  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 407033us
I20260709 13:05:02.071828 13258 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:01.992378 13246 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:05:02.063687  8088 connection.cc:256] RPC call timeout handler was delayed by -1.2123446489999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30910000000000004s for a response
I20260709 13:05:02.130098  8194 raft_consensus.cc:2393] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 13: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:02.129251  8125 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
W20260709 13:05:02.134909  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 368911us
I20260709 13:05:02.136118  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.136898  8196 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
W20260709 13:05:02.130877 13084 consensus_meta.cc:287] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 13:05:02.122088 12995 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:02.128710 13247 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:01.931784 13068 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:02.122826 12956 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.158489 12956 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:02.156476  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:02.169965  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:02.170677  8125 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:02.033037 13245 consensus_queue.cc:260] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:02.126252 13059 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:05:02.145619  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.149492  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2322) took 2477 ms. Trace:
I20260709 13:05:02.150456  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.150967  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.152020 13153 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:02.130601 12980 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.178742 12980 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:02.181689 12980 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.152561 12995 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.182382  8808 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:05:02.176806  8807 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 16 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:02.175067  8122 rpcz_store.cc:276] 0709 13:04:59.667472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.555967 (+1888495us) service_pool.cc:224] Handling call
0709 13:05:01.605469 (+ 49502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.605868 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:01.692390 (+ 86522us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.142851 (+450461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.142903 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:02.142942 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.143001 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.144639 (+  1638us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147639,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":16757,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13249,"thread_start_us":454746,"threads_started":2}
W20260709 13:05:02.153146 13180 consensus_meta.cc:287] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.004s
W20260709 13:05:02.179689  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 52264.3us
W20260709 13:05:02.145926  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.185072  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.183331  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:02.175781 12913 consensus_meta.cc:287] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 13:05:02.145078 13246 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:02.153311 13152 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:02.197247  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:02.188084  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:02.194772  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.186846 13160 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:02.201854  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.204844  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.193051 12913 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:02.171842 13263 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:02.234787  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 476437us
I20260709 13:05:02.212182 13150 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:02.213948 13126 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:05:02.222667 13052 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:02.205201 13222 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 2.486s	user 0.004s	sys 0.015s
W20260709 13:05:02.532403  8116 consensus_meta.cc:287] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.006s
I20260709 13:05:02.503427  8273 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:02.552590  8116 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
W20260709 13:05:02.405498  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 68547.4us
W20260709 13:05:02.405880  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 68997.6us
W20260709 13:05:02.555145  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.540161  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 176475us
I20260709 13:05:02.336603 13218 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:02.359782  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.580802  8197 raft_consensus.cc:1240] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:05:02.505247 13283 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.377s	user 0.013s	sys 0.005s
W20260709 13:05:02.359666 12946 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:05:02.553714 13169 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:02.557860  8116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2319) took 2887 ms (client timeout 2137 ms). Trace:
I20260709 13:05:02.573477  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:02.587393  8116 rpcz_store.cc:269] 0709 13:04:59.666806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.711137 (+2044331us) service_pool.cc:224] Handling call
0709 13:05:02.553898 (+842761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.590276  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.359889  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:02.352756 13246 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:02.429939 13292 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:05:02.590839  8268 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:02.594152  8118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 699) took 2998 ms. Trace:
I20260709 13:05:02.359969 13164 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:02.548487 13213 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:02.595696  8118 rpcz_store.cc:276] 0709 13:04:59.595942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.596084 (+   142us) service_pool.cc:224] Handling call
0709 13:04:59.596414 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.286848 (+1690434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.593846 (+1306998us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540029a254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:02.594083 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3880463104}
I20260709 13:05:02.430382 13152 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:02.598438  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.602517  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2418) took 1216 ms. Trace:
I20260709 13:05:02.603303  8121 rpcz_store.cc:276] 0709 13:05:01.386200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.580749 (+194549us) service_pool.cc:224] Handling call
0709 13:05:01.581177 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.650805 (+ 69628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.650840 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.722316 (+ 71476us) log.cc:844] Serialized 26 byte log entry
0709 13:05:02.187177 (+464861us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:02.187212 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.187279 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.602291 (+415012us) raft_consensus.cc:1685] finished
0709 13:05:02.602312 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.602452 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65932,"raft.queue_time_us":69982,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":40740,"thread_start_us":202998,"threads_started":1,"wal-append.queue_time_us":671774}
I20260709 13:05:02.605455  8775 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:02.607046 13180 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:02.607160 13253 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:02.610972 13260 log.cc:927] Time spent T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 1.428s	user 0.006s	sys 0.005s
W20260709 13:05:02.359851  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:02.613049  8007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 399775us
I20260709 13:05:02.564787 13150 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:02.616683  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.558748 13068 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:02.584635 13218 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:02.614423  8197 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:02.620368  8120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2421) took 1232 ms. Trace:
I20260709 13:05:02.622522  8120 rpcz_store.cc:276] 0709 13:05:01.387510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.455309 (+ 67799us) service_pool.cc:224] Handling call
0709 13:05:02.620205 (+1164896us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b54000e33d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:02.620313 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203228544}
I20260709 13:05:02.620855  8273 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:02.354810 12995 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:02.628579 13247 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.629206 13247 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:02.630036 12995 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:02.631484 13247 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:02.632169 13247 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:02.428834 12978 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.184s
I20260709 13:05:02.625687  8272 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:02.646158  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:02.644834  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.633531  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.647099  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:02.656196 13139 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:02.657013 13255 consensus_meta.cc:287] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.903s	user 0.002s	sys 0.015s
I20260709 13:05:02.656754 13139 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:02.595129 13059 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:02.658072 13274 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.089s	user 0.004s	sys 0.007s
I20260709 13:05:02.658685 13059 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.659314 13139 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:02.660436  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.661154  8266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2069) took 1034 ms. Trace:
I20260709 13:05:02.661549  8266 rpcz_store.cc:276] 0709 13:05:01.626359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.634147 (+  7788us) service_pool.cc:224] Handling call
0709 13:05:01.651293 (+ 17146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.696345 (+ 45052us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:01.696377 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.727001 (+ 30624us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.739842 (+ 12841us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:01.739888 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.739969 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.660903 (+920934us) raft_consensus.cc:1685] finished
0709 13:05:02.660923 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.661067 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3497,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":12360,"threads_started":1,"wal-append.queue_time_us":144710}
I20260709 13:05:02.615434 13052 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.661465  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.592139 13169 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:02.632531  8088 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:02.633921 13231 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 2.572s	user 0.008s	sys 0.010s
I20260709 13:05:02.619511 13150 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:02.623309 13218 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.623739 13155 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:02.632501 13247 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:02.686019  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.686993  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:02.687747  8197 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:05:02.688942  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.689664  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.693298  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.695710  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:02.697499  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79073.3us
I20260709 13:05:02.699715  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.633285 13152 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:05:02.626123 13253 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:05:02.688742 13247 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.674489 13255 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:02.713472  8192 raft_consensus.cc:2410] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:02.714744  8194 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:02.716208  8198 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:05:02.723258  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 107512us
I20260709 13:05:02.724290  8124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53286 (request call id 695) took 5241 ms. Trace:
I20260709 13:05:02.724679  8124 rpcz_store.cc:276] 0709 13:04:57.458575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.264410 (+805835us) service_pool.cc:224] Handling call
0709 13:04:58.264672 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.374419 (+109747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.374449 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.415814 (+ 41365us) log.cc:844] Serialized 26 byte log entry
0709 13:04:59.185480 (+769666us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:59.185522 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:59.185593 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.767516 (+2581923us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:02.663571 (+896055us) raft_consensus.cc:1685] finished
0709 13:05:02.663591 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.699493 (+ 35902us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181070,"raft.queue_time_us":145709,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4105,"spinlock_wait_cycles":1169812736,"thread_start_us":663918,"threads_started":1,"wal-append.queue_time_us":946129}
W20260709 13:05:02.728439  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.729923  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.719911  8191 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:02.733271  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2420) took 1346 ms. Trace:
I20260709 13:05:02.707757 12978 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:02.742952  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.743805  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.744298  8192 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
W20260709 13:05:02.745210  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 112746us
I20260709 13:05:02.740589  8119 rpcz_store.cc:276] 0709 13:05:01.387095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.650988 (+263893us) service_pool.cc:224] Handling call
0709 13:05:01.692585 (+ 41597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.727855 (+ 35270us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:02.013646 (+285791us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.203273 (+189627us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:02.340556 (+137283us) log.cc:844] Serialized 26 byte log entry
0709 13:05:02.340967 (+   411us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:02.377791 (+ 36824us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.378064 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.378164 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.733043 (+354879us) raft_consensus.cc:1685] finished
0709 13:05:02.733063 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.733195 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36270,"prepare.queue_time_us":105194,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":86,"raft.queue_time_us":811,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":102762,"spinlock_wait_cycles":7716096,"thread_start_us":359376,"threads_started":2,"wal-append.queue_time_us":603504}
W20260709 13:05:02.747948  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.748088  8123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50790 (request call id 2298) took 5959 ms (client timeout 1696 ms). Trace:
W20260709 13:05:02.748489  8123 rpcz_store.cc:269] 0709 13:04:56.788241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.788365 (+   124us) service_pool.cc:224] Handling call
0709 13:05:02.747875 (+5959510us) spinlock_profiling.cc:243] Waited 4.56 s on lock 0x7b54000deb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:02.748002 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10480001792}
I20260709 13:05:02.754077  8272 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:05:02.762069  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:02.745282 13180 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:05:02.772308 12980 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 13:05:02.762813  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:02.778846  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:02.781678  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.782117  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.759223 13263 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:02.779592  8269 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:05:02.791040  8273 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:02.792838  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.794960 12946 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:02.796224 12946 tablet_bootstrap.cc:492] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:02.797056 12946 ts_tablet_manager.cc:1403] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 4.980s	user 0.056s	sys 0.025s
I20260709 13:05:02.798602  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.798990  8200 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:02.799208  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.800333  8089 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:02.800679  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.801298  8194 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:02.802168  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.804199 13152 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:02.799726  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:02.807682  8198 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:02.809738  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.799592  8195 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
W20260709 13:05:02.810372  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 59438.2us
I20260709 13:05:02.791893  8192 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:02.812779  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:02.821308  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.789726 12978 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.829907 12978 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.830384 12978 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.834075  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:02.800266 13298 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.838179  8272 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:02.838420  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 273931us
I20260709 13:05:02.844985  8269 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:02.784381 12980 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:02.853566  8238 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:02.873939  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.840454 13298 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:02.888622  8269 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:02.893446  8271 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:02.890360  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.900297 12892 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:02.901858 13296 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:05:02.905856 13126 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:02.906065  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:02.909464  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.912267  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 79443us
I20260709 13:05:02.891224 13300 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.894330 13298 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.932898  8269 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:02.909910 13255 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:02.943306  8272 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
W20260709 13:05:02.947736  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 114030us
W20260709 13:05:02.949358  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 107570us
I20260709 13:05:02.929980 13300 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:02.961790  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:02.962587  8088 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:02.945149 13138 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.967962  8272 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:05:02.967872  8163 connection.cc:256] RPC call timeout handler was delayed by -3.2059707390000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 13:05:02.991261  8088 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:02.962700 13300 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.993829  8238 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:02.970626 12956 consensus_meta.cc:287] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.003s
I20260709 13:05:02.990332 12913 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:02.999423 12913 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.001914 13108 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.004102 12913 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:03.018054  8163 connection.cc:256] RPC call timeout handler was delayed by -2.8225707390000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 13:05:03.019300  8163 connection.cc:256] RPC call timeout handler was delayed by -2.8173227419999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:05:03.019884  8163 connection.cc:256] RPC call timeout handler was delayed by -2.744270739000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:05:02.967872 12745 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:05:03.019781  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:03.020282  8163 connection.cc:256] RPC call timeout handler was delayed by -2.388922741999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:05:03.021893  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 176408us
I20260709 13:05:03.024358  8269 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
W20260709 13:05:03.024569  8163 connection.cc:256] RPC call timeout handler was delayed by -2.3239707390000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26940000000000003s for a response
W20260709 13:05:03.025151  8163 connection.cc:256] RPC call timeout handler was delayed by -2.2710227420000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:05:03.026312  8163 connection.cc:256] RPC call timeout handler was delayed by -2.2332227420000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 13:05:03.026678  8163 connection.cc:256] RPC call timeout handler was delayed by -1.7841227420000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2678s for a response
W20260709 13:05:03.026970  8163 connection.cc:256] RPC call timeout handler was delayed by -1.7227707389999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33620000000000005s for a response
I20260709 13:05:03.017958  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.030890  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.022190 13305 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.036558 12978 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:02.992573 13138 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.021057 13126 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:03.045639  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.048482 13308 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:03.064965 13126 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:03.065196  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.065563 13126 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:03.066673  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.040145 13068 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:03.067270  8120 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:05:03.067384 13068 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:03.067787 13068 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.068135  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.069651  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.070223  8120 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:03.070020 13150 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.071151  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.072216  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.072388 13150 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.073253  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:03.074128 13126 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.076642 13126 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:03.077682  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.047259 13305 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.010191 12956 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.083283 12956 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:03.084069  8266 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:05:03.085179  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:03.086001  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.086704  8269 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:03.086386  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.087630  8270 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 12.
I20260709 13:05:03.088495  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.088608  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.050132 12949 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:03.090248 12949 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:03.089870  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.091728 13246 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:03.092145 13246 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:03.046499  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:03.093050 13246 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.093786  8124 raft_consensus.cc:2376] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13. Re-sending same reply.
I20260709 13:05:03.047629  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:03.056242 12946 raft_consensus.cc:359] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 8 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.047045  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.094966  8116 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:03.047330  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.095428 13255 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:03.095837 13255 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:03.040803  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.046219  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.050470  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.048544  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:03.099200  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50727.8us
I20260709 13:05:03.100216 12870 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.100565  8091 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:03.031843 12980 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:03.021402 13311 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:03.091269 12949 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.050797  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.096674 13255 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.060825  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 862) took 1313 ms. Trace:
I20260709 13:05:03.089722  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.099288  8774 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.100158  8117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2416) took 1715 ms. Trace:
I20260709 13:05:03.087585  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.100804 12870 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.130785  8267 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:03.129967  8807 rpcz_store.cc:276] 0709 13:05:01.741408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.747796 (+  6388us) service_pool.cc:224] Handling call
0709 13:05:03.036427 (+1288631us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b540062e654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:03.054821 (+ 18394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144263040}
I20260709 13:05:03.130955  8117 rpcz_store.cc:276] 0709 13:05:01.385154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.573675 (+188521us) service_pool.cc:224] Handling call
0709 13:05:01.577463 (+  3788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.728163 (+150700us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:02.195183 (+467020us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.612584 (+417401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.612640 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:02.612696 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.097924 (+485228us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b1800498d00. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c092a6 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419
0709 13:05:03.099759 (+  1835us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400003554. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:03.099935 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.100093 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31882,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":81,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":13222,"spinlock_wait_cycles":350463744,"thread_start_us":576321,"threads_started":2,"wal-append.queue_time_us":391671}
W20260709 13:05:03.137532  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 170643us
I20260709 13:05:03.138466  8089 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:03.127068  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 135916us
I20260709 13:05:03.127375  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.131538  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.139844  8089 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.151623  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:03.151737  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 51271.5us
I20260709 13:05:03.152441  8274 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:03.152925  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.126299 13084 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.134855 12745 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.133471 12892 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:03.133760 13177 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:03.160868  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:03.161793  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 62635.4us
I20260709 13:05:03.138006 13311 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:03.179044 13152 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:03.179746 13152 consensus_queue.cc:1243] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:03.179383 13311 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.182509  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:03.183322  8270 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.185660 13315 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:03.186241 13315 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:03.186602 13315 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:03.186852 13059 consensus_meta.cc:287] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.527s	user 0.015s	sys 0.002s
I20260709 13:05:03.190246  8088 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:03.191541  8088 consensus_peers.cc:597] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.193496  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.195235  8117 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:03.197428 13227 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.197932 13227 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.198540 13227 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.150408 13243 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.201586 13243 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.202003 13243 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.167909 13246 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.168220 12870 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.205940 13255 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.207999 13305 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.197022  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:05:03.186852  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.215178  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.215432 13308 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:03.166966 13314 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:03.219231  8199 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:03.220685  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.222265  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.223176 12870 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:03.223657  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.223673 12870 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.225086 12870 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:03.228210 13247 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.197053 13169 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.232937 13177 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.233542  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.233470  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.234485  8116 raft_consensus.cc:2410] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:05:03.144299 12978 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:03.168658 13084 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.250941 13177 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.170012 13139 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.253264  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.253598 13139 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.254024 13139 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.255319  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:03.258006 13218 consensus_meta.cc:287] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.008s
I20260709 13:05:03.164310 13307 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:03.144083 12946 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:03.173691 13138 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.259306 12946 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:03.261544 13218 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.267786 13218 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:03.268848  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:03.272989  8019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 169) took 15647 ms (client timeout 15000 ms). Trace:
I20260709 13:05:03.168591 12949 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.235284  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:03.178166  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 119555us
I20260709 13:05:03.303684  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:03.305311  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:03.235291  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.253042 13084 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.261559 13245 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:03.171665 13294 log.cc:927] Time spent T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.426s	user 0.004s	sys 0.002s
I20260709 13:05:03.280138 12946 ts_tablet_manager.cc:1434] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.468s	user 0.008s	sys 0.018s
I20260709 13:05:03.284261 13150 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:03.175930 13298 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.289635 13247 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:03.291620 12870 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.232978  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:03.316304  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.326519  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.326774  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:03.340102  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.329149  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 337921us
I20260709 13:05:03.342774  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.301524 13243 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.336045  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:05:03.328452  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 349234us
I20260709 13:05:03.340209  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.347489  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.342957  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.340130  8118 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:03.345829  8805 raft_consensus.cc:2410] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:05:03.327845 13258 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:03.338327  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 274983us
I20260709 13:05:03.346091  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.347930  8809 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:03.348635  8808 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:03.348083  8124 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:03.350214  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:03.350255  8117 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:03.349985  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:03.351011  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.352640  8804 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 10.
I20260709 13:05:03.353549  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:03.353904  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 188217us
I20260709 13:05:03.354951  8268 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:03.356588  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.357390  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.358203  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.354156  8802 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:03.358847  8810 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:05:03.360420  8810 pending_rounds.cc:85] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 8
W20260709 13:05:03.361620  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 202574us
I20260709 13:05:03.362032  8089 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.359381  8777 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:05:03.332026 12946 ts_tablet_manager.cc:1467] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Tablet startup took 532ms
I20260709 13:05:03.362957  8803 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:03.368371  8123 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:05:03.367182  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.362378  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.363925  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.364717  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.344344 13180 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:03.360608  8810 pending_rounds.cc:107] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:05:03.374001  8810 raft_consensus.cc:2889] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.370867  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.370508  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:03.388339  8271 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:03.354085 13164 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:03.371757  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.351801 12745 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.386756  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.386763  8089 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.359323 13213 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:03.396807  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 91712us
I20260709 13:05:03.370445 13263 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.345984 13139 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.393570  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.359856 13247 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:03.389962  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.394825  8091 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:03.420485  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 56030.3us
I20260709 13:05:03.394006 12892 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:03.392902 13218 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:03.372155 13253 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:05:03.401427 13177 raft_consensus.cc:2804] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:03.404058  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.414582 13150 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.405992  8116 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:03.406736  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.407521  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:03.409036  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.437486  8122 raft_consensus.cc:2368] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14.
I20260709 13:05:03.390830  8272 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:03.413995  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.434221  8125 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
W20260709 13:05:03.414225  8237 connection.cc:256] RPC call timeout handler was delayed by -2.3080336620000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 13:05:03.367761  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.418470 13263 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:03.438414  8192 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:03.392453 13305 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:05:03.443746  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.423375  8268 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:03.397002 13308 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:03.429574  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:03.431250  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.400736  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:03.404652 12980 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:03.427524 12892 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.437494  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.401535  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.418522  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.373629 13180 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:03.395262  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:03.438730  8237 connection.cc:256] RPC call timeout handler was delayed by -2.2306336620000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 13:05:03.305611  8019 rpcz_store.cc:269] 0709 13:04:47.625230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.625455 (+   225us) service_pool.cc:224] Handling call
0709 13:05:03.272722 (+15647267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:57.346167 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:57.346699 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:57.346731 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:04:57.346748 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:57.465518 (+118770us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:57.465579 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:57.465607 (+    28us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:04:57.466833 (+  1226us) tablet.cc:701] Row locks acquired
0709 13:04:57.466858 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:04:57.466989 (+   131us) write_op.cc:270] Start()
0709 13:04:57.467104 (+   115us) write_op.cc:276] Timestamp: P: 1783602297466947 usec, L: 0
0709 13:04:57.467125 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:57.467744 (+   619us) log.cc:844] Serialized 7052 byte log entry
0709 13:04:58.534387 (+1066643us) op_driver.cc:464] REPLICATION: finished
0709 13:04:59.432133 (+897746us) write_op.cc:301] APPLY: starting
0709 13:04:59.440810 (+  8677us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:00.618740 (+1177930us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:00.618857 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:01.320153 (+701296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:01.320576 (+   423us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:05:01.320639 (+    63us) write_op.cc:312] APPLY: finished
0709 13:05:01.321275 (+   636us) log.cc:844] Serialized 164 byte log entry
0709 13:05:01.565297 (+244022us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.669680 (+104383us) write_op.cc:454] Released schema lock
0709 13:05:01.669763 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:01.919975 (+250212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.920016 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1488666,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":824313,"apply.run_cpu_time_us":87945,"apply.run_wall_time_us":2505106,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79475,"num_ops":18,"prepare.queue_time_us":717428,"prepare.run_cpu_time_us":63235,"prepare.run_wall_time_us":526582,"raft.queue_time_us":511610,"raft.run_cpu_time_us":28846,"raft.run_wall_time_us":359810,"replication_time_us":1051434,"thread_start_us":1251239,"threads_started":5,"wal-append.queue_time_us":729679,"wal-append.run_cpu_time_us":17555,"wal-append.run_wall_time_us":2114145}]]}
I20260709 13:05:03.421202 12745 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.440639  8196 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:03.441583  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:03.515605  8237 connection.cc:256] RPC call timeout handler was delayed by -2.1793336620000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 13:05:03.516623  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.448239  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.516992  8200 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.516923  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.517725  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.518350  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.518512  8196 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:03.517863  8237 connection.cc:256] RPC call timeout handler was delayed by -2.139733662000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 13:05:03.514694  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:03.519420  8237 connection.cc:256] RPC call timeout handler was delayed by -1.1767336620000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3089s for a response
I20260709 13:05:03.504010  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.519753  8192 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
W20260709 13:05:03.470187  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.519109  8195 raft_consensus.cc:2410] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:05:03.448855 13263 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.514873  8199 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.521705  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.521046  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:03.522424  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 127679us
I20260709 13:05:03.523195  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:03.523933  8195 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:03.525956  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.430874 13218 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.516301  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.417429 13320 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:05:03.535391 13180 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.421649 13213 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.536330  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.537599  8117 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:03.537902  8809 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:03.535950  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.539681  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.540266  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.538578  8193 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:03.435539 13177 raft_consensus.cc:697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:03.539108 13218 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.439597 13084 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.542788  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:03.544787  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:03.546598  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.514164 12980 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.515556 12892 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.553930 13331 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:03.438534 13323 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 13:05:03.512081 13321 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:03.442474 13150 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:03.589829 13325 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:05:03.520816 13327 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:03.549422 13135 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:03.593214 12980 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.535317 13139 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.526924 12745 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.532797 13255 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.433530 13247 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.535979 13243 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.561417  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:03.591396  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.552037  8089 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.514417 13308 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:05:03.655995  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 104059us
I20260709 13:05:03.598933  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:03.505721 13068 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.606485  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:03.561153 13164 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:03.657512  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 221423us
I20260709 13:05:03.658377  8803 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.605911  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.557754  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.618423  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.659795  8193 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.593830 13084 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.619320  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:03.561321 12995 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:03.672290  8089 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.596764 13180 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.635874  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:03.639144  8271 raft_consensus.cc:2468] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:03.632325 13135 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:03.640851  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 43736.8us
I20260709 13:05:03.679287  8777 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:05:03.609818  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 212992us
I20260709 13:05:03.661057  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:03.607899 13298 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:03.663712 13308 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:03.618527 13246 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:03.664319  8810 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 8 LEARNER]: Advancing to term 10
I20260709 13:05:03.643707 12745 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.669186  8270 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
W20260709 13:05:03.654040  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 111331us
I20260709 13:05:03.682302  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.689621  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.657924 13164 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.703981  8804 raft_consensus.cc:2410] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:03.669636 13139 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.705874  8194 pending_rounds.cc:85] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 8
I20260709 13:05:03.706215  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.707379  8116 raft_consensus.cc:2410] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:05:03.718348  8194 pending_rounds.cc:107] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:05:03.651005 13255 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:03.700742 13315 consensus_meta.cc:287] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:05:03.726506 13255 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:03.721822  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:03.727011 13315 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.727953 13253 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:03.689301 13246 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:03.728494 13246 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.729240  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.724386 13333 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.730161 13333 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.727505 13068 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.730608 13258 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.730494 13333 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.730789 13315 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.733759 13108 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:03.734390 13108 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:03.734376  8803 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:03.735620 13084 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.703297 13164 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.737619 13253 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:03.738152 13253 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.738477 13253 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.680250 13169 consensus_queue.cc:1059] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:03.741725  8194 raft_consensus.cc:2889] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.682363 13322 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:03.708326  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 102558us
I20260709 13:05:03.695106 13324 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.746096  8199 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
W20260709 13:05:03.746531  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.748739  8193 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:03.743927 13322 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.662638 13327 consensus_queue.cc:1059] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:05:03.694414 13311 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:03.744495  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:03.695329  8022 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.709107 13139 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.755959  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.753706  8089 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:03.754462  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 196814us
I20260709 13:05:03.763664 13255 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:03.768199  8191 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:03.777426 13139 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.758050 13311 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.779145 13311 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.781935 13247 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:03.782495 13338 raft_consensus.cc:2804] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:03.700944 13177 consensus_queue.cc:237] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.789805 13316 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:03.790441 13316 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:03.791265 13316 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.709157 13307 consensus_queue.cc:1059] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:05:03.755998 13322 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:03.797839  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:03.782596 13135 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:03.751621 13227 consensus_meta.cc:287] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.553s	user 0.000s	sys 0.012s
W20260709 13:05:03.816773  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 60809.1us
I20260709 13:05:03.731037 13258 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.821842 13258 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:03.825841  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 81447.5us
I20260709 13:05:03.817890  8196 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:03.760877 13243 raft_consensus.cc:3055] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:03.751886 13324 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:03.820443 13333 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:03.827373  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 121847us
I20260709 13:05:03.839517  8195 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:03.819346 13327 raft_consensus.cc:3055] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:05:03.846812  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 167632us
I20260709 13:05:03.848827  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:03.850045  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:03.849570  8270 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.796591 13330 raft_consensus.cc:3055] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:03.805685 12995 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.848301 13253 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:03.849625 13300 consensus_meta.cc:287] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.831s	user 0.013s	sys 0.004s
I20260709 13:05:03.868214  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:03.873592  8271 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:03.849745 13324 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.839422 13243 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:03.874792  8270 raft_consensus.cc:2468] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:05:03.860834 13330 raft_consensus.cc:740] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:03.849229 13327 raft_consensus.cc:740] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:03.879784 13213 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:03.886596  8198 raft_consensus.cc:2368] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15.
I20260709 13:05:03.886817 13253 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.887347 13329 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:03.891599  8200 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:03.838990 13227 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.893677  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.893985  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.894352  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:03.800839 13139 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.004294  8199 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:03.896281  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:03.858359  8022 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 7, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 7 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.003785  8811 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:03.901372  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 214016us
W20260709 13:05:03.899396  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 50416.5us
I20260709 13:05:03.861630 13338 raft_consensus.cc:697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:03.873726 12995 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.011793 13152 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:03.864667 13263 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.895167 13164 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:03.971964  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.972860  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 71634.7us
W20260709 13:05:03.970695  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 66287.1us
I20260709 13:05:03.897691 13339 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:03.989571 13218 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.991526 12745 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.991592 13311 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.993481 13308 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:03.972570 13177 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.902904 12949 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
W20260709 13:05:03.368656 12946 ts_tablet_manager.cc:1469] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Trace:
0709 13:04:52.210390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.210492 (+   102us) service_pool.cc:224] Handling call
0709 13:04:52.493907 (+283415us) ts_tablet_manager.cc:934] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
0709 13:04:54.612783 (+2118876us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:55.323515 (+710732us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:55.323631 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:55.818295 (+494664us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:55.875916 (+ 57621us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:55.927966 (+ 52050us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:55.983624 (+ 55658us) inbound_call.cc:177] Queueing success response
0709 13:04:57.816475 (+1832851us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:02.833999 (+5017524us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:02.899416 (+ 65417us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:02.900835 (+  1419us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":9099,"raft.queue_time_us":4057,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":176,"tablet-copy.queue_time_us":114859,"tablet-download-pool.queue_time_us":14630,"tablet-download-pool.run_cpu_time_us":1459,"tablet-download-pool.run_wall_time_us":904083,"thread_start_us":251735,"threads_started":2}
I20260709 13:05:04.054620  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.055212  8271 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.014309 13333 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:04.015174  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 118986us
I20260709 13:05:04.055636 13169 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:04.056231  8091 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.056962 12949 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:04.058844 13258 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.015708 13213 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.060894 12949 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:04.016270 12995 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:03.899479 13305 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:03.877992 13300 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.062314  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.062559 13343 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:04.062925 13343 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:04.062935  8272 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:05:04.063741 13343 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.018015  8022 catalog_manager.cc:5697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 7 to 8, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 8 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:04.064883 13343 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.066133  8272 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.068076 13150 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.010679 13330 consensus_queue.cc:260] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:03.876610 12980 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:04.069736 13330 raft_consensus.cc:3060] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.070924 12980 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:04.020270  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:04.071969  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 51812.6us
I20260709 13:05:04.072446  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:04.072731  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:04.074301  8272 raft_consensus.cc:1240] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:04.020663 13338 consensus_queue.cc:237] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:04.019426 13314 consensus_meta.cc:287] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.004s
I20260709 13:05:04.076213  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:04.077478 13308 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.022622 13139 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.011405 12870 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.010905 13227 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:04.079468 13327 consensus_queue.cc:260] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.061740  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.082276  8271 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:04.023324  8199 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:04.003084 12892 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.089495 12892 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.026955  8268 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:04.031316  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:04.090706  8195 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:05:04.035032  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:04.030983 13339 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.091603 13339 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.091639  8803 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:05:04.092877  8266 raft_consensus.cc:1240] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.093778 13311 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:04.094708  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.094990 13305 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:04.095438 13305 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.039640  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.095685  8022 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 5, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 5 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.096930  8197 raft_consensus.cc:2368] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14.
I20260709 13:05:04.040340 13164 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.047483  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.049724 13263 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.030591  8200 raft_consensus.cc:2955] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:04.112681  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.110781 13305 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.147701  8198 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.149933 13059 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:04.035526 13243 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.150916 13317 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:04.028779 13322 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.152051 13307 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:04.152400 13307 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:04.153472 13322 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.153163 13307 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.149446 13305 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.109751  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.137704 13327 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:04.126708  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50575.5us
W20260709 13:05:04.121515  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.158639  8777 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:05:04.146045  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 47851.3us
I20260709 13:05:04.110139  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:04.126484  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 269512us
I20260709 13:05:04.160344  8197 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 13: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:04.113797  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:04.125052  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 47766.3us
I20260709 13:05:04.113027  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.052696 13218 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:04.064097 13300 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:04.022814 13246 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.083272 13253 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:04.184543  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.083961 13344 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.184844  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.185271  8267 raft_consensus.cc:2393] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:04.084867  8810 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:05:04.085789  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:04.087546  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.026162  8811 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:04.150902 13059 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:05:04.149842  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 106094us
I20260709 13:05:04.199679  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:04.157933  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49718.7us
I20260709 13:05:04.189769  8088 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:04.050916 12745 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:04.001829 13324 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.003883 13329 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:04.161554  8194 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:04.210093  8267 raft_consensus.cc:1240] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:04.210882  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 125395us
I20260709 13:05:04.211571  8267 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:04.213181  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.213531 13253 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:04.214003  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:04.214612  8803 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.219266 13307 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.218885 13059 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.210326 13315 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:04.222437 13315 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.222767 13315 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.223897 13329 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.225337 13329 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.208325  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.169605  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.171530  8777 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:05:04.235738  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64295.1us
I20260709 13:05:04.177301  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.110232 13258 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.180088  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.180774  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.183588  8272 raft_consensus.cc:1240] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.124568 13314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44846 (request call id 32) took 3093 ms. Trace:
I20260709 13:05:04.205616  8269 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:04.205485  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.186406  8810 pending_rounds.cc:85] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 11
I20260709 13:05:04.243731  8810 pending_rounds.cc:107] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:05:04.244014  8810 raft_consensus.cc:2889] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:04.214207 13253 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:04.206188  8238 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.200444  8089 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.236676  8803 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:04.177305 13335 raft_consensus.cc:2804] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:04.239852  8273 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:05:04.246258  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.232482  8811 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEARNER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:05:04.252044  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51681.7us
I20260709 13:05:04.254104  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.099622 13177 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.251829  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:05:04.257221  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 51132.8us
I20260709 13:05:04.258751  8163 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.116426 13339 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.208025 13243 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.261454 13245 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:04.266041  8274 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.251881 12870 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:05:04.265762  8089 leader_election.cc:400] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15.
I20260709 13:05:04.271144  8089 leader_election.cc:403] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.240309 13300 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.278347  8806 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:04.278725  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:04.265933 12956 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:04.243085 13327 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:04.263475 13324 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:04.291334  8270 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:04.256417 13164 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:04.264104 13169 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:04.293771  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 124259us
I20260709 13:05:04.294690  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.295209  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.295722  8803 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:04.297079  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.299741  8775 leader_election.cc:400] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14.
I20260709 13:05:04.300052  8775 leader_election.cc:403] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.300756  8810 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:04.270633 13335 raft_consensus.cc:697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:04.303251  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.312026  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.312397  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.313066  8116 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:04.303563  8117 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:05:04.302098  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.314534  8125 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:04.302593  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.302042  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.306460  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.307826  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.316751  8807 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:05:04.288329 13327 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.313139  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.316996  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.295248 13258 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.324322  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.297971 13317 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.301559 13323 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:04.328377  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:04.326274  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61413.2us
I20260709 13:05:04.311780 12956 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:04.301539 13300 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:04.301764 13298 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:04.305902 13169 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:04.338671  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.339359  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.347829  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.339947  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.327199 13327 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.320479 13068 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14.
W20260709 13:05:04.356680  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.341449  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.358722  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.366914 13305 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:04.367394 13305 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:04.367830 13305 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.369064 13245 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.369572 13245 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.377450  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.378933  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:04.367720 13150 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:04.381402  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.389459  8274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
mode: GRACEFUL
new_leader_uuid: "65d66cd655cd4400b079b4427061ca5e"
 from {username='slave'} at 127.0.0.1:38292
I20260709 13:05:04.390221  8274 raft_consensus.cc:606] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Received request to transfer leadership to TS 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:04.390540  8274 raft_consensus.cc:614] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:04.390980 13169 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.393677  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.394810  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.394991  8116 raft_consensus.cc:1240] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.395478  8265 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:05:04.396346 13351 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:04.397531  8269 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:04.397746 13335 consensus_queue.cc:237] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.398990  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:04.400519  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 157505us
I20260709 13:05:04.401526 13300 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.402441 13139 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:04.402875 13322 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:04.397679  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.403360 13322 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.403954  8271 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.408169  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.408784  8118 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:04.409830  8192 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.413362  8121 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:04.418723  8194 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 10.
I20260709 13:05:04.419415  8196 raft_consensus.cc:1240] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:04.349792 13164 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:04.402565  8088 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:04.424095  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.346884 13323 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:04.422241  8125 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:04.425762  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.426730  8193 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:05:04.428838  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 99055.3us
I20260709 13:05:04.380815  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.437029 13333 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:04.438439  8774 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.438732  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:05:04.439525  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58934us
I20260709 13:05:04.440088  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.440532  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:04.445787  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.446599  8118 raft_consensus.cc:2393] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:05:04.448817  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46339.7us
I20260709 13:05:04.459044  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.381659 13150 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:04.470706  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.331061 13253 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.480304  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.481755 12892 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.480963  8198 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:04.477703  8089 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.491948 12745 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:04.492471 12745 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:04.494519  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.495585 12745 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.493332  8271 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:05:04.403007 13139 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.466326 13135 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.510195  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:04.514792  8125 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.511269  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.479758 13227 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:04.519371  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 81018.4us
I20260709 13:05:04.514032 12956 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.508963 12892 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:04.522792  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 82330.4us
I20260709 13:05:04.525657  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.501883 13333 raft_consensus.cc:2764] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:05:04.528689  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.466140 13108 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:05:04.500780 13344 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:04.530934  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.526784  8196 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:04.477048 13343 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:05:04.555138  8809 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:04.529114 13298 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:04.530643 13135 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:04.572486  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 43882.8us
I20260709 13:05:04.563148  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:04.565567  8134 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-446d688479d34112bfc4ab0afb09d6f5 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:05:04.535966 13180 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:04.517647 13348 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:04.243208 13314 rpcz_store.cc:276] 0709 13:05:01.031561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.037597 (+  6036us) service_pool.cc:224] Handling call
0709 13:05:01.403962 (+366365us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b58008fa8d0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24c840aa 00007fbd24d06447 00007fbd24d2370a 00007fbd24d2476a 00007fbd24d2391b 00007fbd24d2f03c 00007fbd24d2e6b3 00007fbd24d269fa 00007fbd29cee4c9 00007fbd2326ac54
0709 13:05:01.537810 (+133848us) log.cc:844] Serialized 494 byte log entry
0709 13:05:02.642368 (+1104558us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5400449ba0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24ca1142 00007fbd24c81eaa 00007fbd24c88d53 00007fbd24c88cd9 00007fbd24c88c69 00007fbd24c88c31 00007fbd24c87dfd 000000000038f354 000000000038f199 00007fbd21c3b475
0709 13:05:03.054240 (+411872us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b180014dee0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:04.075233 (+1020993us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.124465 (+ 49232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214592,"raft.queue_time_us":111068,"raft.run_cpu_time_us":4856,"raft.run_wall_time_us":1216092,"spinlock_wait_cycles":889869184,"thread_start_us":95376,"threads_started":1,"wal-append.queue_time_us":357771}
I20260709 13:05:04.574764 13330 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.577016  8197 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.594547  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.598841 12978 consensus_queue.cc:1059] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:04.587236 13139 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.599810 13139 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.561825 13177 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.538448 13318 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.599617 13108 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:04.580917  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55339.5us
I20260709 13:05:04.590261  8134 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-446d688479d34112bfc4ab0afb09d6f5 on tablet 446d688479d34112bfc4ab0afb09d6f5 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:04.633244  8125 raft_consensus.cc:2468] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:04.638116  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.584918  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.605924  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.587679  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:04.558930 13339 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:04.643750  8117 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:04.645834  8774 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.569017 13164 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:04.641386  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e848f577948c470fb4c95fcc2b55b7ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260709 13:05:04.585297 13355 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:05:04.650456  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44636.1us
I20260709 13:05:04.558128 13059 consensus_queue.cc:1059] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:05:04.652869  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.589548 13152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53272 (request call id 16) took 15979 ms. Trace:
I20260709 13:05:04.586946 13316 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:04.665032  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:04.601034 13246 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:04.664979  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:04.665503  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.670909  8267 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:04.667769  8266 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:05:04.671521  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.674350  8200 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:04.665423 13345 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:04.653891 13068 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:04.561123 13323 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.657277 13331 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:04.681507 13139 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.670527 12978 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.684933 13135 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.685889 13298 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.587160 13150 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:04.705334  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 120508us
I20260709 13:05:04.662961 13316 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:04.718511 13316 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.720031 13316 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:04.707120  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 365191us
I20260709 13:05:04.657871 13152 rpcz_store.cc:276] 0709 13:04:48.609963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.610087 (+   124us) service_pool.cc:224] Handling call
0709 13:04:48.735220 (+125133us) log.cc:844] Serialized 499 byte log entry
0709 13:05:04.589432 (+15854212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23237,"raft.queue_time_us":24888,"raft.run_cpu_time_us":1214,"raft.run_wall_time_us":1212,"thread_start_us":462496,"threads_started":1,"wal-append.queue_time_us":438636,"wal-append.run_cpu_time_us":2441,"wal-append.run_wall_time_us":1008594}
I20260709 13:05:04.704967 13333 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:04.642076 13318 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.686362 12892 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:04.750130  8124 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:04.712373  8091 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.686425 13308 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:04.706107  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:05:04.734160  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 67445.3us
W20260709 13:05:04.806715  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 94766.9us
I20260709 13:05:04.679991 13305 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:04.809758  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 103728us
I20260709 13:05:04.831696 13320 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:04.832163 13320 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.832476 13320 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.833488 12995 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:04.847637  8198 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:04.693256 13348 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:05:04.850895  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:04.851611  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:04.714578 13169 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:05:04.853590 13318 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:04.856247 13305 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.859897  8199 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.839025 12892 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:04.806205 13308 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:04.865082  8806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26e50e42ace14a4db7be14613c771220"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:04.875360  8119 raft_consensus.cc:2468] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:04.874460  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.876485  8116 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 13: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:04.875403  8806 raft_consensus.cc:606] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.877410  8806 raft_consensus.cc:614] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:04.879374  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:04.879307  8088 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.881919  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:04.885936  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.892277  8197 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
W20260709 13:05:04.865849 13363 log.cc:927] Time spent T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:05:04.894413 12892 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:04.895358 12892 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.897245  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.898939 13379 consensus_queue.cc:1059] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:04.899456  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:04.889843 13245 consensus_meta.cc:287] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.002s
I20260709 13:05:04.900511 13245 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.902215  8810 raft_consensus.cc:1240] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:05:04.903030  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:04.885155  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:04.920476  8269 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:04.887239 13344 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:04.931203  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 58331.8us
W20260709 13:05:04.932132 13243 consensus_meta.cc:287] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:05:04.935865 13378 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:04.936280 13378 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.936704 13378 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:04.937037 13317 consensus_meta.cc:287] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.001s
I20260709 13:05:04.937463 13317 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15.
W20260709 13:05:04.940099 13327 consensus_meta.cc:287] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:05:04.940527 13327 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.864313 13380 consensus_queue.cc:1059] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:05:04.941709 13059 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:04.942277 13380 consensus_queue.cc:1059] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:04.944016 13245 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:04.944664 13318 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:04.946589 13315 consensus_meta.cc:287] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.000s
I20260709 13:05:04.946949 13315 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.932296 13227 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:04.949085 13227 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:04.949704  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46787us
I20260709 13:05:04.950248 13164 raft_consensus.cc:3055] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:04.950038 13227 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.950626 13164 raft_consensus.cc:740] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:04.951388 13164 consensus_queue.cc:260] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:04.952351 13308 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:04.953796 13308 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.947961  8123 raft_consensus.cc:2368] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 16. Current term is 17.
I20260709 13:05:04.887895 13329 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.956965  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:04.957670  8122 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:04.864907 13333 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:05:05.084322  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:05.079195  8270 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:04.930150 13330 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:05.085244  8125 raft_consensus.cc:2393] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:05.087164  8269 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:05.085883  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:05.103943  8269 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:05.131433  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.904949 13314 consensus_queue.cc:1059] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
W20260709 13:05:05.133484  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 47657.7us
W20260709 13:05:05.132368  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49335.4us
I20260709 13:05:05.135193  8124 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
W20260709 13:05:05.080878 13357 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:05:05.135924  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 229940us
W20260709 13:05:05.136338  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 250503us
I20260709 13:05:05.137540  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:04.927165 13305 consensus_queue.cc:1059] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.174s
I20260709 13:05:05.111161 13164 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:05.142118  8163 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.147270  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:05.146816 13320 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.152297  8807 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:05.153272 13320 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.137490 13316 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:05.158453  8116 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:05.142875 13323 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:05.171437  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet bc9f1ca41df6462b902893527ceb3878: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:05.150153 13258 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:05.160743 13305 consensus_queue.cc:1243] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:05.160301 13316 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.174062 13323 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:05.178587 13379 consensus_queue.cc:1243] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:05.183753 13387 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:05.181854 13316 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.186447 13305 raft_consensus.cc:3055] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:05.221104  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 80046.2us
I20260709 13:05:05.222609  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.203929 13345 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:05.186585 13253 raft_consensus.cc:2804] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:05.198987 13387 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.194491 13393 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 13:05:05.234457  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53845.1us
I20260709 13:05:05.235407  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:05.219798 13305 raft_consensus.cc:740] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.237327  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:05.240607 13388 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:05.233469 13393 consensus_queue.cc:1243] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:05.234714 13315 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:05.247900  8269 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.251411  8271 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.269279  8269 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.225842 13378 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.236155 13253 raft_consensus.cc:697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:05:05.275219  8071 auto_rebalancer.cc:629] Failed to schedule move for tablet 55917afdf34f4dd3985df6ff71c4d019: Illegal state: Replica 9e0c7bd2e224498bb1c68be20e5b3561 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:05.273644  8271 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:05.285333  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:05.285996  8200 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.270967 12870 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:05.295482 13397 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:05:05.282033 13323 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.293332 13253 consensus_queue.cc:237] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.327710 13150 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.307030  8200 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:05:05.292466 12870 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.311558  8119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 717) took 1024 ms. Trace:
I20260709 13:05:05.290756 13387 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.313719  8269 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:05.290478 13305 consensus_queue.cc:260] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.318809 13378 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:05.341807  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 113487us
I20260709 13:05:05.332077  8775 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.318897  8120 raft_consensus.cc:1275] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:05:05.313696 13327 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.324482 13316 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.330883  8119 rpcz_store.cc:276] 0709 13:05:04.287586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.287965 (+   379us) service_pool.cc:224] Handling call
0709 13:05:05.311382 (+1023417us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400149454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:05.311498 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298435840}
I20260709 13:05:05.341981 12870 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:05.347820  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Timed out: RequestConsensusVote RPC to 127.6.215.65:38095 timed out after 1.556s (SENT)
I20260709 13:05:05.289564 13345 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:05.350200 13391 raft_consensus.cc:2804] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:05.355461  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:05.355969  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:05.361769  8118 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.344300 13388 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.357487  8119 pending_rounds.cc:85] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 11
I20260709 13:05:05.362895  8119 pending_rounds.cc:107] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:05:05.363117  8119 raft_consensus.cc:2889] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:05.358896  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:05.362277  8124 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:05.374058 13322 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.375515 13381 raft_consensus.cc:3055] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:05.376000 13381 raft_consensus.cc:740] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.375572  8118 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:05.376881 13381 consensus_queue.cc:260] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.377888  8163 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.378921 13393 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.379484 13393 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.380703 13378 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:05.381280 13378 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.381762 13345 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.382143 13378 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.383324  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.378077 13381 raft_consensus.cc:3060] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.384078  8163 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.366195 13316 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:05.402163  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54372.2us
I20260709 13:05:05.393421 13164 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:05.407006  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50482 (request call id 2626) took 1048 ms. Trace:
W20260709 13:05:05.408282  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.407516  8197 rpcz_store.cc:276] 0709 13:05:04.358121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.378629 (+ 20508us) service_pool.cc:224] Handling call
0709 13:05:05.406801 (+1028172us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540014d7d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:05.406943 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313549696}
I20260709 13:05:05.397532 13327 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:05.430548  8194 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:05.430059  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:05.431973  8196 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.436568 12870 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.421869 13164 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.406790 13391 raft_consensus.cc:697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:05.440867  8118 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:05.444621  8089 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.451170  8196 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:05.423672 13403 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.460942  8807 raft_consensus.cc:1240] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:05:05.465246 13348 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:05.479007 13246 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:05.456585 13342 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.481319 13342 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.484823 13342 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.481662 13068 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.485785 13068 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.487854 13068 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.488512 13164 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.474591 12870 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:05.472627 13317 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:05:05.493562  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:05.460079 13380 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:05:05.499121  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 95986.9us
I20260709 13:05:05.499918 13393 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.505481 13343 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:05.509769  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.511096 13380 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:05.512331 13213 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:05.512831 13311 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:05.498148 13388 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:05:05.443744 13331 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.026s
I20260709 13:05:05.521595  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:05.514772 13335 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.522070  8809 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:05.524369 13152 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:05.528903  8269 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:05.548257  8803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:05.529206  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:05.548872  8803 raft_consensus.cc:606] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.549060  8271 raft_consensus.cc:3060] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.549659  8803 raft_consensus.cc:614] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:05.529840  8270 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:05.530455  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:05.550729  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:05.521376  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:05.551941  8806 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.542089 12745 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.552839 12745 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.555037 13335 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.555686 12745 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:05.556970 13335 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.548290 13152 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:05.558559 13152 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:05.517212 13343 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:05.562350 13343 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.563249  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:05.563535 13343 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.565055  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:05.535178  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:05:05.535849  8166 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.530s (SENT)
I20260709 13:05:05.566818  8166 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:05.521904 13213 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:05.567901  8166 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.682s (SENT)
I20260709 13:05:05.568106 13258 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:05.549240 13317 consensus_queue.cc:1059] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:05:05.518136 13380 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.570034  8196 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:05:05.569868 13380 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.571086 13380 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.571768 13402 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:05.522383 13311 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:05.574683 13311 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.575554  8197 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:05.517379 13391 consensus_queue.cc:237] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.577009  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:05.577795  8199 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:05.576866  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:05.583176  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.567850 13213 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.534548  8120 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:05.544286  8804 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:05.586031 13329 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:05.586527 13329 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:05.587246  8123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53286 (request call id 718) took 1299 ms (client timeout 1556 ms). Trace:
I20260709 13:05:05.587381 13329 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:05.587668  8123 rpcz_store.cc:269] 0709 13:05:04.287834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.288041 (+   207us) service_pool.cc:224] Handling call
0709 13:05:05.587052 (+1299011us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540029b654. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:05.587189 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454028288}
I20260709 13:05:05.588423 13253 consensus_queue.cc:1059] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:05.468290 13403 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.590960 13403 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:05.592145 12745 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:05.592746  8121 raft_consensus.cc:1240] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 17. Ops: []
W20260709 13:05:05.543503 13331 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.011s	sys 0.026s
I20260709 13:05:05.593672  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:05.594372  8270 raft_consensus.cc:2393] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:05.595118  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:05.595657  8270 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:05.596381  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:05.596923  8270 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:05:05.597965  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:05.598511  8191 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:05.586050  8089 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.546747  8268 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:05.589246 13253 raft_consensus.cc:3055] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:05.592406  8194 raft_consensus.cc:1275] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:05:05.544473 13388 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.602233  8194 pending_rounds.cc:85] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 12
I20260709 13:05:05.597885  8272 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:05.597119  8196 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:05.601649  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.583850  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:05.603876  8194 pending_rounds.cc:107] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:05:05.606669  8194 raft_consensus.cc:2889] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:05.581087  8806 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:05.541105  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:05.608633 13321 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:05.627552  8265 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 10. Current term is 11. Ops: []
W20260709 13:05:05.627710  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 59826.7us
I20260709 13:05:05.610569  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:05.611389  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:05.629686  8196 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:05:05.631479  8268 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:05.609196  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:05.583639 13317 raft_consensus.cc:3055] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:05.592768 12745 consensus_queue.cc:1243] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:05.634369  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.585199 13213 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:05.633296  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 92288.4us
I20260709 13:05:05.637979  8199 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:05.639683  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.640249  8196 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:05.640568  8271 raft_consensus.cc:2468] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:05:05.603363 13253 raft_consensus.cc:740] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:05.608682 13068 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:05.631119 13402 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.635358 13393 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:05.652452  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:05.650636  8091 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.653234  8806 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 16 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:05.635285 13321 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:05.628134 13403 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:05:05.649276 13068 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.657691 13068 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:05.660480 13323 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.651558 13342 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:05:05.643395 13378 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.643522 13317 raft_consensus.cc:740] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:05.646919 13327 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:05.645531 13169 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:05.647156 13320 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:05.656926  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:05.666770  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:05.667191  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:05.645810 13345 consensus_queue.cc:1048] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:05:05.684762 12745 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.670945 13315 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.678435  8118 raft_consensus.cc:2376] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14. Re-sending same reply.
I20260709 13:05:05.654990 13393 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.683290  8088 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.678423  8120 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:05.687861 13330 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:05.688627 13388 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.666024 13394 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:05:05.693109  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.681121 13321 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.683269  8272 raft_consensus.cc:1217] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-14.9]   Dedup: 10.7->[12.8-14.9]
I20260709 13:05:05.696475  8806 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:05.696780  8272 pending_rounds.cc:85] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
I20260709 13:05:05.697055  8272 pending_rounds.cc:107] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:05:05.697274  8272 raft_consensus.cc:2889] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:05.694146  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:05.698416  8118 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:05.700937  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:05.699828  8163 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.701562  8120 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:05.703096  8804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:05.704000  8804 raft_consensus.cc:606] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.656041 13307 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:05:05.675683 13169 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.676466 13327 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.707675  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.660583 13135 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:05:05.726949  8191 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:05.729138 13391 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:05.705950 13378 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:05.752372 13378 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:05.752844 13378 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:05.757162  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.757274 13246 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:05:05.768152 13068 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.720046 13317 consensus_queue.cc:260] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.772536  8120 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:05.772938 13317 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.774070 13380 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:05.776253 13380 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.776793 13380 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.779409  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:05.780000  8117 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:05.718040 13169 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.783490  8804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:05.784065  8804 raft_consensus.cc:606] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.784355  8804 raft_consensus.cc:614] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:05.781525  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:05.799932  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.719496 13327 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.721283 13258 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:05.802008 13381 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:05.703104 13253 consensus_queue.cc:260] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.813164 13258 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:05.830176  8804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:05.831650  8804 raft_consensus.cc:606] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.817090 13380 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.819041 13381 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.833503 13258 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.841403  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:05.836897 13381 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.836352 13330 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:05.851974  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:05.852631  8198 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:05.862510 13068 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.863644  8198 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:05:05.865437  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:05.866287 13068 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:05.866927 13068 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:05.867749 13068 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:05.868356 13378 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.886801 13380 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:05.894405 13380 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.894855  8121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50790 (request call id 2345) took 1472 ms. Trace:
I20260709 13:05:05.896306  8121 rpcz_store.cc:276] 0709 13:05:04.422808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.422945 (+   137us) service_pool.cc:224] Handling call
0709 13:05:05.592594 (+1169649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.593116 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.894692 (+301576us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540029b650. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d278ad 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:05.894805 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689553664}
I20260709 13:05:05.898624 13391 consensus_queue.cc:1048] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:05.899879 13378 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:05.913472  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.913664  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2120) took 1028 ms. Trace:
W20260709 13:05:05.917871  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 967500us
I20260709 13:05:05.919924  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.921842 13300 raft_consensus.cc:2764] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:05.922472 13388 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:05.899945 13380 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.921231  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:05.914130  8273 rpcz_store.cc:276] 0709 13:05:04.885429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.885580 (+   151us) service_pool.cc:224] Handling call
0709 13:05:04.885831 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.885996 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:04.931746 (+ 45750us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.913092 (+981346us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b180000c160. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:05:05.913270 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.913324 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:05.913389 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.913464 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.913587 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739,"prepare.queue_time_us":46060,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":49998592}
I20260709 13:05:05.923070 13388 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.950434 13169 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:05.951238 13323 raft_consensus.cc:993] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:05.951951 13323 raft_consensus.cc:1081] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:05.935437 13330 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.938532 13059 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:05.978071  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 56918.7us
I20260709 13:05:05.977986  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:05.979473  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:05.979837  8197 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:05.995812  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 81607.2us
I20260709 13:05:06.004544 13345 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.005255 13345 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.008134 13345 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:06.015287  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.989683  8192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:05:06.020960  8192 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.021390  8192 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:05.990985 13298 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:06.030292 13318 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.041868 13318 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:06.042375 13318 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:06.045862 13418 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:05:06.048009  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.048839  8191 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:06.049470 13068 raft_consensus.cc:993] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:06.050022 13068 raft_consensus.cc:1081] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:06.054311  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.055339 13323 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.055796 13323 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.056113 13323 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.989053 13330 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.022794 13169 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:05.993152 13059 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.071000  8197 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:06.027204 13298 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:06.073635  8089 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.096635  8197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:36640
W20260709 13:05:06.104604  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 125214us
I20260709 13:05:06.106189  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:06.109458 13059 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:06.122776  8196 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:06.070678 13327 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.126583 13391 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:06.127230 13327 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:06.132993  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:06.133630  8194 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.067286 13300 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:05:06.139981  8192 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.101461 13298 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:06.149212  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.104149 13169 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:06.155366  8194 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:06.156980  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.142230 12956 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:06.162195 13318 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.162217 13329 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:06.163705 13329 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:06.164577 13329 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.165970 13388 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.166366 13330 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.166909 13169 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:06.167719 13169 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.170454 13323 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.170629 13258 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.172480 13323 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:06.176443 13383 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.942s	user 0.000s	sys 0.005s
I20260709 13:05:06.158236 13339 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:05:06.178128 12956 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:06.178484 12956 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:06.179298 12956 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.180426 12956 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.181828 13381 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.183566 13311 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:06.183943 13381 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.186910  8237 leader_election.cc:400] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14.
I20260709 13:05:06.187995  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:06.191072 13348 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.191642  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 594610us
I20260709 13:05:06.193023 13135 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.189071  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:06.197055  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.173048 13258 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.202787  8267 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:06.197932  8268 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:06.211048 13391 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.211714 13391 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.213428  8267 raft_consensus.cc:1275] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:06.213882 13391 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.214664  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:06.215288  8270 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.219147  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:06.219791  8200 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.221309  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:06.222103  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.224494  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.226111  8194 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:06.191576 13348 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.172493 13318 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:06.198022 13339 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:06.232344  8192 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:06.240509  8197 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.240919  8197 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:06.239653  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2122) took 1152 ms. Trace:
I20260709 13:05:06.242726  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:05:06.279937  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.243643  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.223978 13340 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:06.288590  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 48848.7us
I20260709 13:05:06.218575 13315 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:06.298098  8200 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
W20260709 13:05:06.299844  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.305946  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.310976 13329 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:06.311496 13329 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:06.312317 13329 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.306906 13327 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:06.315747 13327 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.224213 13321 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:05:06.200877 13135 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.242640  8274 rpcz_store.cc:276] 0709 13:05:05.086840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.089554 (+  2714us) service_pool.cc:224] Handling call
0709 13:05:05.089907 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.090164 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:05.135429 (+ 45265us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.979185 (+843756us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.018431 (+ 39246us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.129239 (+110808us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b1800329800. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:06.226805 (+ 97566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:06.226946 (+   141us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:06.227000 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.227069 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.239592 (+ 12523us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829562,"prepare.queue_time_us":317914,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":6731,"raft.queue_time_us":838683,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":6631,"spinlock_wait_cycles":3717504,"thread_start_us":264252,"threads_started":2}
I20260709 13:05:06.321694 13305 raft_consensus.cc:3060] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:06.322196  8197 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:06.322757 13414 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.535s	user 0.002s	sys 0.003s
I20260709 13:05:06.317049  8270 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
W20260709 13:05:06.328788  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 303743us
W20260709 13:05:06.320540 13425 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:05:06.332383  8192 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:05:06.307633 13318 raft_consensus.cc:2764] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 13:05:06.335143  8089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.324913 13327 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.340883  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.345753  8200 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
W20260709 13:05:06.348026  8166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.574s (SENT) [suppressed 19 similar messages]
I20260709 13:05:06.351143  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.351980  8200 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:06.309492 13315 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.350800  8089 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.369920  8191 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:06.369148  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 131327us
I20260709 13:05:06.374277  8271 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:06.434216  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:06.435230  8803 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:06.371877 13331 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:06.435863  8803 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:06.438424  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65630.5us
I20260709 13:05:06.420696  8777 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
W20260709 13:05:06.441531  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 93543.8us
W20260709 13:05:06.442301  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.415601 13068 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.418990  8807 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:06.446457  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.437994  8803 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:06.447629  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 70504.2us
I20260709 13:05:06.448398  8803 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.418941 13403 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.458546  8803 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:06.439507 13331 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.433820 13348 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.453197  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.455030 13379 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:06.464450 13379 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.434348 13323 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:06.467299 13379 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.467775 13323 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:06.468215 13323 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:06.468544 13440 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:06.378803 13339 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:05:06.447419 13387 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:06.459684 13437 log.cc:927] Time spent T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:05:06.476534 13135 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:06.449076 13381 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:06.450968 13068 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.468539 13323 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:06.478772 13315 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.471244 13331 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:06.489678 13152 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:06.518167  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 68129.8us
W20260709 13:05:06.516819  8166 leader_election.cc:336] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.806s (SENT)
W20260709 13:05:06.509682 13438 log.cc:927] Time spent T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:05:06.527851  8270 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:06.538985 13435 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:05:06.543833  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.544726  8268 raft_consensus.cc:2410] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:06.545920  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.546785  8273 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:06.546955 13213 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.547545  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.547796 13213 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.518471  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.550516  8191 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:05:06.540992  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.551508  8274 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:06.555079  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.470719 13403 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.585788  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.559854  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:06.624886  8270 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.625061  8192 raft_consensus.cc:2410] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:05:06.559988  8166 leader_election.cc:336] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.146s (SENT)
I20260709 13:05:06.626765  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:06.629109  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43674.7us
W20260709 13:05:06.633844  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 74008.9us
I20260709 13:05:06.637512  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.638249  8274 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:06.638715  8270 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:06.512384 13381 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.644510  8270 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:06.649045  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.653064  8120 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.653748  8270 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:06.655612 13298 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.557600 13135 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.660159  8117 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:06.662163  8123 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:05:06.560654 13393 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.628746 13315 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:06.663525  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 150221us
I20260709 13:05:06.654546  8270 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.632306 13139 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.666316  8166 leader_election.cc:336] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 2.171s (SENT)
I20260709 13:05:06.670457  8166 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:06.640911 13322 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.670442  8270 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:06.679622  8237 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:06.643392 13344 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:06.683993 13139 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.527792 13451 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.144s
I20260709 13:05:06.692405  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:06.694187 13447 log.cc:927] Time spent T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:05:06.695792  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.696180 13339 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:06.694406 13427 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.592s	user 0.003s	sys 0.000s
I20260709 13:05:06.710300 13253 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.669652 13315 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:06.714991 13315 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:06.718446  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.694388 13139 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.724740  8195 raft_consensus.cc:1275] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:06.725769  8163 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.727406 13068 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:06.727648 13388 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:06.728086  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.728284 13388 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:06.729839 13218 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:06.730764 13059 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:06.730875 13218 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:06.731268 13218 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:06.732069 13218 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.686148 13213 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.734656  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2132) took 1128 ms. Trace:
I20260709 13:05:06.735029  8271 rpcz_store.cc:276] 0709 13:05:05.606016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.641322 (+ 35306us) service_pool.cc:224] Handling call
0709 13:05:05.641628 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.374741 (+733113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.734443 (+359702us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54001beed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:06.734601 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672440576}
I20260709 13:05:06.677748 13441 consensus_queue.cc:1048] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:05:06.678610 13135 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.740412 13135 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.742267 13059 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:06.743036 13344 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.682927 13393 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:06.743412 13059 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.744509 13059 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.745613 13298 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:06.747998  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.686627 13322 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.750003 13327 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.751116 13322 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.751997 13327 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.754104  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.754694  8191 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:05:06.754225 13386 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:06.755317  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:06.756628 13386 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.759922 13386 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.760257  8269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1027) took 1165 ms. Trace:
I20260709 13:05:06.760629 13451 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.729149 13388 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.762657  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:06.760654  8269 rpcz_store.cc:276] 0709 13:05:05.595266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.645160 (+ 49894us) service_pool.cc:224] Handling call
0709 13:05:05.651400 (+  6240us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:05.993817 (+342417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.993850 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:05.999818 (+  5968us) log.cc:844] Serialized 52 byte log entry
0709 13:05:06.221308 (+221490us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:06.243844 (+ 22536us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.244035 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.244103 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.314699 (+ 70596us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b180038c6e0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:06.323078 (+  8379us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b180038c6e0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:06.538340 (+215262us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:06.716710 (+178370us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b24001fd078. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21ac19c4 00007fbd21abfacb 00007fbd21c7adc9 00007fbd21c7aa55 00007fbd21c79fb0 00007fbd248f0488 00007fbd248f0be8 00007fbd248c8398 00007fbd248c376a 00007fbd248c2bb6
0709 13:05:06.760048 (+ 43338us) raft_consensus.cc:1685] finished
0709 13:05:06.760069 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.760201 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":337071,"prepare.queue_time_us":25196,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":342442,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":21427,"spinlock_wait_cycles":251270272,"thread_start_us":186315,"threads_started":1,"wal-append.queue_time_us":220130}
I20260709 13:05:06.763252  8191 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:06.765017 13245 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.765527 13245 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.765836  8120 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:06.767503 13245 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.767971  8809 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:06.733156 13218 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:06.771543  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 79238.7us
I20260709 13:05:06.772541  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:06.774047  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:06.775689  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:06.776003  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:06.776695  8809 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:06.780962  8237 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:06.773227 13300 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:06.783422  8195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 960) took 1216 ms. Trace:
I20260709 13:05:06.789856  8195 rpcz_store.cc:276] 0709 13:05:05.561759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.568795 (+  7036us) service_pool.cc:224] Handling call
0709 13:05:05.569084 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.725146 (+1156062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.777768 (+ 52622us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540021be54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:06.777935 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2657300224}
I20260709 13:05:06.792387  8191 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:06.718369 13403 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.794395  8089 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.796275  8088 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:06.800812  8197 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:06.773078 13381 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:06.779918 13339 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:06.782418 13298 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:06.783262 12956 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:06.811677 12745 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:06.811806  8089 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:06.761140 13451 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.821060  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.826887  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:06.828717  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:06.829406  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:06.829588  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:06.829995  8803 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:06.830703 13108 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:06.830770  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.831207 13108 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.809695 13246 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:06.807113 13432 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:06.834785  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:06.836120  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.839334  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:05:06.847592  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.780153 13344 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:06.887331  8803 raft_consensus.cc:2368] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:06.888110  8807 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:06.892786  8125 raft_consensus.cc:1240] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.894193  8803 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:06.892709  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.894812  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:06.897737  8120 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:06.899264  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.900310  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.901628  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:06.855139  8270 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:05:06.903115  8270 pending_rounds.cc:85] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 10
I20260709 13:05:06.904481  8270 pending_rounds.cc:107] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:05:06.905416  8123 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:06.906630  8270 raft_consensus.cc:2889] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:06.906834  8269 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:05:06.907998  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.817695 12745 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.807317 13322 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:05:06.910915  8274 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:06.962872 13316 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:06.963070 13323 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.964264  8809 raft_consensus.cc:2368] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11.
I20260709 13:05:06.965651 13381 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:06.966425 13381 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.968428 13381 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:06.845865 13108 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.931694  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:06.933445  8197 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:06.975066  8163 leader_election.cc:400] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11.
I20260709 13:05:06.975215  8125 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 18: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:06.933780 12745 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.933981  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:06.983186  8811 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:06.983600  8811 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:06.986284  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:06.987128  8804 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:06.943804  8124 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:06.944617 13379 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.886533 13213 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:06.886152 13246 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.886989 13393 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:06.946691 13340 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:05:06.891605 13391 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:05:06.947606 13387 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.957144  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.011529  8123 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:06.890300 13305 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:05:06.885828 13348 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.973006  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:07.012744  8197 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:06.975962 13323 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:06.975551  8163 leader_election.cc:403] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:06.978823  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.907675  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 262832us
I20260709 13:05:06.984804  8811 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:06.926522  8121 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:07.003008  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.022135  8273 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:07.001902  8022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 257) took 45819 ms (client timeout 15000 ms). Trace:
I20260709 13:05:06.968722 13331 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.008674  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:06.933317 13451 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.009958  8125 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:07.000623 13246 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.051541  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:07.052565  8197 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:05:06.989951 13394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.005s	sys 0.023s
I20260709 13:05:07.018880  8116 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:07.021457  8811 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:07.005566  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.074265  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.025846  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:07.021597  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:07.040216  8271 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:07.078174  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.078645  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:07.061790  8270 raft_consensus.cc:1240] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:07.061808  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.080031  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:07.062695  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.080662  8120 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.081259  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.063587  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:07.071779  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 98833.3us
W20260709 13:05:07.082463  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:07.062609  8166 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Timed out: RequestConsensusVote RPC to 127.6.215.67:43007 timed out after 1.575s (SENT)
W20260709 13:05:07.090945  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.005704 13307 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:07.008095 13059 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:06.946712 13315 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.095115  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.101673  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.108489  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.109025  8270 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.081921  8267 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:07.109040 13455 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.109958  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.102962  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:07.070478 13444 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:05:07.105384  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 83853.3us
I20260709 13:05:07.100893  8811 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:07.110873  8269 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.049325 13432 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.104456  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.004923 13379 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.113950  8267 raft_consensus.cc:2368] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15.
I20260709 13:05:07.111099  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.118786  8274 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:07.013720 13445 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:05:07.007490 13213 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.007417 13393 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:07.128353  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.128976  8122 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:07.129484  8270 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
W20260709 13:05:07.110803 13427 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:05:07.129278  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.135805  8197 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:07.137835  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.155107  8267 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.094301  8020 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 9 to 10, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:07.024646  8022 rpcz_store.cc:269] 0709 13:04:21.163332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.163628 (+   296us) service_pool.cc:224] Handling call
0709 13:04:21.293790 (+130162us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b540006bb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c92090 00007fbd24d30f3a 00007fbd2aae71cc 00007fbd2abe537e 00007fbd290a62a4 00007fbd290a6232 00007fbd290a6161 00007fbd290a60dc 00007fbd290a5392 00007fbd2306348c 00007fbd230628c6
0709 13:05:06.982825 (+45689035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:04.490052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:04.566221 (+ 76169us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:04.566268 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:05:04.566286 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:04.566882 (+   596us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:04.566955 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:04.566980 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:04.567403 (+   423us) tablet.cc:701] Row locks acquired
0709 13:05:04.567454 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:05:04.567621 (+   167us) write_op.cc:270] Start()
0709 13:05:04.567754 (+   133us) write_op.cc:276] Timestamp: P: 1783602304567562 usec, L: 0
0709 13:05:04.567774 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:05:04.574880 (+  7106us) log.cc:844] Serialized 1684 byte log entry
0709 13:05:05.078089 (+503209us) op_driver.cc:464] REPLICATION: finished
0709 13:05:05.212991 (+134902us) write_op.cc:301] APPLY: starting
0709 13:05:05.226026 (+ 13035us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:05.308036 (+ 82010us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:05.308152 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:05.328872 (+ 20720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:05.329069 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:05:05.329121 (+    52us) write_op.cc:312] APPLY: finished
0709 13:05:05.377853 (+ 48732us) log.cc:844] Serialized 49 byte log entry
0709 13:05:05.378023 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:05.378123 (+   100us) write_op.cc:454] Released schema lock
0709 13:05:05.378165 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:05.378571 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:05.378603 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":204532,"reported_tablets":49,"spinlock_wait_cycles":137222400,"child_traces":[["op",{"apply.queue_time_us":108698,"apply.run_cpu_time_us":8008,"apply.run_wall_time_us":175158,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":246224,"prepare.run_cpu_time_us":28164,"prepare.run_wall_time_us":217101,"raft.queue_time_us":212005,"raft.run_cpu_time_us":27921,"raft.run_wall_time_us":214592,"replication_time_us":510079,"thread_start_us":478142,"threads_started":4,"wal-append.queue_time_us":136109,"wal-append.run_cpu_time_us":78605,"wal-append.run_wall_time_us":1725674}]]}
I20260709 13:05:07.020330 13387 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.148161  8192 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:07.143842  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.167913  8274 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.148451  8124 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:07.112615 13388 raft_consensus.cc:3060] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.161008  8269 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:07.162591  8195 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:07.163162  8270 raft_consensus.cc:1217] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 14.11->[15.12-17.13]   Dedup: 17.13->[]
I20260709 13:05:07.163306  8271 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:05:07.170130  8270 raft_consensus.cc:1240] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:05:07.168200  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:07.171375  8197 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:07.172545  8020 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 12 to 13, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.176458  8120 raft_consensus.cc:2468] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:07.178079  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:07.177599  8118 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:07.050148 13348 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.184468  8020 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 9 to 12, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:07.185254  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.186093  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:07.189692  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.116581 13059 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.112313 13307 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.196072  8191 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:07.199810  8197 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:07.200129  8191 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:07.139786 13321 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:05:07.207129  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:07.205289  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.208447  8269 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:07.208841  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:07.185807 13330 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.209399  8124 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.209015  8020 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 13 to 14, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.218603  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.219906  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.220329 13314 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:07.220799 13314 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.222528  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.223133  8271 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:05:07.227005  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:07.227669  8267 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:05:07.220430  8270 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:07.139865 13432 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.229274  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.233599  8269 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 18.
I20260709 13:05:07.229120  8267 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:07.232957  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.235726  8268 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:07.237030  8809 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:07.179440 13345 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:05:07.221190 13314 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.232021  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 8 to 12, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 12 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:07.244938  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:07.197252 13344 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.203862 12892 raft_consensus.cc:493] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:05:07.231386 13253 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 13:05:07.194007 13391 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:05:07.222563 13213 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.222939 13298 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:05:07.272486  8191 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:07.254392  8266 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:07.266005  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.277571  8124 raft_consensus.cc:2468] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:07.232076 13381 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:07.231814 13330 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.328284  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.279052  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.340023  8268 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:07.364524  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.361989  8273 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:07.333802  8020 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.374032  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:07.374071  8266 raft_consensus.cc:3055] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:07.374614  8266 raft_consensus.cc:740] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:07.374629  8197 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:07.259006 13139 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:07.408411 13139 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.410744 13139 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.411715  8273 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:07.412078  8273 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:05:07.314234 13462 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:07.412730  8273 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.413725  8273 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.415812 13387 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.418074 13059 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.421121  8020 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 9 to 12, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.430328  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:07.318326 13331 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.432193  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:07.422518  8268 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:07.440979  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.407512  8266 consensus_queue.cc:260] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.442771  8266 raft_consensus.cc:3060] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.421320  8273 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
W20260709 13:05:07.438067  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 225189us
I20260709 13:05:07.445789  8273 pending_rounds.cc:85] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 9
I20260709 13:05:07.447947  8270 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:07.446376  8273 pending_rounds.cc:107] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:07.448783  8273 raft_consensus.cc:2889] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:07.449908  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.450664  8273 raft_consensus.cc:2393] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:07.446262  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:07.453128  8197 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:05:07.453841  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.464274  8268 raft_consensus.cc:2368] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11.
I20260709 13:05:07.456363  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.465256  8124 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:07.278398 13329 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.153s
I20260709 13:05:07.278903 13394 consensus_queue.cc:1048] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.159s
I20260709 13:05:07.314419 13245 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:05:07.459935  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.464226  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.455245  8807 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:07.467645  8266 raft_consensus.cc:1275] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:07.483760  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.495533  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.426597 13451 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:07.490355  8775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.274776 12892 raft_consensus.cc:515] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:07.492091  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.501529  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.510991  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.511439  8268 raft_consensus.cc:2393] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:07.511626  8266 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.512305  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.512861  8270 raft_consensus.cc:2376] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15. Re-sending same reply.
I20260709 13:05:07.516140  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.516736  8270 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:07.520458  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:07.500685  8274 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:07.377503 13381 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:07.485440 13253 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.526441  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.526836  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.530920  8268 raft_consensus.cc:2376] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14. Re-sending same reply.
I20260709 13:05:07.431094 13458 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 13:05:07.494882 13323 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:07.498656 13315 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.534924  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:07.520546  8266 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:07.536736  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.537673  8273 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:07.542094  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.543789  8268 raft_consensus.cc:2393] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:05:07.502681  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 316624us
I20260709 13:05:07.494113 13449 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:05:07.585860  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.599937  8124 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:07.536762  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:07.602671  8274 raft_consensus.cc:2376] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13. Re-sending same reply.
I20260709 13:05:07.607658  8270 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
W20260709 13:05:07.734989  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:07.546821 13470 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:05:07.538300  8020 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 8 to 13, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.797526  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.798199  8270 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:07.799472  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.513929 13451 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.588965  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:07.550586 13298 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.553567 13139 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.829393  8124 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:07.540777 13450 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.259s
I20260709 13:05:07.554207 13478 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.824672  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.785104 13307 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.795476 13393 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:07.845671 13465 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.439s	user 0.001s	sys 0.000s
I20260709 13:05:07.845220  8020 catalog_manager.cc:5697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 3 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.846340 12892 leader_election.cc:290] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:07.839272 12745 consensus_meta.cc:287] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.001s
I20260709 13:05:07.846818 13315 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:05:07.847473 13461 log.cc:927] Time spent T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.394s	user 0.000s	sys 0.000s
I20260709 13:05:07.795989 13059 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:07.847384 13315 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.848153 13331 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.847632  8020 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 7 to 10, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 10 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:07.848083 13059 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.848676 13331 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.849728 13315 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:07.850555 13468 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.415s	user 0.000s	sys 0.000s
I20260709 13:05:07.850696 13331 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.851305 13478 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:07.852033 13480 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
I20260709 13:05:07.796768 13323 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:07.854465 13381 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.854898 13139 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.856271  8124 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:07.856985 13139 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.858088  8124 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:07.854436 13323 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.840217 13298 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.861804  8020 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 13, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.535925 13253 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.845269  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:07.868826  8020 catalog_manager.cc:5697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.872151 13307 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.875845 13307 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.880280 13258 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:07.880975 13258 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:07.881778 13253 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.881799 13258 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.883564 13258 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.883939 13451 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:07.847033 12745 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:07.885797  8117 raft_consensus.cc:2368] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 12. Current term is 13.
I20260709 13:05:07.887590  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40700 (request call id 910) took 1120 ms. Trace:
W20260709 13:05:07.888602 13246 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.001s
I20260709 13:05:07.887964  8806 rpcz_store.cc:276] 0709 13:05:06.765227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.768880 (+  3653us) service_pool.cc:224] Handling call
0709 13:05:06.769165 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.769700 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.769730 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.770165 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.101599 (+331434us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:07.101639 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.101710 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.885933 (+784223us) raft_consensus.cc:1685] finished
0709 13:05:07.885952 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.886066 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1043,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":331018,"threads_started":1,"wal-append.queue_time_us":489503}
I20260709 13:05:07.888991 13246 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.890583  8119 raft_consensus.cc:2368] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
W20260709 13:05:07.892493  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.872659 13393 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.872802 13449 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:07.907335  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 318417us
I20260709 13:05:07.909058  8777 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:07.911789  8020 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.903342 13478 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:07.925623  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 375882us
I20260709 13:05:07.907853 13348 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:07.929958  8271 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:05:07.931196  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.929427  8199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50494 (request call id 2343) took 2257 ms. Trace:
I20260709 13:05:07.932025  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:07.932266  8199 rpcz_store.cc:276] 0709 13:05:05.672238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.672488 (+   250us) service_pool.cc:224] Handling call
0709 13:05:05.672761 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.153661 (+1480900us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:07.153688 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.153728 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:07.153763 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.929199 (+775436us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001ae0d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:07.929242 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.929375 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":378,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":14310,"spinlock_wait_cycles":3405346048}
I20260709 13:05:07.920679 13449 raft_consensus.cc:2804] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:07.935365  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:07.936564  8271 raft_consensus.cc:2410] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:07.935685  8020 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 7 to 11, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 11 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.938124  8020 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 9 to 12, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.940752  8020 catalog_manager.cc:5697] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:07.943015  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 413490us
W20260709 13:05:07.924930 13169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.011s
I20260709 13:05:07.944594  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.949326 13495 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:07.949895 13495 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:07.950259 13495 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.907649 13393 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:07.933753 12745 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:07.940083 13314 consensus_meta.cc:287] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.002s
W20260709 13:05:07.965049  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:07.964047 13169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.007s	sys 0.011s
I20260709 13:05:07.967085  8020 catalog_manager.cc:5697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 2 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.976894  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:07.986452  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:07.968370 13449 raft_consensus.cc:697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:07.994532  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 62573.1us
I20260709 13:05:07.995669  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:07.996918  8237 leader_election.cc:400] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:07.997601  8237 leader_election.cc:403] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:07.999738  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.000660  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:07.988679 13451 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:05:07.996765 13381 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:07.983637 13314 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.020524 13464 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:08.021632 13298 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.023087 13393 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:08.024547 13388 consensus_meta.cc:287] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: Time spent flushing consensus metadata: real 0.845s	user 0.003s	sys 0.006s
I20260709 13:05:08.025861 13475 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:08.001315 13483 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:08.020666 13496 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:05:08.028182  8122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50784 (request call id 2454) took 1191 ms. Trace:
I20260709 13:05:08.032147  8271 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:07.998970 13484 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:05:08.025902 13452 log.cc:927] Time spent T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.929s	user 0.003s	sys 0.003s
I20260709 13:05:08.030114 13381 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:05:08.038630 13471 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.515s	user 0.001s	sys 0.000s
I20260709 13:05:07.996372 13253 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:05:07.996044 13495 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.051801  8122 rpcz_store.cc:276] 0709 13:05:06.837089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.837203 (+   114us) service_pool.cc:224] Handling call
0709 13:05:06.837571 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.147612 (+310041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.027952 (+880340us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000de154. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:08.028122 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669796224}
W20260709 13:05:08.037159 13108 consensus_meta.cc:287] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 1.037s	user 0.008s	sys 0.003s
I20260709 13:05:08.054183 13475 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.064360 13108 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.065764  8123 raft_consensus.cc:2368] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:08.050879 13298 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:08.058291 13381 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:08.062085 13486 log.cc:927] Time spent T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:08.058070 13449 consensus_queue.cc:237] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.063251 13495 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.052017 13393 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:05:08.061065  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 60058.7us
I20260709 13:05:08.055764 13490 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.051796 13388 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11.
I20260709 13:05:08.051393 13483 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.093883  8166 leader_election.cc:400] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 10. Current term is 11.
I20260709 13:05:08.094658 13464 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
W20260709 13:05:08.110819  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 110219us
I20260709 13:05:08.112360  8166 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:08.114456  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.114895  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:08.116118 13504 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:05:08.117583  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61304.4us
I20260709 13:05:08.119936  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.139407  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:08.113950 13298 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.120815 13511 consensus_queue.cc:1048] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:05:08.142740  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.122236 13495 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:08.122525 13388 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:08.148182  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:08.143913 13496 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:08.159294  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 44458.3us
I20260709 13:05:08.113615 13490 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.117223 13483 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.163874  8166 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:08.157382 13388 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.157970 13502 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:08.165570  8192 raft_consensus.cc:2468] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 11.
I20260709 13:05:08.178385 13509 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:08.175367  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:08.182103 13502 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.188730 13490 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.189640 13502 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.187933  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.193696  8196 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:08.194589 13509 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.195116 13509 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.195693 13432 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.197468 13501 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:05:08.207922  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.208964  8199 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:08.209523  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.206513  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.210036  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.210799  8194 raft_consensus.cc:2410] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:05:08.166072 13108 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.171489 13253 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:08.219442  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.225313  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.226238  8199 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:05:08.162676 13495 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:05:08.250273  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 43878.8us
I20260709 13:05:08.265576  8195 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:05:08.284878  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61697.2us
I20260709 13:05:08.183458 13314 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:08.287988  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 112670us
I20260709 13:05:08.292126  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2134) took 2622 ms. Trace:
W20260709 13:05:08.298198  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:08.304369 13515 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:05:08.172163 13464 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.318500 13495 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:08.318590 13323 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.319590 13323 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.322917 13323 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.330555 13388 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.335041  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.335741  8195 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:08.336839 13059 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.337689  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.340742  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.341564  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.342278  8120 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:08.341595  8124 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:08.343189  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.319226 13495 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.347530 13495 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.287227 13320 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.348862 13495 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.349561 13491 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:08.350222 13491 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.350579 13491 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.289120 13253 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.352587 13253 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.290145 13511 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:08.353618 13511 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.354470 13511 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.295959  8272 rpcz_store.cc:276] 0709 13:05:05.669626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.669802 (+   176us) service_pool.cc:224] Handling call
0709 13:05:05.683038 (+ 13236us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 13:05:05.936699 (+253661us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:06.695372 (+758673us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b18003dfba0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c38455 00007fbd287203c7 00007fbd24d329a7 00007fbd24d420bf 00007fbd24d42038
0709 13:05:06.990406 (+295034us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.200972 (+210566us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.211610 (+ 10638us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.212344 (+   734us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:07.230390 (+ 18046us) log.cc:844] Serialized 52 byte log entry
0709 13:05:07.230519 (+   129us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:07.230548 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.255228 (+ 24680us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:08.038066 (+782838us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:08.291898 (+253832us) raft_consensus.cc:1685] finished
0709 13:05:08.291920 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.292064 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292551,"prepare.queue_time_us":162520,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":124,"raft.queue_time_us":247530,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":12109,"spinlock_wait_cycles":37853952,"thread_start_us":499355,"threads_started":2,"wal-append.queue_time_us":462034}
I20260709 13:05:08.357462  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.294392  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.358210  8122 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:08.288856 13490 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:08.360288  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 65987.5us
I20260709 13:05:08.362964  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.383213  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.383543  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.349045 13320 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.394845 13320 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.390368  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.298323 13432 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:05:08.360551 13509 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:08.396955  8118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2453) took 1561 ms (client timeout 1717 ms). Trace:
I20260709 13:05:08.361758 13490 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:08.377457 13258 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:08.397909 13258 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.398831 13258 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.391247  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.401854  8272 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:08.402354  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:08.397498  8118 rpcz_store.cc:269] 0709 13:05:06.835770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.835889 (+   119us) service_pool.cc:224] Handling call
0709 13:05:08.396805 (+1560916us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b5400003a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:08.396902 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198483840}
W20260709 13:05:08.413514  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50635.4us
I20260709 13:05:08.417219  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.283968 13298 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.409250 13490 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.419590  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.421116  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.422196  8268 raft_consensus.cc:1813] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Handling vote request from an unknown peer 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:08.421335  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 134350us
I20260709 13:05:08.422973  8268 raft_consensus.cc:2410] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:08.419677  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.423946  8274 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:08.425006  8266 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:08.422154  8265 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:08.416453 13484 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:08.416345 13139 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.431416  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.433386  8265 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:08.418236 13504 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:08.433676  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.436159  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.417438 13514 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.437093  8268 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.438890  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.439535  8265 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.437644 13504 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.443334 13504 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:08.444396  8272 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
W20260709 13:05:08.419239  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 271098us
I20260709 13:05:08.451337  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.451707  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.459735  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.469940  8237 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.450409 13514 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.471513 12745 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:08.471242  8237 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.469975 13504 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.473888 13504 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.469978  8272 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.475214 13514 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.475813 13320 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.476320 13320 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.476876 13381 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.450464 13509 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.440196 13485 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:08.468775 13340 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:08.468932 13135 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:08.458763 13152 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:08.437131 13139 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.496331  8272 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:08.482224 13500 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.499850  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.491756 13485 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.506244  8268 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:08.517416 13520 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:05:08.518047 13491 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.519033 13521 raft_consensus.cc:2804] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:08.522432  8191 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:08.503023 13320 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.511207 13485 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.525782 13520 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:08.513091 13500 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.493665 13509 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.523670 13432 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:08.540722 13381 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.542857  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.543491  8191 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:05:08.544793  8775 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.546880 13320 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:08.509374 13152 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.549412  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:08.550002  8191 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.541571 13500 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.548559 13320 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.549042 13491 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.584218  8265 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
W20260709 13:05:08.585922  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 114733us
I20260709 13:05:08.588449  8237 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.594461  8191 raft_consensus.cc:2468] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:08.595764  8775 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.586373 13521 raft_consensus.cc:697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.588517 13320 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.555506 13139 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.618392 13152 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.621121 13152 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:08.621675  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.621893 13495 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:08.622437  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.622413 13495 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.624063  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.624418 13495 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.625466  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.625900  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.626507  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.627337  8270 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:08.627748  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.628422  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.629158 13509 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.599452 13502 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:08.629849  8121 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:08.630951  8123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2463) took 1553 ms (client timeout 1918 ms). Trace:
I20260709 13:05:08.630853 13490 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:08.631409  8123 rpcz_store.cc:269] 0709 13:05:07.077830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.077962 (+   132us) service_pool.cc:224] Handling call
0709 13:05:08.630770 (+1552808us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400299d54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:08.630891 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158230784}
I20260709 13:05:08.598424 13520 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:05:08.635169 13520 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:08.635299  8272 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:08.635519 13520 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.636353 13520 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.637740  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.638269  8266 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:08.639428  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.602303 13491 raft_consensus.cc:2804] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:08.640094 13491 raft_consensus.cc:697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:08.641250 13491 consensus_queue.cc:237] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.641665  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.628456 13484 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:08.642432 13484 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.643128  8192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1000) took 1465 ms. Trace:
I20260709 13:05:08.643491  8192 rpcz_store.cc:276] 0709 13:05:07.177642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.177782 (+   140us) service_pool.cc:224] Handling call
0709 13:05:08.642959 (+1465177us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400028fd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:08.643052 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158710656}
I20260709 13:05:08.642379  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:08.633850  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.645526  8166 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:08.648856  8266 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 19.
I20260709 13:05:08.645539  8195 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:08.631429  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:08.654795  8274 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:08.650787  8238 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.656606  8237 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.658263  8237 leader_election.cc:400] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:08.658552  8237 leader_election.cc:403] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:08.659845  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.660737  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.660773  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.661429  8272 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:08.629972 13502 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.670674  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.679263  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.681260  8118 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:08.663733 13340 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:08.679565 13531 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:08.655900 13386 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:08.656894 13253 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:08.664520 13298 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:08.683612 13340 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.682194 13496 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:08.713058 13490 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.664180 13511 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:08.714062 13511 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.714969 13511 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.717185  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:08.643719 13152 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.664354 13258 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:08.680205 13533 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:08.708523 13520 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:08.682510 13509 consensus_queue.cc:1059] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:05:08.719844 13253 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.742419 13253 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.745121  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:08.747550  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.729146 13533 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.748359  8125 raft_consensus.cc:2410] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:08.752861  8195 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:08.754427 13345 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.754940 13345 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.755985  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:08.732002 13490 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.767122  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.768170  8116 raft_consensus.cc:2410] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:05:08.768395  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.768906  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:08.735159 13258 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 19 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.774262  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.683521 13502 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:08.781000  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.781206  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:08.782238  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.770638 13329 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.773243 13474 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:08.757146 13533 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.770403 13068 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:08.830226  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 49116.1us
I20260709 13:05:08.800225 13323 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:08.732121 13521 consensus_queue.cc:237] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:08.837546  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 91274.1us
I20260709 13:05:08.775796 13490 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.827747 13441 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:08.832336 13068 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.848552 13345 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.850538  8270 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:08.842319 13499 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:08.829325 13329 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.844635 13314 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:05:08.849506 13068 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:08.881589  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.882568  8811 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:08.885721 13253 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:08.886840 13253 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:08.887199 13253 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:08.887970 13253 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.863783 13490 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.864692  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.889853  8125 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:08.890710  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.891563 13329 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:08.893045 13454 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 1.784s	user 0.011s	sys 0.000s
I20260709 13:05:08.867506  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.868204  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.853456 13499 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.844035 13441 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:08.879943  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.891706  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:08.904349  8116 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:08.904982  8120 raft_consensus.cc:2393] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 11: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
W20260709 13:05:08.905108  8163 connection.cc:256] RPC call timeout handler was delayed by -1.3152765669999553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:05:08.905874  8163 connection.cc:256] RPC call timeout handler was delayed by -1.3022384869999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:05:08.905938  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.889181 13253 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.906497  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.906978  8125 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:08.907404  8811 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:08.910818 13485 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.912928 13485 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:08.914067 13388 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.914629 13388 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.917807 13152 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.922962 13484 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:08.928649  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.930531  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.931317  8124 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:08.933334  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.933938  8272 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:08.934865  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.935531  8274 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:08.936784  8091 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:08.937772  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:08.941774  8163 connection.cc:256] RPC call timeout handler was delayed by -1.2104848449999395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:05:08.942425  8163 connection.cc:256] RPC call timeout handler was delayed by -1.0470765669999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 13:05:08.952894  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:08.956373  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:08.957010  8125 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:08.960095  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 128977us
I20260709 13:05:08.917126 13388 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.964550  8774 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:08.969846 13139 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.970402 13139 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.970896 13379 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:08.971402 13379 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.971856 13379 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.846903 13258 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:08.975920  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:08.903875 13499 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.980342  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.977845  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:08.981761  8091 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:08.984156  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:08.984963  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:08.985996  8274 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:08.987128  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:08.987242  8125 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 19.
I20260709 13:05:08.987022  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.992496  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.993439  8811 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:08.995688  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:08.996459  8807 raft_consensus.cc:2368] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:08.954809 13381 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.960695 13387 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:08.978992 13329 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:09.000269  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.976737 13316 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.004277  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.999174  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.008242  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:09.017045  8274 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:08.994807 13455 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:08.995239 13068 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:09.029393  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "621c07aa07044d69b33dead0af7e7fd9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.991760 13476 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:08.983150 13510 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:09.019111  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:09.026764  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:08.992100 13537 raft_consensus.cc:2764] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:05:09.033298  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.036185  8272 raft_consensus.cc:1240] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:09.048236  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:09.046020  8274 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:09.049621  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:09.047356  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.052021  8270 raft_consensus.cc:2410] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:09.048882  8810 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:09.016085 13509 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:09.028079 13455 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.054412  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.055480  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:09.058167  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:09.004027 13381 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.060163  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.060886  8274 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:09.032397 13476 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.060115  8810 raft_consensus.cc:2393] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:09.065523  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:09.048641 13316 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.009477 13387 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.069092  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.076277  8270 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:09.071861  8777 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.082185  8163 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.083333  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.064421 13476 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.085131 13330 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.058230 13218 raft_consensus.cc:3055] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:09.087149  8804 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:09.063596 13455 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.090857  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:09.093474  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:09.069581 13474 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:09.104063  8088 leader_election.cc:304] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.102128  8237 leader_election.cc:400] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:09.112581  8237 leader_election.cc:403] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:09.114333  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:09.118521  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 134432us
I20260709 13:05:09.120602  8091 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:09.072839 13316 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.127811  8091 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.086802 13511 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:09.131161  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:09.065876 13320 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.088611 13218 raft_consensus.cc:740] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:09.106782 13449 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:09.063203 13509 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.112452 13520 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.113979 13258 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:09.118759 13330 raft_consensus.cc:2749] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:09.119123 13432 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15.
I20260709 13:05:09.129112 13484 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.133369 13152 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:09.132072 13305 raft_consensus.cc:2804] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:09.144322 13387 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.141646  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:09.149677 13379 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.155853 13139 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.156075 13520 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:09.127381 12956 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:09.127916 13381 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.130859 13316 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.127372 13482 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.178148  8809 raft_consensus.cc:1240] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:09.131330 13504 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:09.155050  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:05:09.251495  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 96488.7us
I20260709 13:05:09.209383  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:05:09.214702  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 73349.1us
W20260709 13:05:09.213196 13547 log.cc:927] Time spent T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:09.257714  8124 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:09.179184 13557 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:09.223125 13552 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:05:09.224793 13474 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.225430 13536 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.282969 13536 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.227018 13509 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:09.231473  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 148200us
I20260709 13:05:09.287992  8163 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:09.248075  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.173913 13491 consensus_queue.cc:1059] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:05:09.290607 13491 raft_consensus.cc:3055] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:09.291029 13491 raft_consensus.cc:740] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:09.139397 13511 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.213642 13152 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:09.291905 13152 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.150694 13345 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.293135 13511 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.293540 13345 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.255757  8091 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:09.260504  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:09.233075 13520 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.232002 13305 raft_consensus.cc:697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:09.178364 13258 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.213137 12745 consensus_queue.cc:1059] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:05:09.246820 13484 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:09.297026  8119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2450) took 2468 ms (client timeout 1520 ms). Trace:
I20260709 13:05:09.305732  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:09.309069  8119 rpcz_store.cc:269] 0709 13:05:06.828281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.828390 (+   109us) service_pool.cc:224] Handling call
0709 13:05:09.296797 (+2468407us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000e2254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:09.296915 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439970048}
I20260709 13:05:09.304615  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.289280  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.296679  8268 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:09.306725  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:09.279142 13558 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:09.246273 13139 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:09.293699 13511 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:09.259235 13551 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:09.298120 13307 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.306921 13345 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.318395 13381 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.325488 13566 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:09.369084 13566 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.254796 13482 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.313486 13379 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.317180  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.354548 13536 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.355436  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.245967 13218 consensus_queue.cc:260] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:09.385419  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 129699us
W20260709 13:05:09.413722  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 96620.8us
I20260709 13:05:09.332628 13551 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.430714  8091 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:09.440274  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:09.440850  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 263354us
I20260709 13:05:09.439213  8806 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:09.356776 13139 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:09.442341  8091 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:09.315411 13484 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.355611 13258 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.330067 13329 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
W20260709 13:05:09.450685  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 121516us
I20260709 13:05:09.454728  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.438190 13511 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:09.445808 13551 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:09.449276 13218 raft_consensus.cc:3060] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.447831 13381 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.464200 12745 consensus_queue.cc:1243] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:05:09.457141 13533 consensus_meta.cc:287] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.001s
I20260709 13:05:09.447922 13569 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:09.489130 13569 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:09.488940 13533 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.453145 13560 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:05:09.490020 13569 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.450279 13387 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:05:09.491096 13533 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:09.481154 13491 consensus_queue.cc:260] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.481699 13571 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:09.484027 13482 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.488452 13307 raft_consensus.cc:3055] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:09.468230 13253 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:09.430284 13379 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:09.498816  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.470765 13536 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:09.502337  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 57734.8us
I20260709 13:05:09.465631 13258 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:05:09.430835 13305 consensus_queue.cc:237] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:09.509840 13499 consensus_meta.cc:287] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.001s
I20260709 13:05:09.523981  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.524641  8192 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:05:09.505209 13307 raft_consensus.cc:740] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:09.520543  8089 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:09.515300  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 73028.8us
I20260709 13:05:09.510687 13571 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:09.526515 13381 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:09.514534 13491 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.515847 13139 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.526893 13499 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:09.540068 13563 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:05:09.540462  8807 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:05:09.541242 13561 log.cc:927] Time spent T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:09.543345 13566 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.543395  8267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1056) took 1511 ms. Trace:
I20260709 13:05:09.544075 13307 consensus_queue.cc:260] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.545266 13307 raft_consensus.cc:3060] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.544278  8267 rpcz_store.cc:276] 0709 13:05:08.031478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.032507 (+  1029us) service_pool.cc:224] Handling call
0709 13:05:08.049886 (+ 17379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:08.050245 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.050273 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:08.053684 (+  3411us) log.cc:844] Serialized 52 byte log entry
0709 13:05:09.010306 (+956622us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18003ed160. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c1de07 00007fbd2aa78ab9 00007fbd21c3a69b 00007fbd21c3893f 00007fbd21c3ac02 00007fbd248c220b 00007fbd248c7d23 00007fbd248c80d1 00007fbd24ce3a0f
0709 13:05:09.136184 (+125878us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:09.144440 (+  8256us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.145008 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.145160 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.543080 (+397920us) raft_consensus.cc:1685] finished
0709 13:05:09.543173 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.543339 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7615,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11222,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":25623,"spinlock_wait_cycles":7203712,"thread_start_us":125492,"threads_started":1,"wal-append.queue_time_us":1248326}
I20260709 13:05:09.552078 13580 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.555959 13340 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.556476 13340 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.526261 13476 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.559309 13345 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.560597 13476 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.561502 13345 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.561977  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
W20260709 13:05:09.564458 13535 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.880s	user 0.003s	sys 0.000s
I20260709 13:05:09.565706 13246 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.566599 13246 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:09.566955 13246 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.567289 13246 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:09.533898 13568 log.cc:927] Time spent T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:05:09.516784 13536 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:09.618234  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.596925  8269 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:09.620920  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.596908  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.601604  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.603791  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.604431 13482 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:09.604909  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.605597  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.607064  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.627658  8272 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.607945  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.608580  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.608656  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.610318 13379 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:09.611294  8117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50784 (request call id 2448) took 2786 ms (client timeout 1782 ms). Trace:
W20260709 13:05:09.635030  8117 rpcz_store.cc:269] 0709 13:05:06.824877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.825009 (+   132us) service_pool.cc:224] Handling call
0709 13:05:09.611091 (+2786082us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540029ac54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:09.611227 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424539392}
I20260709 13:05:09.613503 13316 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.526245 13386 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:09.614719 13484 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:09.626791  8269 raft_consensus.cc:2410] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:05:09.613129 13340 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:09.552870 13455 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.580736 13381 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.645336  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.648269 13381 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.651727 13536 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.655110 13139 consensus_queue.cc:1059] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:09.656262 13579 raft_consensus.cc:3055] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:09.656618 13579 raft_consensus.cc:740] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:09.657418 13571 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.659374  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:09.641086  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 120615us
W20260709 13:05:09.639425 13541 log.cc:927] Time spent T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:05:09.649034 13540 log.cc:927] Time spent T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.768s	user 0.002s	sys 0.000s
I20260709 13:05:09.671728  8116 raft_consensus.cc:1240] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:09.672786  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.674873  8267 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:09.633829 13258 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:09.663302 13511 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:09.611223 13520 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.684281 13464 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:09.673506 13586 log.cc:927] Time spent T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:09.702903  8267 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:09.657444 13579 consensus_queue.cc:260] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.706344 13499 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.686877 13258 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.707571  8271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2404) took 1070 ms. Trace:
I20260709 13:05:09.708768 13258 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.707947  8271 rpcz_store.cc:276] 0709 13:05:08.637049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.647025 (+  9976us) service_pool.cc:224] Handling call
0709 13:05:08.647295 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.658191 (+ 10896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.658221 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.658617 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:05:08.782396 (+123779us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:08.800569 (+ 18173us) log.cc:844] Serialized 14 byte log entry
0709 13:05:08.800825 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.800905 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.299924 (+499019us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b18003900a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b522 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:09.647880 (+347956us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:09.707384 (+ 59504us) raft_consensus.cc:1685] finished
0709 13:05:09.707408 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.707519 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12430,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":50310,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":12587,"spinlock_wait_cycles":34792064,"thread_start_us":123489,"threads_started":1,"wal-append.queue_time_us":185229}
I20260709 13:05:09.711750 13455 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.661840 13504 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.714104  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:09.714570  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 53211.5us
I20260709 13:05:09.716177  8271 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:09.639926 13482 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.720000  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:09.730764  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.713326  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:09.749899  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:09.750804  8192 raft_consensus.cc:2410] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:05:09.756119  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.756804  8267 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
W20260709 13:05:09.758118  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 44146.5us
I20260709 13:05:09.705497 13316 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.705530 13579 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.658552 13386 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.765113  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.760174  8191 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.713943 13320 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:09.770102  8119 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:09.771565  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:09.767602 13379 raft_consensus.cc:493] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:09.763902  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.775817  8192 raft_consensus.cc:1240] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:09.778039  8119 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:09.712980 13551 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.780577  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:09.760464 13464 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:09.760758 13560 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:09.784700  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.785744  8117 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:09.788519  8192 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:05:09.725034 13258 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:05:09.790931  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.792646  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.793993  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.794911  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.795660  8121 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:09.802860  8191 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:09.764721 13381 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:05:09.816143  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:09.817416  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.782968 13464 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.783154 13566 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.819483  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.785784 13554 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:09.818713  8272 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:05:09.767596 13504 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:05:09.820600  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.843622  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.779572 13379 raft_consensus.cc:515] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.821638  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.790750 13387 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.822824  8120 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:05:09.824815  8122 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:09.826117  8117 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.826292  8119 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:09.779965 13152 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.831284  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.832903  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.834685  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.835273  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.838384 13551 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.828584 13464 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.854813 13387 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.856137 13520 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.858253 13387 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.858697 13386 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.841426 13059 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.864588  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.848515  8192 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:09.849474 13379 leader_election.cc:290] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.849706 13483 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:09.852762  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.869490  8117 raft_consensus.cc:2468] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:09.869700  8200 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 8.
I20260709 13:05:09.785384 13511 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.833544 13554 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.855206  8123 raft_consensus.cc:2393] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 18: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:09.871285  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.872947  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.873531  8195 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:09.874889  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.875135  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.875488  8195 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:09.857398 13482 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:09.883435  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.885171  8119 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:09.886065  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:09.887387  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:09.874696 13554 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.855674 13246 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.890302  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:09.869889 13059 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:09.893915 13059 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:09.896075  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:09.899801  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:09.912039  8192 pending_rounds.cc:85] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:05:09.912343  8192 pending_rounds.cc:107] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:05:09.912567  8192 raft_consensus.cc:2889] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:09.912863  8192 pending_rounds.cc:107] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:05:09.913064  8192 raft_consensus.cc:2889] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:09.916210 13441 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:09.920375  8269 raft_consensus.cc:1240] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:09.920579  8163 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.923323 13152 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:09.924140 13441 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.927675  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.890944 13253 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:09.931417  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.933463  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:09.934746  8272 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 15: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:09.935768  8163 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.937070  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.937873  8274 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.939255  8163 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.941576  8199 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:05:09.944867  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.947072  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.944821  8091 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:09.940415  8123 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:09.942497  8089 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:09.951351  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.970827  8117 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:09.927927 13305 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:09.952765 13307 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:09.952913 13322 consensus_queue.cc:1059] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:05:09.938803 13387 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:09.963228  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.965492 13581 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:09.962535  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:09.999802  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.971974  8274 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:09.956087 13514 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:09.972422  8089 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:09.974191 13511 consensus_queue.cc:1059] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:09.977100 13560 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:09.960840 13566 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:09.985472  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.001513 13307 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:10.004081 13511 raft_consensus.cc:3055] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:10.004441 13511 raft_consensus.cc:740] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:10.002105  8091 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.004649 13307 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.007596 13585 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.008162 13585 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:10.009269 13322 raft_consensus.cc:3055] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:10.009675 13322 raft_consensus.cc:740] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:10.010440 13322 consensus_queue.cc:260] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.011698 13322 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.987831 13464 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.015094 13464 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:09.989688 13588 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.169s	user 0.000s	sys 0.003s
I20260709 13:05:09.996969  8118 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:09.997628  8803 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:09.998351  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:10.000367  8270 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:10.021147  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.022920 13464 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:10.023337 13464 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.023656 13464 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:10.026079  8806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 934) took 1170 ms. Trace:
I20260709 13:05:10.026497  8806 rpcz_store.cc:276] 0709 13:05:08.856055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.856187 (+   132us) service_pool.cc:224] Handling call
0709 13:05:08.856469 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:09.444315 (+587846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.025821 (+581506us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54006103d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:10.026013 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339580288}
W20260709 13:05:10.028786  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.031440  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.035331  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:10.035984  8266 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.036801  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:09.974921 13579 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:10.037832  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:10.051175  8271 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:10.038190  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 66278.3us
I20260709 13:05:10.054546  8270 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:10.042583 13537 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.043001  8267 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:05:10.043926 13475 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.044430 13514 consensus_queue.cc:1059] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:10.045631 13485 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.046399  8118 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.040014  8272 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:10.055398  8089 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:10.054661  8266 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
W20260709 13:05:10.060240  8777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.074621  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.075285  8809 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.076969  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.066504  8091 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.067090  8274 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:10.074694  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.081635  8810 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:10.037509 13581 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.088719  8271 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 19.
I20260709 13:05:10.065654 13391 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:10.057447 13579 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:10.103893  8809 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:05:10.091646  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:10.093108  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.093787  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.106899  8117 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:10.008944 13585 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.081444 13537 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.108256  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.102638  8118 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:05:10.103278 13135 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:10.090226 13560 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.118767  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.073077 13345 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:05:10.121934  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.115119 13152 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:10.081066 13485 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.103565 13571 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:10.106769 13579 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.136519 13485 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.137527  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:10.139675 13317 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:10.128675 13152 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.121166 13135 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:10.143235  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:10.145936  8122 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:10.148074  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.148792 13520 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.149250 13483 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:10.150955  8777 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.136667  8117 raft_consensus.cc:1240] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:05:10.152928  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:10.125047 13499 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:05:10.154182  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:10.124936 13557 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:10.167218  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.168170  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.168749 13502 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:10.169482 13485 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:10.097365 13581 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.181227  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:10.130445 13571 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.181901  8117 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 12.
I20260709 13:05:10.178478  8089 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:10.156644 13317 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.126717 13551 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:05:10.161180 13491 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.160171 13381 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:10.158648 13258 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:10.161003 13152 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:10.185340  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.123327 13560 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.190071  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.191529  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:10.192373  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:10.173390 13483 consensus_queue.cc:1243] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:10.175246 13245 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:10.195940  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.180177 13557 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:10.198904  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.199937 13557 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:10.200139  8804 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:10.190754 13317 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.183111 13476 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.193241 13213 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.206432 13581 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.194744 13258 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:10.207764 13258 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:10.208917 13595 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:10.174813 13520 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.211690 13520 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.212184 13520 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.188766 13571 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.197896 13491 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:10.213496 13317 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.215632 13340 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:10.214237 13491 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.220600 13560 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.222400  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:10.222939  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.215652 13135 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.227067 13386 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.227833 13386 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.230329  8803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40700 (request call id 935) took 1139 ms. Trace:
I20260709 13:05:10.231240 13245 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:10.231557 13317 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.232120 13245 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.166353 13475 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:05:10.234633  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 916) took 1240 ms. Trace:
I20260709 13:05:10.235350  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:10.235800  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.236035  8192 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.235006  8807 rpcz_store.cc:276] 0709 13:05:08.997598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.999653 (+  2055us) service_pool.cc:224] Handling call
0709 13:05:09.001629 (+  1976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.540990 (+539361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.234421 (+693431us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54005b1b54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:10.234581 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238572928}
I20260709 13:05:10.234866  8200 raft_consensus.cc:1240] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:10.238240  8200 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:10.236819  8195 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:10.239435  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:10.240025  8194 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.230696  8803 rpcz_store.cc:276] 0709 13:05:09.090506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.090622 (+   116us) service_pool.cc:224] Handling call
0709 13:05:10.230191 (+1139569us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54005b0254. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:10.230281 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068064640}
I20260709 13:05:10.244217  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.245666  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.246445  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:10.246822  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.247126  8269 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:10.247596 13246 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.247938 13386 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.253297  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:10.255575  8271 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:10.257495  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.257586  8194 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:10.260916  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:10.261884 13560 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:10.263341  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:10.264863  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:10.274363  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:10.275043  8117 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:10.279285  8116 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:10.273139  8192 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:10.281193  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.281984  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.266723 13501 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:05:10.284327  8237 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.259244 12745 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.286098  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.266062 13386 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:10.288439 13485 raft_consensus.cc:2804] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:10.291158  8802 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:10.194041 13554 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.266963 13560 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.294800  8271 raft_consensus.cc:1240] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:10.295279  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f99fd4567469babdeb05f3b4b3d27" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:10.295665  8269 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:10.293535 13608 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:10.301573 13608 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.301949 13608 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:10.308665  8265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2397) took 1684 ms (client timeout 2094 ms). Trace:
I20260709 13:05:10.296375  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:10.309092  8265 rpcz_store.cc:269] 0709 13:05:08.623844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.625191 (+  1347us) service_pool.cc:224] Handling call
0709 13:05:10.308472 (+1683281us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003b83d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:10.308592 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911600384}
I20260709 13:05:10.274056 13504 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:10.310084  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.310216  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:10.312469  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.313486 13560 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.314026 13560 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.314848 13386 consensus_queue.cc:1059] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:10.315682 13386 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:10.298225  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:10.315968 13386 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:10.280314 13502 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:05:10.299487  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:10.316977 13386 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.287441 13340 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:10.319151 13340 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.319298 13386 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.319555 13340 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.298403 12745 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.323984 12745 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.325132 13500 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:10.325616 13500 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:10.326361 13500 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.328375 13500 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.328912 13554 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.330088  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.330230  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.330687 13531 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:10.330962  8809 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:10.330127  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:10.315995  8271 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:10.317224  8266 raft_consensus.cc:1275] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:05:10.332943  8166 leader_election.cc:304] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.330698  8804 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:10.337572  8121 raft_consensus.cc:2468] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:10.332988  8266 pending_rounds.cc:85] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
I20260709 13:05:10.338272  8266 pending_rounds.cc:107] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:05:10.336827 13531 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.339299 13531 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.338515  8266 raft_consensus.cc:2889] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:10.344944  8809 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:10.330392 13485 raft_consensus.cc:697] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:10.337062 13504 raft_consensus.cc:2749] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.361228  8273 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:10.374125 13579 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.376293 13579 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.376878  8120 raft_consensus.cc:1240] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:10.377449 13606 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:05:10.377555 13388 raft_consensus.cc:3055] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:10.377974 13388 raft_consensus.cc:740] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:10.380370  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:10.317334 13571 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.383396  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.384122  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.334120 13464 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.387125  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.349817 13554 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:05:10.389501 13485 consensus_queue.cc:237] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.390933 13152 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.394788  8119 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:05:10.394948  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:10.395545  8200 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.392887  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.397701  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:10.399448  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:10.387506 13258 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.405303 13554 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:10.405740 13554 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:10.406597  8807 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:10.406474 13554 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.407542 13169 raft_consensus.cc:2749] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.407811 13554 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.388537 13340 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.410097  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.402343  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.370682 13521 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.386704 13560 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.397995 13504 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:10.434711  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:10.437546 13340 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:10.438283 13316 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:10.438766 13316 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.439227 13316 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.439549 13340 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.440096 13340 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.420517 13514 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:10.444602  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.420071 13600 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.448961  8200 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:10.437120 13618 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:05:10.455842  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:10.456586  8118 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.460078  8807 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:10.456777 12745 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:10.465018 13537 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:10.418290 13521 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.444320 13585 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:10.469306  8118 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 19.
I20260709 13:05:10.424611 13305 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:10.424403 13582 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:05:10.476091  8237 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:10.454223 13571 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.476473 13582 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:10.486950 13582 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:10.487723 13582 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.475245 13585 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:10.491997 13585 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:10.488878 13582 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:10.501935 13573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.000s	sys 0.007s
W20260709 13:05:10.502496 13573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.000s	sys 0.007s
I20260709 13:05:10.452557 13059 consensus_queue.cc:1059] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:05:10.504463 13620 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:10.488984 13316 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.514415 13316 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.516104 13152 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.516901  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.516978  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.519848  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:10.520387  8194 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:10.536090  8809 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:10.548827  8088 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:05:10.537367  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.549908  8194 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 9.
I20260709 13:05:10.549853 13579 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:10.532099 13622 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:10.511868 13620 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:05:10.582525  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 106501us
I20260709 13:05:10.584043  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:10.570690 13579 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:10.599486  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:10.573097 13464 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.572592 13623 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:10.576088 13624 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.582374 13340 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:10.584242 13258 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.589003 13485 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:10.613301 13621 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:05:10.616982 13511 consensus_queue.cc:260] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.637465 13258 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:05:10.653461  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65631.4us
I20260709 13:05:10.635113 13485 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.650491 13511 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.676754  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:10.680240  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.695572  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.701207  8809 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:10.705593  8125 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:10.628194 13624 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.654004 13521 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:10.703253 13626 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:05:10.644428 13620 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.677568 13253 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.656756 13623 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:05:10.722285  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64022.2us
W20260709 13:05:10.712816 13557 consensus_meta.cc:287] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
I20260709 13:05:10.765735 13557 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.767946 13557 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.656117 13579 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.769578 13620 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:10.714329 13625 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:05:10.655453 13258 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.713990 13059 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:05:10.743774 13485 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:10.741833 13630 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:05:10.742847 13627 log.cc:927] Time spent T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 13:05:10.743947 13618 raft_consensus.cc:3055] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:10.748636 13531 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.749279  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:10.749938 13608 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.753746  8237 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.753708  8194 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:05:10.716609 13514 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:10.781131 13246 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:10.782227  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.793035  8811 raft_consensus.cc:2393] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
W20260709 13:05:10.759002 13629 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:05:10.785908  8265 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:10.787158  8194 pending_rounds.cc:85] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:05:10.790081  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:10.797408  8194 pending_rounds.cc:107] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:05:10.799201  8194 raft_consensus.cc:2889] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:10.758522 13521 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.788772  8089 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.797545  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:10.810002  8267 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:10.783756 13618 raft_consensus.cc:740] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:10.807298  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.835551  8774 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:05:10.845990  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 48516.9us
I20260709 13:05:10.796036 13504 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.802186 13521 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.796180 13638 raft_consensus.cc:2804] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.855358  8273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2408) took 1903 ms. Trace:
I20260709 13:05:10.856210  8273 rpcz_store.cc:276] 0709 13:05:08.951907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.952047 (+   140us) service_pool.cc:224] Handling call
0709 13:05:08.952387 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:10.361705 (+1409318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.855128 (+493423us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003b88d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:10.855305 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3239465344}
I20260709 13:05:10.765172 13253 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.795655 13557 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:05:10.826829 13490 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:10.849862 13305 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:10.792737 13585 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.849542 13492 raft_consensus.cc:2804] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:10.849164 13464 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.809515 13514 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:05:10.855738 13622 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:05:10.858634 13500 consensus_meta.cc:287] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.004s
I20260709 13:05:10.875070 13253 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.875248 13608 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:10.868592 13618 consensus_queue.cc:260] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.883281 13618 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.885767 13624 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.886174 13531 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:10.848253 13623 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.876626 13464 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.888463 13464 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:10.890466 13492 raft_consensus.cc:697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:10.891356 13492 consensus_queue.cc:237] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.866307 13305 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.894727  8119 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:10.865057 13258 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.854048 13504 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.893666 13305 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.900162 13585 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:10.917126 13504 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:10.919750 13636 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.169s	user 0.000s	sys 0.004s
W20260709 13:05:10.939776  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 151080us
I20260709 13:05:10.940296 13573 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.941831  8089 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:10.942237  8810 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:10.937649 13521 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:10.947278  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.944980 13246 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:10.958127  8089 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.947613 13573 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:10.964072  8125 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:10.966280 13388 consensus_queue.cc:260] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.967804 13246 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:10.969267  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 162310us
I20260709 13:05:10.979985 13316 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:10.980749 13548 consensus_queue.cc:1059] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:10.981688 13573 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:10.976493  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.984062  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:10.984839  8124 raft_consensus.cc:2368] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19.
I20260709 13:05:10.971573 13510 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:10.978780 13504 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:10.987229  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:10.991536  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.992450 13511 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.993569  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:10.995836  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:10.977104  8802 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:10.988158  8118 raft_consensus.cc:1240] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:10.988049  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:10.989176  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:10.990438  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:10.998265  8125 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.002712  8807 raft_consensus.cc:3060] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.007377  8192 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:11.007757  8192 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:11.007917  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.008670  8194 raft_consensus.cc:2368] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 17. Current term is 18.
I20260709 13:05:11.014016  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:11.008399  8192 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:10.981766 13548 raft_consensus.cc:3055] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:11.067118  8125 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:11.016124  8192 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.018834 13317 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:11.019708 13246 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.001856 13316 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:11.024379 13388 raft_consensus.cc:3060] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.017652 13557 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:10.988685 13510 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:10.988790 13305 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.046960  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:05:11.094306  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 47425.1us
I20260709 13:05:11.094774  8089 leader_election.cc:400] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 17. Current term is 18.
I20260709 13:05:11.095124  8089 leader_election.cc:403] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:05:11.048750  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.096151  8197 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:11.049875  8196 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:11.099502  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.050467  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.103188  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.103791  8191 raft_consensus.cc:2376] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13. Re-sending same reply.
I20260709 13:05:11.104527  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.051380  8195 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:11.105983  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.107004  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.107533  8195 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:11.108273  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.051939  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.052603  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.073962  8807 raft_consensus.cc:2468] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
W20260709 13:05:11.081832  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 86069.7us
I20260709 13:05:11.083608  8198 raft_consensus.cc:1240] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.110913  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.111877  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.059275 13548 raft_consensus.cc:740] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:11.109163  8194 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:11.120733  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.122371  8194 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:11.100111  8196 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:11.124571  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.013633 13504 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.126694  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.127238  8197 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:11.119745  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:11.129328  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.093582 13258 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:11.133040  8198 raft_consensus.cc:2393] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 16: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:11.130752 13514 consensus_queue.cc:1048] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:05:11.133559 13258 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:11.111335 13557 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:11.137519 13557 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.137161 13258 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.139076 13305 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:11.125916 13482 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:11.143334  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.124010 13579 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 17. Current term is 18.
I20260709 13:05:11.146095  8191 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:11.150031  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.152756  8197 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 19.
I20260709 13:05:11.155999  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.157495  8197 raft_consensus.cc:2410] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:11.159762  8116 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:11.139811 13305 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:11.167652  8197 raft_consensus.cc:1240] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:11.171514  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 46412.4us
W20260709 13:05:11.016140 13511 consensus_queue.cc:1175] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65d66cd655cd4400b079b4427061ca5e" responder_term: 14 status { last_received { term: 11 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:11.159967 13482 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:11.233052  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.236320  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 61075.4us
W20260709 13:05:11.230288 13630 log.cc:927] Time spent T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.009s
I20260709 13:05:11.168673 13316 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:11.235132 13649 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.053s	user 0.005s	sys 0.000s
I20260709 13:05:11.173228 13510 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.265213  8197 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:11.168809 13548 consensus_queue.cc:260] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:11.269644  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 149986us
W20260709 13:05:11.256053  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 70273.9us
I20260709 13:05:11.271993  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.272852  8193 raft_consensus.cc:2410] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:05:11.275344  8195 raft_consensus.cc:1275] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:11.276188  8163 leader_election.cc:400] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19.
I20260709 13:05:11.277469  8163 leader_election.cc:403] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:05:11.245069 13557 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.283897  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:11.286437  8118 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:11.287577  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:11.288383  8120 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:11.290153  8197 raft_consensus.cc:1275] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:11.294000  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.292230  8163 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:11.294548  8193 raft_consensus.cc:3060] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.273299 13510 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.314440  8193 raft_consensus.cc:2468] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:11.332831 12745 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:11.290652 13464 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19.
I20260709 13:05:11.333674 12745 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:11.285650 13646 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:05:11.336061  8194 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:11.332463 13554 raft_consensus.cc:2804] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:11.295307 13381 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.339390 13650 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:11.343431  8802 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:05:11.345136  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:11.345779 13647 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:05:11.338546 13656 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:11.341176 12745 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:11.348242 13504 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:11.352161 13258 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.298171 13548 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:11.338771 13651 log.cc:927] Time spent T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:05:11.377281  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.381331  8200 raft_consensus.cc:1240] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:11.382717  8198 raft_consensus.cc:2410] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:11.355110 13381 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.355067 13554 raft_consensus.cc:697] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:11.449731 13554 consensus_queue.cc:237] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.450418 13258 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.294899 13482 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.473419 13557 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:11.547413  8191 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:05:11.548683  8163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.555491  8192 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:05:11.556110  8192 pending_rounds.cc:85] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 6
I20260709 13:05:11.556543  8192 pending_rounds.cc:107] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:05:11.556941  8192 raft_consensus.cc:2889] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.569015  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.571044  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.572141  8193 raft_consensus.cc:2410] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:11.573820  8198 raft_consensus.cc:1240] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.577394  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.643338 13246 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:11.648432 13152 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.657100  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.667940  8274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44554 (request call id 2442) took 1080 ms. Trace:
I20260709 13:05:11.668509  8274 rpcz_store.cc:276] 0709 13:05:10.587587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.587714 (+   127us) service_pool.cc:224] Handling call
0709 13:05:11.667398 (+1079684us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400189a54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d2c2fa 00007fbd29cedb17 00007fbd232686d4 00007fbd23268662 00007fbd23268591 00007fbd2326850c 00007fbd232677c2 00007fbd2306348c 00007fbd230628c6 00007fbd2306226f
0709 13:05:11.667659 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770958080}
I20260709 13:05:11.670234 13108 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:11.670991 13482 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:11.671871 13482 consensus_queue.cc:1243] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:11.674906  8198 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:11.680624 12745 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:11.686494  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.687512  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.692636  8121 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:05:11.696291 13643 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.757s	user 0.011s	sys 0.027s
W20260709 13:05:11.707101  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.708654 13381 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.713830  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:11.714202  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:11.719189  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:11.722024  8810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 940) took 1555 ms. Trace:
I20260709 13:05:11.722524  8810 rpcz_store.cc:276] 0709 13:05:10.166566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.166706 (+   140us) service_pool.cc:224] Handling call
0709 13:05:10.166987 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:10.943943 (+776956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.721422 (+777479us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54004d7bd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:11.721805 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782408064}
I20260709 13:05:11.732520  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:05:11.743521  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 930363us
I20260709 13:05:11.744869 13381 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:11.729099 13152 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.770740 13388 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.771713 13388 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.774345 13638 raft_consensus.cc:697] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:11.775199 13514 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:11.775959 13638 consensus_queue.cc:237] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:11.779363  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.779239 13502 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:11.784924  8238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.215.66:37313 timed out after 1.527s (SENT) [suppressed 19 similar messages]
I20260709 13:05:11.786330  8191 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:11.789822 13258 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.790550 13258 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.791671 13635 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:11.782780 13502 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.802170  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:11.786125 13381 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.810144  8199 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:11.812026 13662 log.cc:927] Time spent T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:05:11.776081 13520 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:11.798508  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:11.794600 13635 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.814499 13381 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:11.835428  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50539.8us
I20260709 13:05:11.833201  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:11.837378 13633 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:11.838321 13633 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.839691 13624 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:11.840497 13624 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.842303 13548 consensus_queue.cc:1059] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:11.842832 13510 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:11.843497 13624 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.846726 13623 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.847436 13623 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.848848 13108 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:11.850350  8238 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:11.849267 13108 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:11.852262 13108 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.862941  8273 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:05:11.843571 13628 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.888682  8199 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:05:11.906373  8272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44554 (request call id 2443) took 1041 ms. Trace:
I20260709 13:05:11.906811  8272 rpcz_store.cc:276] 0709 13:05:10.789011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.789123 (+   112us) service_pool.cc:224] Handling call
0709 13:05:10.789422 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:10.789598 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:10.792457 (+  2859us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.742817 (+950360us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b180049e7c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21bb5c0a 00007fbd2b2f5219 00007fbd21c3da40 00007fbd21c384e4 00007fbd21c38455 00007fbd24d20060 00007fbd24d32716 00007fbd24d43287 00007fbd24d43208
0709 13:05:11.763076 (+ 20259us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.785597 (+ 22521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:11.787801 (+  2204us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:11.813003 (+ 25202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.826345 (+ 13342us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.830723 (+  4378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3181,"prepare.queue_time_us":28643,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":954737,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":388,"spinlock_wait_cycles":5774592,"thread_start_us":17625,"threads_started":1}
I20260709 13:05:11.892038 13548 consensus_queue.cc:1243] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:11.902140 13108 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.880445 13624 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:11.901364 13633 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.891868 13620 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:11.924984 13619 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:11.925732 13152 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.926393  8802 raft_consensus.cc:3055] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:11.906837  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:11.912969 13623 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.938374  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:11.935317  8802 raft_consensus.cc:740] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:11.940975 13307 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.941816 13504 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.942893 13620 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.941867 13307 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:11.946074 13670 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:11.946282 13307 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.946810 13635 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:11.946628 13628 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:11.947525  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 97378.3us
I20260709 13:05:11.945101 13620 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:11.951581  8802 consensus_queue.cc:260] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.952653  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:11.952975  8238 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:11.956103 13618 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:05:11.957757 13665 log.cc:927] Time spent T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.315s	user 0.003s	sys 0.001s
I20260709 13:05:11.960335  8089 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:11.933034 13388 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.954444 13502 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:11.961395 13668 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:05:11.927831 13548 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:11.989260  8272 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:11.989566 13548 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:11.963056  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:11.964006 13514 consensus_queue.cc:1059] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:11.966157  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:11.967813  8808 raft_consensus.cc:1240] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 13:05:11.969848  8803 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 10 LEARNER]: Advancing to term 11
W20260709 13:05:11.970182 13675 log.cc:927] Time spent T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:05:11.972517  8271 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:11.974732 13608 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.956178  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 158243us
I20260709 13:05:11.935146 13619 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:11.991022  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:11.991072  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:11.994294 13624 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:11.996773 13628 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:11.998162  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:11.999543 13258 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:12.009528  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 59468.5us
I20260709 13:05:12.009954  8803 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:12.015523  8802 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.013005  8804 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
W20260709 13:05:12.023849  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 108371us
I20260709 13:05:12.017185 13548 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.029230  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:12.034488 13152 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:12.028515  8121 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:12.034709  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.036589  8272 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:12.037959  8269 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:12.021268 13619 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.040963  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:12.045194  8199 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:12.048698  8269 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:12.053022 13672 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:12.053270 13314 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.053845 13314 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.053820 13672 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:12.055742  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 103058us
I20260709 13:05:12.049522 13108 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:12.056735 13108 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.043354 13608 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.068235 13108 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.069183 13624 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:12.060886 13322 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:12.048946  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:12.051028 13623 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:12.057963  8191 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:05:12.049789 13152 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
W20260709 13:05:12.059576 13674 log.cc:927] Time spent T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:05:12.059901  8266 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:12.060396 13317 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.063045  8804 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:12.065575  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:12.080861  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:12.084048 13152 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.089578 13623 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.091073  8272 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:05:12.093758  8270 raft_consensus.cc:2393] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:12.104043  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.106565  8271 raft_consensus.cc:2410] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:12.046159 13618 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:12.114025  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 57550.3us
I20260709 13:05:12.072050 13620 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:12.115211 13317 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.120685  8271 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:05:12.121730  8803 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:12.122123 13317 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.124678  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:11.982719  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:12.130141  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.130776  8266 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:12.132103 13619 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.133080 13531 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:12.133713 13531 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.134344 13619 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.134728 13620 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:12.135625 13620 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.137563 13624 consensus_queue.cc:1059] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:12.138708 13619 raft_consensus.cc:3055] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:12.139272 13619 raft_consensus.cc:740] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:12.141609 13316 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:12.142098 13316 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.142414 13316 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:12.143100  8776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.143622  8192 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:05:12.143977  8192 pending_rounds.cc:85] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 10
I20260709 13:05:12.144196  8192 pending_rounds.cc:107] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:05:12.144418  8192 raft_consensus.cc:2889] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.145730  8191 raft_consensus.cc:1275] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:12.146548  8197 raft_consensus.cc:1275] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:12.145743  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:12.146708  8121 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:12.071610 13514 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:12.158991  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 129824us
I20260709 13:05:12.161187  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.173756 13684 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:12.177558  8116 raft_consensus.cc:2393] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:12.180261  8199 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:12.182976  8272 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:12.192592 13608 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.193585  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:12.195044 13638 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.195510 13638 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.196063  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.197367  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:12.197736  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.198333  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.198920  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.199314  8265 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:12.199668  8271 raft_consensus.cc:2368] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:05:12.198345  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.200887  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.202193 13135 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:12.204048  8273 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.199889 13633 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:05:12.209750  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:12.197532 13628 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:12.211374 13628 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.211720 13628 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:12.212203  8266 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:12.213166  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.214205  8266 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 15.
I20260709 13:05:12.215411 13314 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.215826 13623 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:12.219628 13246 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:12.222285 13618 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.197594 13638 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:12.224117 13504 raft_consensus.cc:3055] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:12.224555 13504 raft_consensus.cc:740] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:12.224845  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.225548 13504 consensus_queue.cc:260] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.226414  8265 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:05:12.226599 13504 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.229979  8268 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:12.231503  8265 pending_rounds.cc:85] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 7
W20260709 13:05:12.214505 13669 log.cc:927] Time spent T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 13:05:12.232650 13672 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.215746  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.117854 13502 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:12.237815  8265 pending_rounds.cc:107] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:05:12.244437  8265 raft_consensus.cc:2889] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:12.237813  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 119038us
W20260709 13:05:12.238297  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79369.6us
W20260709 13:05:12.241181  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.225469  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.239295  8266 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 18.
W20260709 13:05:12.256289  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.256980  8023 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 10 to 13, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 13 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.252671 13246 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:05:12.259209  8811 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:05:12.259505  8023 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 10 to 12, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 12 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:12.261055 13619 consensus_queue.cc:260] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.262545 13619 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:12.264602 13502 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:12.265853 13635 consensus_queue.cc:1175] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17c126976afd40d9a398d13a5ddd222f" responder_term: 17 status { last_received { term: 11 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 16. Current term is 17. Ops: [12.7-16.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:12.273052 13691 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:12.273514 13548 consensus_queue.cc:1048] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:12.274715 13691 consensus_queue.cc:1048] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:12.275406 13548 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:12.275797 13548 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:12.277730  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 89553.4us
I20260709 13:05:12.278771  8775 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.282939  8273 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:12.285832  8270 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:12.287236  8802 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:05:12.288863  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.224789 13618 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:12.288694  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 107037us
I20260709 13:05:12.309967  8272 raft_consensus.cc:1240] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:12.310156  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.311095  8274 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:12.308815  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.309257  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.264741 13684 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.318169 13492 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:05:12.276789 13548 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.326700 13531 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:12.309716 13510 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:05:12.334825 13684 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.338653 13391 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.341739  8238 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:12.303085 13691 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:12.307901 13635 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.261247  8023 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:12.362848  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.361891  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.345503 13108 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:12.373456  8269 raft_consensus.cc:1240] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:05:12.349560 13135 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:05:12.368221 13531 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:12.374667 13531 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:12.375046 13531 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:12.375670  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 67382.3us
I20260709 13:05:12.377429  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.379887 13314 consensus_queue.cc:1059] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:05:12.396727  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 142137us
I20260709 13:05:12.355199 13672 consensus_queue.cc:1059] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:05:12.398765  8273 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:12.385578 13691 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:12.404345  8272 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:12.383248 13381 raft_consensus.cc:493] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.357847 13635 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.410920 13635 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.384282 13108 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:12.420197  8238 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.392063 13628 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.422902 13628 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.423370  8271 raft_consensus.cc:1240] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:12.425443 13169 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:12.426050 13169 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.427374 13381 raft_consensus.cc:515] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.430508 13510 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:12.431403 13548 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.362149 13391 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:12.439066  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 81376.2us
I20260709 13:05:12.466359  8238 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:12.466200 13608 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:12.467033 13316 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.467730  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.467832 13608 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:12.468307 13608 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:12.468703 13608 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.470685  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:12.471244  8810 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:12.473510 13628 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:12.477674 13608 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.479398 13684 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.480260 13608 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.482775  8023 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:12.490113 13502 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:12.453985 13620 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:12.451634 13381 leader_election.cc:290] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.497118 13391 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:12.504771 13307 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:05:12.506345  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 55035.7us
I20260709 13:05:12.507100  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.508534  8237 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.484658  8023 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 7 to 8, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 8 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:12.469161  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:12.513198  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 133817us
I20260709 13:05:12.512801 13316 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.517275 13619 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:12.517067 13620 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:12.542068  8810 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:12.520925 13502 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:12.591471 13635 raft_consensus.cc:3055] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:12.591986 13635 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:12.592883 13635 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.598317 13635 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.601832  8023 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:12.603858  8023 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:05:12.607988  8020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 248) took 22439 ms (client timeout 15000 ms). Trace:
W20260709 13:05:12.609478  8020 rpcz_store.cc:269] 0709 13:04:50.186351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.248720 (+ 62369us) service_pool.cc:224] Handling call
0709 13:05:12.607739 (+22359019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:08.284216 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:08.304149 (+ 19933us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:08.304184 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:05:08.304200 (+    16us) tablet.cc:662] Decoding operations
0709 13:05:08.305923 (+  1723us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:08.305979 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:08.306007 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:05:08.307125 (+  1118us) tablet.cc:701] Row locks acquired
0709 13:05:08.307140 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:05:08.307304 (+   164us) write_op.cc:270] Start()
0709 13:05:08.307416 (+   112us) write_op.cc:276] Timestamp: P: 1783602308307251 usec, L: 0
0709 13:05:08.307432 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:05:08.308138 (+   706us) log.cc:844] Serialized 6732 byte log entry
0709 13:05:08.641592 (+333454us) op_driver.cc:464] REPLICATION: finished
0709 13:05:08.844776 (+203184us) write_op.cc:301] APPLY: starting
0709 13:05:08.846771 (+  1995us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:08.913762 (+ 66991us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:08.962055 (+ 48293us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:09.492437 (+530382us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:09.492719 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:05:09.492762 (+    43us) write_op.cc:312] APPLY: finished
0709 13:05:09.524191 (+ 31429us) log.cc:844] Serialized 156 byte log entry
0709 13:05:09.531510 (+  7319us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:09.531666 (+   156us) write_op.cc:454] Released schema lock
0709 13:05:09.531732 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:09.532112 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:09.532144 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32264,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":191192,"apply.run_cpu_time_us":24522,"apply.run_wall_time_us":690009,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75289,"num_ops":17,"prepare.queue_time_us":148540,"prepare.run_cpu_time_us":13855,"prepare.run_wall_time_us":256119,"raft.queue_time_us":114123,"raft.run_cpu_time_us":76888,"raft.run_wall_time_us":116473,"replication_time_us":334017,"thread_start_us":404837,"threads_started":4,"wal-append.queue_time_us":216758,"wal-append.run_cpu_time_us":15470,"wal-append.run_wall_time_us":2025595}]]}
I20260709 13:05:12.613106  8023 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.534462 13108 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.572956  8088 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
W20260709 13:05:12.625180  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 116695us
I20260709 13:05:12.626767 13381 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.633553 13704 consensus_queue.cc:1048] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:05:12.636574 13537 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:05:12.650671  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 136263us
W20260709 13:05:12.656338  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 187278us
I20260709 13:05:12.637807 13619 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
W20260709 13:05:12.658178  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 87846.3us
I20260709 13:05:12.659686  8023 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.668990  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:12.674271  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.660306 13108 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:12.673026  8198 raft_consensus.cc:2376] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13. Re-sending same reply.
W20260709 13:05:12.664072  8007 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 10
I20260709 13:05:12.680359  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.682991  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:12.683627  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 226626us
W20260709 13:05:12.692457  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 247183us
I20260709 13:05:12.692530  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:12.658953 13381 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.693727  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.694456  8198 pending_rounds.cc:85] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 13
I20260709 13:05:12.697572  8198 pending_rounds.cc:107] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:05:12.697888  8198 raft_consensus.cc:2889] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.695317  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.697481  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:12.705987  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.659129 13700 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.172s
I20260709 13:05:12.708609  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:12.718611  8272 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:12.709555  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.688158  8023 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 9 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 10 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.726704  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:12.727875  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.728526  8802 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:12.729202  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.732908  8200 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:12.721257  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:12.734115  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.735154  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.735965  8119 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:12.737542  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.738250 13152 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:12.666332 13537 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.673961 13531 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.693974 13108 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:12.744632  8193 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 11.
I20260709 13:05:12.737140 13135 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:05:12.753487  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.753667  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:12.754465  8777 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:12.755017 13503 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.755451 13391 consensus_queue.cc:1059] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:12.758078  8125 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:12.758872 13258 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.760075 13504 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:12.760794  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:12.761703  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 91237.2us
I20260709 13:05:12.764349 13169 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.768769 13619 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:12.770567  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.771831 13317 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:12.772102 13691 raft_consensus.cc:3055] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:12.772634 13316 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:12.772630 13557 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:12.808614 13316 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:12.810025 13381 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.745299 13705 raft_consensus.cc:2764] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:12.811565 13531 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:12.780706  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.779940  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:12.820276  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:12.798919  8271 raft_consensus.cc:1240] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:12.745836 13608 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:12.802668  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.806578 13504 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.807066 13135 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:12.781601 13514 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.830726  8091 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:12.836843  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 78752.6us
I20260709 13:05:12.849076  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.800863 13704 raft_consensus.cc:3060] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.890965  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.813195 13537 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:12.804111 13691 raft_consensus.cc:740] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:12.902740  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:12.906292  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.832705 13135 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:05:12.930521  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 81143.7us
I20260709 13:05:12.935810  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.931180 13381 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:12.941632  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.941774  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:12.950371  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 170890us
I20260709 13:05:12.910282 13135 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.943480  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:12.943948 13557 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:12.944597  8023 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 13 to 14, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:05:12.946180  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 159781us
I20260709 13:05:12.828331 13503 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.952584 13573 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:12.952965  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.953507  8166 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:12.990947  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 88582.8us
I20260709 13:05:12.990597  8023 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 5 to 7, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 7 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:12.991719 13381 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:12.954924  8123 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.955404  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:12.956342  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:12.936894 13695 log.cc:927] Time spent T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:12.832371 13514 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:12.965699  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:12.965919 13684 raft_consensus.cc:3055] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:12.895267 13504 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.004136  8811 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:12.841828 13258 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:12.991798  8166 leader_election.cc:400] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:05:13.007627  8166 leader_election.cc:403] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:12.993065  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.004236  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:13.008749  8807 raft_consensus.cc:2410] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:05:13.010901  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.014568  8802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
W20260709 13:05:13.015627  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.978734 13619 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.019639  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.020179  8238 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:12.986620 13573 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:13.003825 13684 raft_consensus.cc:740] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:13.010447 13492 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:13.037535  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.037777  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.038264  8193 raft_consensus.cc:2376] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 19. Re-sending same reply.
I20260709 13:05:13.038887 13504 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:05:13.039286  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.039600 13169 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.040107 13169 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.040408  8088 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.042024 13169 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.043664 13317 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.026008 13608 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.045477  8088 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.046241 13728 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.046411 13258 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.047017 13548 consensus_queue.cc:1059] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:05:13.047999 13698 raft_consensus.cc:3055] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:13.048383 13698 raft_consensus.cc:740] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:13.049062  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.050168  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.051126  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:13.052052  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.052938  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.054378 13503 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.052589 13691 consensus_queue.cc:260] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.048014  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.039041  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:13.065909  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 74255.1us
I20260709 13:05:13.066092  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.067005  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.068296 13723 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:13.068820  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.069119  8166 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.072935  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.071462  8123 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:13.072127  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.075090  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:13.068742 13723 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:13.095243 13723 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.076118 13718 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:13.097700 13718 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:13.098847 13718 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.044443 13135 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:13.101101  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.101769  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.023417 13619 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.102185 13135 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.102728  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.103551 13619 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:13.104415 13619 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.105006  8806 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:05:13.105369  8806 pending_rounds.cc:85] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 10
I20260709 13:05:13.105580  8806 pending_rounds.cc:107] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:05:13.105791  8806 raft_consensus.cc:2889] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:13.029814 13502 consensus_queue.cc:1048] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:05:13.079391  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.107992 13514 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:12.974049 13108 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.103817  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.080204  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.112764  8166 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:13.113487 13258 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:13.113834 13258 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.114203 13258 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.114056 13381 consensus_queue.cc:1059] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:13.114794 13381 consensus_queue.cc:1243] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 9e0c7bd2e224498bb1c68be20e5b3561 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:13.115664 13381 raft_consensus.cc:3055] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:13.115983 13381 raft_consensus.cc:740] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:13.049185 13698 consensus_queue.cc:260] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.074517  8124 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:13.081703  8238 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.023232 13573 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.068260  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.089308 13691 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.081609  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.071727 13684 consensus_queue.cc:260] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:13.117224  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.114943  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:13.127060  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 45411.6us
I20260709 13:05:13.132019  8238 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.127549  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.130672  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.136123  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:13.137800  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.112682 13687 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.151103  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.151746  8191 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:13.152557  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:13.154490  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:13.156421  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.156675  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.159113  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.163240  8238 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.131291 13623 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.172973  8192 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:13.170416  8238 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.135610 13728 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.175549  8238 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.141140 13502 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.141106 13531 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.177745  8195 raft_consensus.cc:1240] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:05:13.144335 13504 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 12. Current term is 13.
I20260709 13:05:13.155966 13620 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.190919  8191 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:13.165221 13635 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.174747 13708 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:13.194219  8195 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:13.181159 13520 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.173205 13628 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.136938 13619 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:05:13.210143  8774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.217093  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 184466us
I20260709 13:05:13.188488 13684 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.199990 13698 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.184913 13608 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:13.200259 13728 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.199591 13623 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.201581 13708 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.280970 13708 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:13.177984  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:13.204922 13531 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:13.253556  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 422875us
I20260709 13:05:13.271802  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:13.271975  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.280161 13464 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.205302 13635 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:13.301779  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 142728us
W20260709 13:05:13.304553  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 129053us
I20260709 13:05:13.306460  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:13.298976  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 106896us
I20260709 13:05:13.318061  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.201759 13381 consensus_queue.cc:260] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.334556  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.337978 13520 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:13.341395  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.333448 13322 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.316298 13623 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:05:13.355670 13322 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.343536 13635 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:13.333474 13628 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:13.357730 13635 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.355629 13619 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:05:13.359351 13322 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.345824 13704 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.355464  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.360823 13502 consensus_queue.cc:1059] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:13.361533 13502 consensus_queue.cc:1243] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:13.359179 13619 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:13.363610 13619 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:13.364387 13619 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.365231  8808 raft_consensus.cc:1275] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:13.365495 13619 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.366130 13739 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:13.353598  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.367056  8807 raft_consensus.cc:2410] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:05:13.366695 13739 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.330559 13531 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.368940 13739 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.372517 13258 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.354437  8271 raft_consensus.cc:1240] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:13.354907 13687 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:13.302300 13464 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.350049 13608 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:13.354436 13726 log.cc:927] Time spent T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:05:13.374562 13635 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:13.375515  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.397725  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.398458 13623 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.398769  8237 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.399523 13623 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.300279 13723 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.400214 13623 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:13.402025  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.403569 13537 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:13.405076 13464 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.377066 13573 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:05:13.392411  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 71780.8us
I20260709 13:05:13.407248 13573 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.406991 13708 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.407338 13740 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:13.407853 13687 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.409029 13708 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.400173  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.409849 13687 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.406945  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:13.402657 13723 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.413419 13381 raft_consensus.cc:3060] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.304361 13728 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.421546  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.423276  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.425814  8803 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:13.424175 13739 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.427306  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.424414 13152 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:13.427671  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.426903  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:13.430356  8191 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:13.431900  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.434201  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.437904  8272 raft_consensus.cc:2410] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:05:13.415354 13531 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:13.450953  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.451136  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.442168  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.452499 13246 consensus_queue.cc:1059] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:13.453292 13246 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:13.453667 13246 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:13.454396 13246 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.455587 13246 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.451687  8194 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 16: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:13.456810  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.457185  8117 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:13.446409 13728 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.437997 13739 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.447389  8122 raft_consensus.cc:606] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.462137  8122 raft_consensus.cc:614] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:13.463029  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.428893 13152 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:13.448971  8199 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:13.429379 13608 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.451689  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.459232  8774 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.447577  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.464320  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.467116  8271 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.474098 13152 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.477675  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:13.469607  8191 raft_consensus.cc:2468] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:13.491291  8192 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:13.488907  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.491748  8775 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:13.462534 13635 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.500521  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.502859  8268 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:05:13.503443  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:13.504726  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45576.8us
W20260709 13:05:13.506363  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64141.3us
I20260709 13:05:13.508204  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.442698 13573 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:05:13.511253  8165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.488160 13258 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.509991 13510 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:13.515589 13739 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.517527 13322 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.518039 13322 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.519601 13708 raft_consensus.cc:2804] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:13.520061 13322 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.520540 13322 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.521325 13705 consensus_queue.cc:1059] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:13.521597 13728 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.522125 13728 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.523111  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.523694  8265 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:13.523978 13728 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.524495  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.491103 13520 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.525539 13520 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.527491 13705 raft_consensus.cc:3055] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:13.527868 13705 raft_consensus.cc:740] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:13.490877 13537 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.529057 13537 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.528661 13705 consensus_queue.cc:260] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.543469 13741 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.544046 13537 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.544219 13705 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.520953 13322 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.494413 13619 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:05:13.551491  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.556509  8117 raft_consensus.cc:2393] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:13.558123  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.527484 13520 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:13.558630  8123 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:13.560375  8121 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:13.564775  8118 raft_consensus.cc:1240] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:13.552846 13741 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.530177 13635 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.551878 13727 raft_consensus.cc:493] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:13.570979  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363112022a444c2f8b7cf6e11c7c1c36" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.556587 13667 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.591246  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.599038  8117 raft_consensus.cc:1275] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:13.598835  8119 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 12: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
W20260709 13:05:13.600605  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 81421.1us
I20260709 13:05:13.601692  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.602283  8121 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 19.
I20260709 13:05:13.604336  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:05:13.609212  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.613942  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.614631  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.615280  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:13.615826  8119 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.572582 13741 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.611424 13742 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.598901 13667 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.638759  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.640903  8091 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.643674  8163 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.643869  8091 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.589466 13727 raft_consensus.cc:515] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.642890  8266 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
W20260709 13:05:13.647313 13749 log.cc:927] Time spent T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:05:13.648867  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.649497  8266 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 19.
I20260709 13:05:13.650595  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.654332  8266 raft_consensus.cc:2393] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:13.657793 13573 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:13.633505 13742 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.658766 13741 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.660497 13742 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.661279  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.662928 13152 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.666800  8197 raft_consensus.cc:1275] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:05:13.667131  8197 pending_rounds.cc:85] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 7
I20260709 13:05:13.667338  8197 pending_rounds.cc:107] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:05:13.667524  8197 raft_consensus.cc:2889] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:13.668984  8119 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:13.670399 13667 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.665848 13635 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:13.646004 13723 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:13.671603 13748 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:13.672449 13727 leader_election.cc:290] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.652509 13246 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:05:13.673596 13758 log.cc:927] Time spent T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:05:13.674798  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.675822  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.677088  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.677526 13700 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.658697 13746 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:13.680863  8271 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:13.685212  8163 leader_election.cc:304] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.685480  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.686046 13718 raft_consensus.cc:2749] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.686429  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.686838 13718 consensus_queue.cc:1048] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:13.687153  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:13.687388  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.681819  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.677986 13700 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.679045  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.682873  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:13.654300 13464 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:13.689850  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:13.693835  8273 raft_consensus.cc:3060] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.691915  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.695101  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.697221  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.679311 13152 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.679035 13573 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:13.688199 13635 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.700351  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:13.666617 13504 consensus_queue.cc:1059] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:05:13.712568  8807 raft_consensus.cc:2393] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:13.693146 13258 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:13.684759 13742 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.714236  8166 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.719148 13742 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.692637 13608 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:13.720662  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 76829.7us
I20260709 13:05:13.723266  8091 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.694587 13322 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.724763  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.729656  8091 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:13.729575  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.731114  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.733440  8119 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:13.733891  8273 raft_consensus.cc:2468] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:13.694470 13520 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:13.732914 13322 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.743399  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.744869  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.721278 13258 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:13.697384 13464 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:13.751767  8267 raft_consensus.cc:2393] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:13.724295 13381 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.727039 13742 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.760119  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.762825  8809 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:13.768782  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:13.757694 13258 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:13.759202 13135 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.773571  8237 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.789880 13738 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:13.792716 13464 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:13.795189  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:13.797101  8091 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.798036 13322 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:13.798415 13322 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.798719 13322 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.789937 13381 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:13.800212 13381 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.802145 13381 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.803385 13700 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.770807 13573 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.809199  8237 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:13.810400  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:13.810729  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:13.811305  8273 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:13.772264 13504 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:13.821458  8163 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:13.790405 13738 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:13.811607 13520 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.866356  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.867190  8118 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:13.867686  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.868060  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.870217 13739 consensus_queue.cc:1048] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:13.871364  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.859571 13381 raft_consensus.cc:2804] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:13.876017  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.869158  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:13.817417 13504 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.817214 13667 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:13.883564 13667 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.884060 13667 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:13.884756 13739 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:13.885561 13739 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.818804 13635 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:05:13.879917  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:13.864986 13738 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.895007 13464 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.878592 13548 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.873944 13381 raft_consensus.cc:697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:13.888825 13322 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.897110  8119 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:13.897068 13381 consensus_queue.cc:237] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.898891 13322 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:13.899986 13723 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.908012 13667 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:13.900760 13504 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.927946  8118 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:13.950079  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 235901us
I20260709 13:05:13.924062 13667 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:13.963155 13751 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.447s	user 0.000s	sys 0.002s
I20260709 13:05:13.926250 13608 consensus_queue.cc:1059] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:13.975912  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.977321  8166 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.956777 13502 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.989311  8166 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.978797 13464 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.982461 13742 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.971145 13723 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:05:14.008637  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.989863 13738 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.012101  8166 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:13.996665 13381 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:14.018165  8166 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:14.012006 13699 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:14.095094  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 77040.8us
I20260709 13:05:14.094869 13699 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.096160 13687 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:14.097004 13699 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:14.026014 13738 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:14.017856 13742 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:14.097976  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:14.102200 13738 raft_consensus.cc:1064] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
W20260709 13:05:14.082834 13773 log.cc:927] Time spent T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:14.107196  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.019516 13723 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:14.109776  8166 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:14.109323  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.115031  8194 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 16.
I20260709 13:05:14.034768 13258 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.116142  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f64012d7a146ddb8774cc4299a38e8" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.117321 13770 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.126550  8196 raft_consensus.cc:1240] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:14.127014  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 48265.4us
I20260709 13:05:14.127840  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.108882 13619 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:05:14.147688 13258 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:14.148303 13504 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.150390 13738 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.151118 13770 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.152796 13504 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:14.132261  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:14.157131  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:14.157718  8806 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:14.165889 13635 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:14.166800 13635 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.169909 13718 raft_consensus.cc:3055] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:14.170326 13718 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:14.171159 13718 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.172246 13718 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:14.173825  8197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2680) took 1146 ms. Trace:
I20260709 13:05:14.174183  8197 rpcz_store.cc:276] 0709 13:05:13.027142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.165429 (+138287us) service_pool.cc:224] Handling call
0709 13:05:13.187302 (+ 21873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.681671 (+494369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.173620 (+491949us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540035bbd4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:14.173772 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079690624}
I20260709 13:05:14.180847  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:14.180749  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
W20260709 13:05:14.183504 13743 log.cc:927] Time spent T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.667s	user 0.003s	sys 0.000s
I20260709 13:05:14.186867  8198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2704) took 1044 ms. Trace:
I20260709 13:05:14.187312  8198 rpcz_store.cc:276] 0709 13:05:13.142725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.277784 (+135059us) service_pool.cc:224] Handling call
0709 13:05:13.278109 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.278483 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.278509 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.278952 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.442436 (+163484us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:13.545774 (+103338us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.549850 (+  4076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.549913 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.065947 (+516034us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b180043b1c0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:14.182981 (+117034us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21b61c85 00007fbd21b626a2 00007fbd248d41db 00007fbd248cfaaf 00007fbd248c386e 00007fbd248c2bb6 00007fbd248c27d8 00007fbd248cc221 00007fbd248cc1d9 00007fbd248cc169
0709 13:05:14.186681 (+  3700us) raft_consensus.cc:1685] finished
0709 13:05:14.186701 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.186804 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6807,"prepare.queue_time_us":13330,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":79937,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2647,"spinlock_wait_cycles":51129856,"thread_start_us":238910,"threads_started":2,"wal-append.queue_time_us":215337}
I20260709 13:05:14.211680  8125 raft_consensus.cc:1240] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:14.214557 13708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.023s	sys 0.013s
W20260709 13:05:14.214484 13691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.003s	sys 0.006s
I20260709 13:05:14.225687  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.227527  8266 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:14.227675  8273 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:14.227923  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:14.222637 13708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.023s	sys 0.013s
I20260709 13:05:14.229051  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:14.229533  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 97344.7us
I20260709 13:05:14.226652  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.226147  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:14.223424 13691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.003s	sys 0.006s
I20260709 13:05:14.239668  8806 raft_consensus.cc:2468] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:14.231962  8272 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.237680  8237 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.213244 13258 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:05:14.220928 13687 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:14.243185  8163 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:14.240981  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.327930  8267 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 14.
I20260709 13:05:14.225524 13619 raft_consensus.cc:3055] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:14.238685 13708 raft_consensus.cc:697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:14.338785  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 95671.9us
I20260709 13:05:14.341655 13504 raft_consensus.cc:2804] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:14.343497  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 105878us
I20260709 13:05:14.345158 13620 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.350539 13504 raft_consensus.cc:697] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:14.351502 13504 consensus_queue.cc:237] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.353485 13742 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:14.354346 13789 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:05:14.354048 13742 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.356643 13742 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:14.357600  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.364727  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4577341fc4203869bd3f8476d9c43" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.365598 13739 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:14.366366  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.366880 13628 raft_consensus.cc:3055] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:14.367221 13628 raft_consensus.cc:740] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:14.367544  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.367987 13628 consensus_queue.cc:260] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.369099 13628 raft_consensus.cc:3060] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.374517  8198 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:14.375946  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:14.377276  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:14.377241  8269 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 18.
I20260709 13:05:14.380576  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:14.240512 13728 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:05:14.383486  8195 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 16: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:14.330015 13619 raft_consensus.cc:740] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:14.394042 13619 consensus_queue.cc:260] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.394549 13708 consensus_queue.cc:237] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.399690  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.331513 13687 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.404881 13687 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:14.407294 13723 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:14.338894 13258 consensus_queue.cc:1243] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer 65d66cd655cd4400b079b4427061ca5e log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:14.393018  8272 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
W20260709 13:05:14.443646  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 98840.2us
I20260709 13:05:14.366724 13739 consensus_queue.cc:1048] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:05:14.449510  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.463086  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.463461  8269 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:14.463936  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.464524  8265 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:14.464768  8273 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:14.465615  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:14.463868  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.467097  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.469889 13770 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:14.470064  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:14.470854 13723 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:14.471226 13723 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.471557 13723 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.471980  8166 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:14.473531 13687 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:14.474169  8166 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:14.474881 13787 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.479557  8273 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:14.480867 13770 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:14.523938 13792 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.543932  8809 raft_consensus.cc:1240] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:14.553154 13531 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.553733 13531 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.555737 13531 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:14.556565  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:14.561115  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:14.504405 13723 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:14.561954  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 123184us
I20260709 13:05:14.565282  8238 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.584887  8089 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:14.584671 13708 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:14.597478  8089 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.604310 13723 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:14.607551 13784 log.cc:927] Time spent T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.532s	user 0.000s	sys 0.003s
I20260709 13:05:14.602066  8089 leader_election.cc:304] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.611312  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:14.611922  8271 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.614835  8272 raft_consensus.cc:1240] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:05:14.610386 13727 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:14.596379 13708 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.601224 13623 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:14.610461 13740 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:14.614390 13667 raft_consensus.cc:2749] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.623728 13718 consensus_queue.cc:1059] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:05:14.637810  8271 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:14.639227  8166 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:14.644953 13745 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:14.645437 13745 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:14.646304 13745 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.647327 13745 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:14.650609 13464 raft_consensus.cc:3055] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:14.651036 13464 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:14.651880 13464 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:14.675693  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.684901 13258 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:14.685546 13258 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.709331 13742 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:14.709995 13742 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.625173 13727 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:14.776859 13391 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.658380 13718 raft_consensus.cc:2804] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:14.802347 13391 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.780359 13727 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:14.827312  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.834270  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.837872  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 218831us
I20260709 13:05:14.868690 13687 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:14.878160 13687 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.805418 13667 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:05:14.831812 13718 raft_consensus.cc:697] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:14.896477  8808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357"
dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:44830
I20260709 13:05:14.897086  8808 raft_consensus.cc:606] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:14.897431  8808 raft_consensus.cc:614] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:14.873507 13464 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.872378 13698 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.904340 13728 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:14.904718 13728 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:14.905431 13728 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.906948 13391 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:14.908176 13708 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:14.927188  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:14.928160  8271 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 16: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:14.910560 13698 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:14.943039  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:14.950826  8166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.940601 13258 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:14.938993 13718 consensus_queue.cc:237] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.953995 13727 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:14.955657  8803 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:14.956493 13698 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:14.944422 13742 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:14.962177 13727 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:14.963438  8268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44562 (request call id 2227) took 1483 ms. Trace:
I20260709 13:05:14.963764  8268 rpcz_store.cc:276] 0709 13:05:13.480290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.532998 (+ 52708us) service_pool.cc:224] Handling call
0709 13:05:13.533365 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.606314 (+ 72949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.606359 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.613715 (+  7356us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.926995 (+313280us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:13.958189 (+ 31194us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.958376 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.963077 (+1004701us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54004088d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:14.963119 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.963164 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:14.963244 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.963366 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25935,"prepare.queue_time_us":32069,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":219,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4768,"spinlock_wait_cycles":190670464,"thread_start_us":291048,"threads_started":1,"wal-append.queue_time_us":387209}
W20260709 13:05:14.966768 13802 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 13:05:14.968220  8196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 2713) took 1284 ms. Trace:
I20260709 13:05:14.968559  8196 rpcz_store.cc:276] 0709 13:05:13.683866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.732274 (+ 48408us) service_pool.cc:224] Handling call
0709 13:05:13.751077 (+ 18803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.132686 (+381609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.968013 (+835327us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54002062d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:14.968147 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863072640}
I20260709 13:05:14.972532 13791 consensus_queue.cc:1059] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:14.973503 13520 raft_consensus.cc:3055] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:14.973829 13520 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:14.975819  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:14.981036  8125 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:14.979902  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:14.998136 13791 consensus_queue.cc:1059] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:14.999429 13520 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.000186 13635 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.000727 13728 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.000675 13635 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.002756 13635 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:14.998371 13623 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.006915  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.006286  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.043515 13503 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.041193 13169 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:15.050208 13503 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.050529 13169 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.052304 13503 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.015115  8807 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:15.032843  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.032783  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.032552  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.032153  8271 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:05:15.011159  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.054466  8271 pending_rounds.cc:85] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 10
I20260709 13:05:15.054749  8271 pending_rounds.cc:107] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:05:15.055176  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.055024  8198 raft_consensus.cc:1240] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:15.055830  8803 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:15.054981  8271 raft_consensus.cc:2889] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:15.057245  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.040449  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40718 (request call id 947) took 1225 ms. Trace:
I20260709 13:05:15.056990  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.058760  8803 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:15.059135  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.054237  8269 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:15.061131  8195 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:15.054265  8272 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:15.053609  8197 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:15.068557  8265 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 18: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:15.058035  8809 rpcz_store.cc:276] 0709 13:05:13.814966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.815106 (+   140us) service_pool.cc:224] Handling call
0709 13:05:13.818470 (+  3364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:14.544415 (+725945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.040141 (+495726us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54005401d4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:15.040310 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667727104}
I20260709 13:05:15.068403  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.071082  8237 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.072508  8091 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.078399  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.052445 13628 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.000764 13520 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:15.014207 13742 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:15.011425 13750 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.039865 13619 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.089300  8237 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.038769 13791 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.079186  8267 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:15.069327 13623 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.048071 13738 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.077826  8775 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:15.070613 13787 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.083756 13502 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.052554 13169 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.113752 13620 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:15.086042 13667 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:15.082927 13608 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:15.085477  8091 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.103647 13537 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:05:15.104315 13628 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.125684 13548 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:15.109896 13750 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.147411 13687 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.147931 13548 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.124310 13502 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.150398  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.083815 13814 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
W20260709 13:05:15.154973  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 69794.4us
I20260709 13:05:15.115187 13791 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.118908 13742 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.166069 13805 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:15.144737 13812 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.182699 13812 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.184620 13812 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.186296  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.186887  8195 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:15.177753  8091 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.122629 13738 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.178404  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.187997  8775 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:15.122323 13787 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.179906  8117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:15.166524 13548 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:15.179683 13727 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:05:15.182185 13750 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.142513 13620 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:15.189708  8803 raft_consensus.cc:2368] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16.
I20260709 13:05:15.190233  8117 raft_consensus.cc:606] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.191177  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.197809  8193 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:15.206709  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:15.211391  8274 raft_consensus.cc:2368] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 16. Current term is 17.
W20260709 13:05:15.209874  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 89421.6us
I20260709 13:05:15.216117  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.195524 13391 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:15.193878 13812 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:15.216511  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:15.220748  8091 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.192318 13807 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.216861  8809 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:15.221943  8267 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:15.206408 13608 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.223671  8088 leader_election.cc:400] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16.
I20260709 13:05:15.223984  8088 leader_election.cc:403] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.225679 13807 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.227758 13807 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.228458 13803 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:15.229004 13803 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:15.229918 13322 raft_consensus.cc:3060] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:15.230197 13608 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.230786  8091 leader_election.cc:400] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 16. Current term is 17.
I20260709 13:05:15.231117  8091 leader_election.cc:403] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.232122 13135 raft_consensus.cc:3060] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.232677 13812 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:15.222330 13813 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:15.233912 13813 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:15.234802 13813 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.239001  8124 raft_consensus.cc:1275] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:15.239137 13620 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.240334  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:15.241715  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:15.241938  8775 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:15.242357 13742 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.243150  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.244127  8774 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.235173  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.245158  8125 raft_consensus.cc:2410] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:15.248257 13704 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:15.248471 13635 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.250494 13738 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.250872  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.251641  8273 raft_consensus.cc:2393] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 18: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:15.251945 13787 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.252852 13740 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:15.214654 13805 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:15.260425  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.253742  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.221478 13391 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:15.264194  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 195428us
I20260709 13:05:15.267765  8199 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:15.258530  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.269170  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.270038  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.273617  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.273705  8119 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:15.253232 13740 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.278244  8163 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.278883 13687 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:15.280171  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.280501  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:15.280974  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.249058 13635 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.275942  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.283871  8273 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 18.
I20260709 13:05:15.269052 13391 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.263031 13805 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:15.270915 13708 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:15.299475  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.303455  8124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.304682  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.306213  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.308810  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.308933  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.309553  8268 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:15.280027 13740 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:15.311744  8803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.314085  8807 raft_consensus.cc:1275] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:15.279517 13795 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:15.307178 13738 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.279978 13742 consensus_queue.cc:1048] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:05:15.282823 13684 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:05:15.302366 13708 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.318233  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:15.329118 13795 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.329798 13825 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:15.329557 13738 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.287220 13787 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:15.331054 13787 consensus_queue.cc:1048] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:15.332139 13738 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.332844 13822 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:15.301064 13805 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.333252 13822 raft_consensus.cc:493] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.333666 13822 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:15.288988 13464 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:15.322085 13608 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.322358  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.322368  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.337455  8117 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:15.323364  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.320061 13687 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:15.281644 13803 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.301219 13623 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.328831 13708 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:15.326592  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:15.350289  8121 raft_consensus.cc:606] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:15.350622  8121 raft_consensus.cc:614] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:15.358541 13135 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 16. Current term is 17.
I20260709 13:05:15.361493  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:15.362507  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:15.363862 13548 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.365969 13548 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.363145  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:15.366910  8270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:15.367478  8270 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:15.367517 13687 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:15.368146 13805 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.373095 13623 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:15.373543 13623 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.373895 13623 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.377471 13608 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:15.477962  8123 raft_consensus.cc:1240] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting Update request from peer afd11cff97554063a80d743fdf2b934d for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:15.479900  8270 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:15.493331  8116 raft_consensus.cc:2468] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:15.477631 13687 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.502099  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:15.502691  8121 raft_consensus.cc:606] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.503160  8121 raft_consensus.cc:614] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:15.497117 13152 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.500144 13322 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for earlier term 15. Current term is 16.
I20260709 13:05:15.523527  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:15.531038  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:15.520496 13795 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.542325 13708 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.542786 13704 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.543586  8807 raft_consensus.cc:2368] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19.
I20260709 13:05:15.505555 13687 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.548269 13687 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.549067  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.549566  8120 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:15.528062 13152 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.543257 13704 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:15.637928 13826 log.cc:927] Time spent T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:05:15.565569 13822 raft_consensus.cc:515] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.640707 13822 leader_election.cc:290] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.567621 13740 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.642262 13391 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.642946 13740 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.643406  8803 raft_consensus.cc:2368] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17.
I20260709 13:05:15.644306 13391 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.570814 13805 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:15.647716 13827 log.cc:927] Time spent T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:05:15.644634  8125 raft_consensus.cc:2368] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 18. Current term is 19.
I20260709 13:05:15.640389 13623 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.655848 13623 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.656944  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:15.567404 13520 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.675572 13520 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.678095 13520 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.749112 13520 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.749799 13520 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.752414 13520 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.830083 13804 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.830715 13804 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:15.832995 13804 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.833853 13623 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.834416 13623 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.836371 13623 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.851498  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.852649 13704 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.858981 13502 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.862308 13742 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:15.862632  8265 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:05:15.862862 13742 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.863662  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.864245  8272 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:15.864892 13742 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:15.866605  8164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.867986  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.869393  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.869905  8195 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:15.870931  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.871440  8195 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:15.871989  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.876034  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:15.887372  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:15.888188  8195 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 17: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:15.889267  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.891222  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.894541  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.899828  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.905434 13742 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:15.906162  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.907414  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:15.908144  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.908917  8125 raft_consensus.cc:2393] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 16: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:15.909646  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.910275  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.910701  8125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:15.911309  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.911900 13742 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:15.912261 13742 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.912599 13742 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.914623  8117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.918532  8805 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:15.918900  8777 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:15.919485  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.920357  8806 raft_consensus.cc:2410] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:05:15.921150  8125 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:15.943951  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:15.944721  8268 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:15.921727 13834 raft_consensus.cc:2804] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:15.912564  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.949317  8120 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:15.922545  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.925087 13608 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:15.927970  8802 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:05:15.950909  8807 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:15.919436 13742 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:15.956959 13770 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:15.957501 13770 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.958091 13742 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:15.959321 13770 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.960019  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.960600  8199 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 17.
I20260709 13:05:15.929432  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:15.964649  8808 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:15.970970  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.934262 13791 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.975051  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:15.935052  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.939422  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3771ea49d91a4d3f8c3b8c67db52b9ab" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:15.975791  8273 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:15.940038 13628 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:15.941612  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:15.977632  8266 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.912281  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.945037  8163 leader_election.cc:400] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19.
I20260709 13:05:15.948324  8196 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:15.978144  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:15.975656  8200 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 12.
I20260709 13:05:15.947335  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:15.978948  8163 leader_election.cc:403] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.979112  8199 raft_consensus.cc:3060] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:15.980116  8121 raft_consensus.cc:2393] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 19: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:15.980448  8804 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:15.982457  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:15.983346  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:15.985862  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:15.990406 13791 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.992506 13791 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:15.996701  8808 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 19.
I20260709 13:05:15.998363  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:15.998638 13791 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:15.998936  8118 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:16.002002  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54731.7us
I20260709 13:05:16.003551  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:16.004612  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:16.006098  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:16.006645  8271 raft_consensus.cc:3060] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.999584 13504 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:16.006760 13628 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:16.009534 13628 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:16.009986  8805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:16.010566  8805 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:16.010380 13628 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.012796  8118 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:15.978499 13834 raft_consensus.cc:697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:16.020118 13834 consensus_queue.cc:237] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.025506  8271 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:16.025949 13836 consensus_queue.cc:1059] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:16.026852 13837 raft_consensus.cc:3055] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:16.027211 13837 raft_consensus.cc:740] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:16.028288 13791 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:16.027963 13837 consensus_queue.cc:260] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.028810 13791 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.029232 13791 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.029209 13837 raft_consensus.cc:3060] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.033164 13727 raft_consensus.cc:993] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:16.033653 13727 raft_consensus.cc:1081] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:16.034503  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:16.037211  8199 raft_consensus.cc:2468] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:16.040042  8273 raft_consensus.cc:2468] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:16.041095  8777 leader_election.cc:304] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:16.042968  8166 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:15.989401 13742 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.045567  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:16.059669  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:16.044808 13619 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.047839 13691 raft_consensus.cc:2804] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:16.057310 13798 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:16.049872 13504 raft_consensus.cc:2804] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:16.076727  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:16.080371  8193 raft_consensus.cc:3060] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.060027 13787 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.072883 13814 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:16.096298  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:16.099800  8122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.024s	sys 0.068s
W20260709 13:05:16.100134  8122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.024s	sys 0.068s
I20260709 13:05:16.102659 13635 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:16.115636 13708 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.081046  8196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
I20260709 13:05:16.133340  8196 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.133777  8196 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.124478  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:16.143491  8123 raft_consensus.cc:1275] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:05:16.144361  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.154814  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:16.083346 13798 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.142663 13635 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:16.159776 13798 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:16.087992 13691 raft_consensus.cc:697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:16.086860 13504 raft_consensus.cc:697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:16.161919 13691 consensus_queue.cc:237] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.162184 13504 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.165405 13628 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.167762 13708 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:16.152776 13738 raft_consensus.cc:2764] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:16.143729 13608 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.170042 13608 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.172678 13608 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:16.173198  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:16.174610  8774 leader_election.cc:400] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 18. Current term is 19.
I20260709 13:05:16.174923  8774 leader_election.cc:403] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:16.092101 13787 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.176862 13708 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) with higher term. Message: Invalid argument: T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 18. Current term is 19.
I20260709 13:05:16.178045 13787 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.181968  8193 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:16.183871  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:16.180826  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:16.092351 13814 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.202039 13814 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.120090 13791 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:16.205617  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 52741.4us
I20260709 13:05:16.206955  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.208057  8238 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.201663  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:16.211705  8122 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 20: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:16.212942  8266 raft_consensus.cc:2468] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:16.213233  8268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:16.214108  8268 raft_consensus.cc:2410] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:16.216425  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:16.221424  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:16.221993  8266 raft_consensus.cc:3060] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.214607  8777 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:16.235451  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:16.236326  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:16.236929  8810 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:16.245841  8266 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 19.
I20260709 13:05:16.258236  8266 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:16.257241  8777 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:16.271257  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:16.277999  8119 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:16.297479  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 63397us
I20260709 13:05:16.286980 13699 raft_consensus.cc:2804] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:16.299249 13812 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:16.299685 13699 raft_consensus.cc:697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:16.270349 13628 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:16.300689 13699 consensus_queue.cc:237] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.286803 13623 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:16.301838 13623 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.302182 13623 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.270857 13738 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:16.298280  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45368us
I20260709 13:05:16.298274  8088 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e; no voters: 
I20260709 13:05:16.313740  8163 leader_election.cc:400] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17.
I20260709 13:05:16.311831  8119 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:16.270172 13708 raft_consensus.cc:2804] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:16.318985  8163 leader_election.cc:403] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:16.323707 13837 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:16.323920 13814 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:16.325181  8116 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 13: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:16.339143  8270 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:16.340726  8274 raft_consensus.cc:1240] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 17. Current term is 18. Ops: [17.15-17.15]
W20260709 13:05:16.302199 13839 log.cc:927] Time spent T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:05:16.317533 13791 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:16.356423  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 148423us
I20260709 13:05:16.362201 13814 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.355933 13846 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.363370 13846 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.365454  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:16.366043  8119 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:16.368952  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:16.369712  8269 raft_consensus.cc:2393] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:16.376680  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:16.338868 13837 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:16.377323  8273 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.384912  8022 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:16.381263  8238 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.386437  8022 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 15 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.387120 13635 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:16.387998  8022 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.388634 13635 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:16.356012 13770 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 16. Current term is 17.
I20260709 13:05:16.390378  8809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 977) took 1027 ms. Trace:
I20260709 13:05:16.382714  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:16.391783  8807 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.349942 13708 raft_consensus.cc:697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:16.390769  8809 rpcz_store.cc:276] 0709 13:05:15.362786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.362948 (+   162us) service_pool.cc:224] Handling call
0709 13:05:15.363228 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.891233 (+528005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.891263 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.891706 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.038736 (+147030us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:16.038779 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.038869 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.390194 (+351325us) raft_consensus.cc:1685] finished
0709 13:05:16.390212 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.390330 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127531,"raft.queue_time_us":131806,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":542513,"threads_started":2,"wal-append.queue_time_us":147075}
I20260709 13:05:16.400444  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.398507  8022 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:16.413009  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:16.413296 13855 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.407014  8022 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 11 to 13, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:16.419440 13573 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.420356 13727 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:16.423599  8273 raft_consensus.cc:2410] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:16.425958 13727 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:16.428645  8116 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:05:16.429724  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64044.7us
I20260709 13:05:16.401489 13152 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:16.434736  8022 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.435977 13837 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.433477  8091 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:16.436697 13708 consensus_queue.cc:237] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.446663  8194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:16.447618  8194 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:16.448727  8023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 258) took 31022 ms (client timeout 15000 ms). Trace:
I20260709 13:05:16.413869 13855 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.450656  8022 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 14, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.454028 13855 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:16.442394 13804 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:16.416834 13846 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.458714  8272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:16.458840  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:16.428277 13718 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.453827  8022 catalog_manager.cc:5697] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:16.473336  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 115709us
I20260709 13:05:16.447427 13742 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) with higher term. Message: Invalid argument: T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d for earlier term 18. Current term is 19.
I20260709 13:05:16.481493  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:16.449084  8023 rpcz_store.cc:269] 0709 13:04:45.426530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.426673 (+   143us) service_pool.cc:224] Handling call
0709 13:05:16.448664 (+31021991us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:13.349786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:13.350469 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:13.350522 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:05:13.350539 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:13.351619 (+  1080us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:13.351703 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:13.351727 (+    24us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:05:13.355109 (+  3382us) tablet.cc:701] Row locks acquired
0709 13:05:13.355163 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:05:13.355321 (+   158us) write_op.cc:270] Start()
0709 13:05:13.355463 (+   142us) write_op.cc:276] Timestamp: P: 1783602313355264 usec, L: 0
0709 13:05:13.355495 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:05:13.356128 (+   633us) log.cc:844] Serialized 4749 byte log entry
0709 13:05:13.872235 (+516107us) op_driver.cc:464] REPLICATION: finished
0709 13:05:14.000372 (+128137us) write_op.cc:301] APPLY: starting
0709 13:05:14.000568 (+   196us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:14.028169 (+ 27601us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:14.028283 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:14.083238 (+ 54955us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:14.083541 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:05:14.083582 (+    41us) write_op.cc:312] APPLY: finished
0709 13:05:14.083996 (+   414us) log.cc:844] Serialized 113 byte log entry
0709 13:05:14.084164 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:14.084299 (+   135us) write_op.cc:454] Released schema lock
0709 13:05:14.084376 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:14.084775 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:14.084810 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":258136,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":127853,"apply.run_cpu_time_us":16362,"apply.run_wall_time_us":84420,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":270696,"prepare.run_cpu_time_us":9524,"prepare.run_wall_time_us":113587,"raft.queue_time_us":223561,"raft.run_cpu_time_us":9491,"raft.run_wall_time_us":82878,"replication_time_us":516588,"thread_start_us":485657,"threads_started":4,"wal-append.queue_time_us":195573,"wal-append.run_cpu_time_us":20343,"wal-append.run_wall_time_us":1529100}]]}
I20260709 13:05:16.485241  8022 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 13, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:16.486673 13854 consensus_queue.cc:1059] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:05:16.487697 13854 raft_consensus.cc:3055] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:16.488023 13854 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:16.488727 13854 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.496852  8199 raft_consensus.cc:2468] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 19.
I20260709 13:05:16.507237  8807 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:16.508613  8237 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:16.508442  8022 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.520339  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:16.522852  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:16.524266  8198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:16.524887  8198 raft_consensus.cc:3060] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.467615 13628 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:05:16.508450  8196 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.534363  8022 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 3 to 10, term changed from 11 to 15, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 15 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.541144  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.541754 13855 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:16.542563  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 61160.6us
I20260709 13:05:16.543815 13619 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:16.549576  8191 raft_consensus.cc:1275] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:16.469303 13718 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.551245  8196 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.554874  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:16.558893  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:16.555454  8193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:16.544997 13850 raft_consensus.cc:2804] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:16.558233  8022 catalog_manager.cc:5697] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.556697 13854 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.591228  8022 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 11 to 14, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:16.592744  8193 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:16.560041 13502 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.602144  8022 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index -1 to 6, term changed from 8 to 10, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:16.565444 13742 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:16.610055  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:16.610737  8267 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.570708 13548 consensus_queue.cc:1048] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:05:16.571733 13850 raft_consensus.cc:697] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:16.612663  8022 catalog_manager.cc:5697] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 11, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.561797 13623 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.620674  8022 catalog_manager.cc:5697] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.622292  8022 catalog_manager.cc:5697] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 12, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 12 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.607256 13742 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:16.625316  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 72380.9us
I20260709 13:05:16.568539 13856 consensus_queue.cc:1048] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:16.630831  8266 raft_consensus.cc:1240] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:05:16.631060  8022 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 14, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.629673  8238 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.628940 13742 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.647028  8267 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:16.652719  8265 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 19.
I20260709 13:05:16.666090  8194 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 13.
I20260709 13:05:16.668219  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:16.669776  8022 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 5 to 10, term changed from 12 to 14, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:16.671998  8022 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.681183 13864 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:16.669739 13608 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.700202 13623 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:16.702919  8198 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:16.703154  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:16.703653  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:16.705106  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:16.709149 13608 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:16.709534 13608 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:16.709870 13608 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:16.687574 13858 log.cc:927] Time spent T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:05:16.722224  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 161244us
W20260709 13:05:16.717904  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 170443us
I20260709 13:05:16.727186  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:16.725611  8089 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:16.706525 13623 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.777904  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 155758us
I20260709 13:05:16.781378  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:16.705967 13718 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.785621 13623 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:16.815344  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 89811.2us
I20260709 13:05:16.818792  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:16.819427  8200 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:16.821027  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:16.821238  8200 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:05:16.821646  8200 pending_rounds.cc:85] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 10
I20260709 13:05:16.771694 13798 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:16.822395 13798 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:16.822770 13798 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.823086 13798 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:16.823540 13152 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:16.824035 13152 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:16.693714 13850 consensus_queue.cc:237] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:16.824987 13152 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:16.821873  8200 pending_rounds.cc:107] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:05:16.827431  8200 raft_consensus.cc:2889] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:16.828845  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:16.842849  8123 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 19.
I20260709 13:05:16.817370 13623 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:16.849035 13844 log.cc:927] Time spent T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:16.781402  8166 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:16.900892 13803 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
W20260709 13:05:16.901562 13841 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.512s	user 0.007s	sys 0.005s
I20260709 13:05:16.901595 13803 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.904745  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:16.922813 13608 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.923445 13742 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:16.904970 13803 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:16.977021  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 195695us
I20260709 13:05:16.978358  8198 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:16.965234 13742 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:16.989692 13718 raft_consensus.cc:2804] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:16.990226 13718 raft_consensus.cc:697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:16.989679  8193 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:16.994043  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:17.002918  8269 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 20.
I20260709 13:05:17.038383  8193 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:16.991076 13718 consensus_queue.cc:237] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.050355 13699 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:17.094089  8200 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:05:17.086014  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 219643us
I20260709 13:05:17.104358  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:17.113035  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:17.113729  8119 raft_consensus.cc:2376] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17. Re-sending same reply.
I20260709 13:05:17.042201 13698 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:17.042802 13812 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:17.115726  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:17.116822  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:17.094429  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 53742.1us
I20260709 13:05:17.121750  8123 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 20.
I20260709 13:05:17.124768  8121 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:17.121577  8119 raft_consensus.cc:3055] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:17.129432  8119 raft_consensus.cc:740] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:17.130437  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:17.132118  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:17.137135  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
W20260709 13:05:17.158926  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 57949.1us
I20260709 13:05:17.130170  8119 consensus_queue.cc:260] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.160727  8119 raft_consensus.cc:3060] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:17.120239 13877 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.083s	user 0.002s	sys 0.002s
I20260709 13:05:17.098403 13608 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:17.171973  8199 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:17.181835  8119 raft_consensus.cc:2468] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:17.155951 13503 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:05:17.172341 13881 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:17.134495 13812 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.213516  8274 raft_consensus.cc:1275] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:17.213759  8266 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:17.217716  8265 raft_consensus.cc:1275] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:17.220490  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:17.222164  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 64007.4us
I20260709 13:05:17.223834  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:17.194813 13850 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:17.189254 13798 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.217322 13881 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:17.235230 13876 log.cc:927] Time spent T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:05:17.237557 13152 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.258246 13152 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.260488 13881 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:17.249794 13872 log.cc:927] Time spent T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:05:17.251828 13864 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:17.262805 13864 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:17.263348 13812 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:17.229292 13813 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:05:17.263720 13864 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.264336 13813 consensus_queue.cc:1243] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer afd11cff97554063a80d743fdf2b934d log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:17.277024 13798 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:17.231527 13850 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.284093 13850 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:17.292879  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:17.293565  8191 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.260869 13152 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:17.305933  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 130230us
I20260709 13:05:17.321903  8265 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:17.324218  8197 raft_consensus.cc:1240] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Rejecting Update request from peer 65d66cd655cd4400b079b4427061ca5e for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:17.329795  8166 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:17.335122  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:17.339234 13854 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:17.339743 13854 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.340250 13854 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.340935  8191 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 21.
I20260709 13:05:17.341975  8238 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:17.343274  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:17.350003 13635 raft_consensus.cc:2804] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:17.351097 13635 raft_consensus.cc:697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:17.352767 13635 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.355522  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:17.358618  8163 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:17.366078  8119 raft_consensus.cc:1275] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:05:17.366466  8119 pending_rounds.cc:85] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Aborting all ops after (but not including) 14
I20260709 13:05:17.366668  8119 pending_rounds.cc:107] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:05:17.366869  8119 raft_consensus.cc:2889] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:17.372219  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:17.372777  8274 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:17.372772  8265 raft_consensus.cc:1813] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Handling vote request from an unknown peer 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:17.374588  8265 raft_consensus.cc:2393] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 17: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:17.372400  8163 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:17.379967  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:17.382054  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:17.384099 13874 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:17.390015 13750 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:17.368402 13846 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:17.395005  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:17.396088  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:17.397456 13798 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:05:17.401512  8090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.403052  8089 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:17.405525 13573 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:17.407503  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:17.408198  8118 raft_consensus.cc:2393] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 20: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:17.411434  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:17.412024  8119 raft_consensus.cc:3060] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.449812  8809 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:05:17.453456  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50485.9us
I20260709 13:05:17.383596 13504 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:05:17.436700 13548 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:17.454421  8265 raft_consensus.cc:1275] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:17.456590  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:17.456856  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:17.457692  8198 pending_rounds.cc:85] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Aborting all ops after (but not including) 9
I20260709 13:05:17.383690 13799 consensus_queue.cc:1059] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:05:17.463840  8265 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:05:17.464315  8265 pending_rounds.cc:85] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 8
I20260709 13:05:17.464529  8265 pending_rounds.cc:107] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 11.9
I20260709 13:05:17.464740  8265 raft_consensus.cc:2917] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Aborting config change with OpId 11.9: Aborted: Op aborted by new leader
W20260709 13:05:17.461796  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 66880us
I20260709 13:05:17.462443  8198 pending_rounds.cc:107] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:17.465180  8265 raft_consensus.cc:2889] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:17.465655  8198 raft_consensus.cc:2889] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:17.468844  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:17.503633  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49507.1us
I20260709 13:05:17.506464  8119 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 21.
I20260709 13:05:17.517620 13708 consensus_queue.cc:1048] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:05:17.519539  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 49401.5us
I20260709 13:05:17.520886 13856 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:05:17.521561 13864 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:17.522543 13897 raft_consensus.cc:3055] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:17.522917 13897 raft_consensus.cc:740] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:17.523432 13803 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:17.502998 13704 consensus_queue.cc:1048] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:05:17.469551 13548 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.526516  8089 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:17.453855 13520 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:17.461258 13850 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:17.527356 13667 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:17.527841  8089 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:17.523718 13897 consensus_queue.cc:260] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.529839  8196 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:17.538470  8089 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:17.539274  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:17.542273  8119 raft_consensus.cc:1275] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:17.539651 13804 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:17.593746  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 70471.5us
W20260709 13:05:17.593861  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 55527.2us
W20260709 13:05:17.584358 13877 log.cc:927] Time spent T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.006s
I20260709 13:05:17.596338 13573 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:17.607158 13573 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:05:17.623327 13899 log.cc:927] Time spent T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:17.538004 13619 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:05:17.625922 13619 consensus_queue.cc:1243] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer 17c126976afd40d9a398d13a5ddd222f log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:17.627223 13890 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:17.535243 13850 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.541661 13822 consensus_queue.cc:1048] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:05:17.543463 13704 consensus_queue.cc:1048] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:05:17.648234 13889 consensus_queue.cc:1048] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:17.542774 13520 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.584426 13846 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:17.672024  8191 raft_consensus.cc:1240] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:05:17.731186 13548 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:17.734555  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:17.697579 13866 raft_consensus.cc:3055] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:17.776319 13520 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:17.707527 13864 consensus_queue.cc:1059] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:05:17.779633 13850 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:17.751991 13866 raft_consensus.cc:740] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:17.791553 13854 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.813922 13854 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 21 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:17.795552 13866 consensus_queue.cc:260] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.821960  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:17.823302  8118 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:17.835630  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:17.836221  8116 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.844797  8116 raft_consensus.cc:2468] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 21.
I20260709 13:05:17.852468  8163 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:17.861004  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:17.863202  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:17.867367  8267 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:17.853585 13520 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.875128  8116 raft_consensus.cc:1275] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:17.877642 13897 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:17.881441 13880 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 13:05:17.911991  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.929759 13926 raft_consensus.cc:2804] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:17.930364 13926 raft_consensus.cc:697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 21 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:17.925304 13882 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:17.931339 13926 consensus_queue.cc:237] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.936879 13913 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:05:17.925267 13520 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:17.939920 13520 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:17.945592 13879 log.cc:927] Time spent T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:17.946237 13742 consensus_queue.cc:1048] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:17.948487 13882 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.956202  8197 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:17.960027  8116 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:17.961695  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:17.964232  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 50377.1us
I20260709 13:05:17.979588 13928 consensus_queue.cc:1059] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:17.980556 13928 raft_consensus.cc:3055] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:17.980865 13928 raft_consensus.cc:740] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:17.981695 13928 consensus_queue.cc:260] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:17.983484 13928 raft_consensus.cc:3060] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.983661 13169 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:17.991446 13882 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:17.976119  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 129465us
I20260709 13:05:17.996595  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:17.997318  8116 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:18.027421  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:18.039582  8809 pending_rounds.cc:85] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Aborting all ops after (but not including) 6
I20260709 13:05:18.039933  8809 pending_rounds.cc:107] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:05:18.040153  8809 raft_consensus.cc:2889] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:18.045392 13918 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:05:18.049842  8808 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEARNER]: Advancing to term 13
I20260709 13:05:18.051908  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:18.074548  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:18.077090  8119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:18.098963  8808 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:18.136215  8192 raft_consensus.cc:1240] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 21 LEADER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:18.250820  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:18.254048  8238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.256507 13933 log.cc:927] Time spent T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:05:18.251667 13855 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.256567  8811 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:18.259699  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:18.262029  8199 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:18.265129  8238 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.258248 13855 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:18.270833  8196 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:18.272663 13791 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:05:18.269987 13608 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:18.327214 13944 log.cc:927] Time spent T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:05:18.345543 13855 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:18.348968 13898 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.349567 13898 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:18.352787 13898 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:18.374450  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:18.443508  8120 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:05:18.461728  8237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.480046  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:18.480832  8271 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:18.506630  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.509716 13608 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:18.515134 13628 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 13:05:18.547437  8240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.555336  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.562489  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:18.563820 13718 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:18.564229 13718 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.564572 13718 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.565104 13910 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:18.562470  8120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:18.567914  8120 raft_consensus.cc:606] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.568181  8120 raft_consensus.cc:614] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:18.568812 13866 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:18.571506  8271 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:05:18.582252  8271 pending_rounds.cc:85] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting all ops after (but not including) 11
I20260709 13:05:18.582522  8271 pending_rounds.cc:107] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:05:18.582737  8271 raft_consensus.cc:2889] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:18.571719  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:18.590420  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.585700 13806 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.594029 13806 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:18.587512 13608 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.587756 13926 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:05:18.595651 13608 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:18.596413 13925 log.cc:927] Time spent T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: Append to log took a long time: real 0.667s	user 0.000s	sys 0.011s
I20260709 13:05:18.603153  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
W20260709 13:05:18.603168  8088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.606719  8121 raft_consensus.cc:2410] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:18.605674 13791 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:18.617877 13608 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:18.621918 13806 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:18.628054 13718 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:18.631996  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:18.634382  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:18.635319 13502 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:18.652251  8238 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:18.653937  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:18.656760  8191 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 16: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:05:18.660996  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 47871.7us
I20260709 13:05:18.663429  8121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:18.664247  8121 raft_consensus.cc:606] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:18.660336 13608 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:18.712296 13803 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:18.719089 13608 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:18.732702 13608 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.731462 13718 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:18.692507 13667 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:05:18.769608  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 105749us
I20260709 13:05:18.775331  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
W20260709 13:05:18.777148  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 105083us
W20260709 13:05:18.778795 13503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.003s	sys 0.015s
W20260709 13:05:18.779179 13503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.003s	sys 0.015s
W20260709 13:05:18.789665 13856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.014s	sys 0.043s
W20260709 13:05:18.794196 13856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.014s	sys 0.043s
W20260709 13:05:18.799532  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 211290us
I20260709 13:05:18.819139  8118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:18.819802  8118 raft_consensus.cc:606] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.801304 13892 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:18.822135  8807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40706 (request call id 984) took 1438 ms. Trace:
I20260709 13:05:18.823149  8807 rpcz_store.cc:276] 0709 13:05:17.389655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.391329 (+  1674us) service_pool.cc:224] Handling call
0709 13:05:17.454353 (+ 63024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.528336 (+ 73983us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:17.667662 (+139326us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.752860 (+ 85198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.752920 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:17.752965 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.044989 (+292024us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b1800400720. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd2ab03de1 00007fbd2ab105b1 00007fbd21c3b3f3 00007fbd21c3d7c1 00007fbd21c3d779 00007fbd21c3d709 00007fbd21c3d6d1 00007fbd21c3c9cd 000000000038f354 000000000038f199 00007fbd21c1e83a
0709 13:05:18.821917 (+776928us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54005b0ed4. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:05:18.821983 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.822084 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":472,"prepare.queue_time_us":243369,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":8864,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7074,"spinlock_wait_cycles":183800064,"thread_start_us":202827,"threads_started":2,"wal-append.queue_time_us":145094,"wal-append.run_cpu_time_us":958,"wal-append.run_wall_time_us":1001082}
I20260709 13:05:18.824726 13892 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:18.837227 13892 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:18.842090 13608 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:18.842450  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:18.843124  8269 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.847064 13608 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:18.847637  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:18.848336  8118 raft_consensus.cc:2393] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 in current term 15: Already voted for candidate 65d66cd655cd4400b079b4427061ca5e in this term.
I20260709 13:05:18.848273  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:18.849872  8199 raft_consensus.cc:2368] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 15. Current term is 16.
I20260709 13:05:18.852249  8269 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:18.854784  8238 leader_election.cc:400] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 15. Current term is 16.
I20260709 13:05:18.855124  8238 leader_election.cc:403] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:18.855340  8118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:18.855902  8118 raft_consensus.cc:606] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.858206  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:18.860802  8118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:18.861336  8118 raft_consensus.cc:606] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.861683  8118 raft_consensus.cc:614] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:18.858273 13619 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313) with higher term. Message: Invalid argument: T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 15. Current term is 16.
I20260709 13:05:18.865486  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:18.874650  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:18.877144  8166 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:18.888479 13855 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:18.897027 13855 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:18.898972 13855 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:18.916329  8091 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:18.922811  8019 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.923666 13803 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.924968  8019 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 6 to 9, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 9 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.927380  8019 catalog_manager.cc:5697] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.928727  8019 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:18.929981  8019 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 12 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 13 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:18.931289 13897 raft_consensus.cc:993] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:18.931741 13897 raft_consensus.cc:1081] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:18.932089  8019 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 11, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 11 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.936370  8019 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:18.942183  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:18.941960  8019 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 11 to 12, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:18.951112  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:18.950987  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet e848f577948c470fb4c95fcc2b55b7ef with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50776
I20260709 13:05:18.953440  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:18.953436 13885 raft_consensus.cc:1064] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:18.956843 13885 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:18.963581  8022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 170) took 8762 ms. Trace:
I20260709 13:05:18.963956  8022 rpcz_store.cc:276] 0709 13:05:10.201093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.201274 (+   181us) service_pool.cc:224] Handling call
0709 13:05:18.963493 (+8762219us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:17.258713 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:17.259222 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:17.259257 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:05:17.259276 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:17.260795 (+  1519us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:17.260851 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:17.260883 (+    32us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:05:17.380345 (+119462us) tablet.cc:701] Row locks acquired
0709 13:05:17.381994 (+  1649us) write_op.cc:260] PREPARE: finished
0709 13:05:17.385221 (+  3227us) write_op.cc:270] Start()
0709 13:05:17.385336 (+   115us) write_op.cc:276] Timestamp: P: 1783602317385172 usec, L: 0
0709 13:05:17.385411 (+    75us) op_driver.cc:348] REPLICATION: starting
0709 13:05:17.386051 (+   640us) log.cc:844] Serialized 7808 byte log entry
0709 13:05:17.795543 (+409492us) op_driver.cc:464] REPLICATION: finished
0709 13:05:17.925738 (+130195us) write_op.cc:301] APPLY: starting
0709 13:05:17.940870 (+ 15132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:18.342724 (+401854us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:18.342838 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:18.525997 (+183159us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:18.526305 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:05:18.526348 (+    43us) write_op.cc:312] APPLY: finished
0709 13:05:18.526729 (+   381us) log.cc:844] Serialized 180 byte log entry
0709 13:05:18.531775 (+  5046us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:18.531960 (+   185us) write_op.cc:454] Released schema lock
0709 13:05:18.532015 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:18.541681 (+  9666us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:18.541711 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":924263,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":77870,"apply.run_cpu_time_us":29659,"apply.run_wall_time_us":654724,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":263631,"prepare.run_cpu_time_us":54178,"prepare.run_wall_time_us":257796,"raft.queue_time_us":278331,"raft.run_cpu_time_us":11740,"raft.run_wall_time_us":58278,"replication_time_us":409981,"spinlock_wait_cycles":68864,"thread_start_us":455864,"threads_started":4,"wal-append.queue_time_us":128256}]]}
I20260709 13:05:18.968658  8121 raft_consensus.cc:1275] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:18.970263  8811 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:18.974207 13814 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:18.977769  8199 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:18.979403 13814 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:18.948213  8019 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.983779  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607b372ee65444fb8187089e3657ab3b" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:18.988605  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:18.990377  8019 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.994086  8274 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:18.973148 13803 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:18.995393 13895 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:18.995476  8269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:18.997610  8269 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.997967  8269 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.999154 13895 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.001158 13895 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:19.002075 13926 consensus_queue.cc:1048] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:18.994932 13708 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:19.006857  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:19.007591  8199 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:19.020345  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:19.020984  8274 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 18.
I20260709 13:05:19.021663  8091 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:19.019379  8118 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 16.
I20260709 13:05:19.024345 13814 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:19.027428 13837 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:19.020112  8269 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.025992  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:19.033865 13895 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:19.034262 13895 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:19.034610 13895 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.035993  8019 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 9, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 9 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.040088  8019 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 7 to 11, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 11 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:19.042976  8269 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:19.043224  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:19.043787  8118 raft_consensus.cc:3055] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:19.043886  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:19.044135  8118 raft_consensus.cc:740] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:19.046012  8199 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.046141  8019 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 8 to 11, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 11 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.044968  8118 consensus_queue.cc:260] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.055402  8118 raft_consensus.cc:3060] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.066620  8019 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 13 to 17, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 17 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.068382  8199 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:19.068773  8118 raft_consensus.cc:2468] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:19.070132  8237 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:19.073029 13895 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.076273 13895 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:19.077941 13966 tablet_replica.cc:333] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:19.078727  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:19.060176 13885 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:19.082800  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ccbf67588374458ebbd07bc5aeeb3b5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17c126976afd40d9a398d13a5ddd222f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.085283 13608 raft_consensus.cc:2804] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:19.088152  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:19.088850  8199 raft_consensus.cc:2393] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d66cd655cd4400b079b4427061ca5e in current term 18: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
I20260709 13:05:19.089090  8274 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 18.
I20260709 13:05:19.090040  8091 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:19.086261 13608 raft_consensus.cc:697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:19.095659 13608 consensus_queue.cc:237] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.079017 13966 raft_consensus.cc:2243] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.104995  8269 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:19.106508 13837 raft_consensus.cc:670] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:05:19.104992 13954 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:19.105185  8019 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.111641  8199 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.119158  8019 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 10 to 16, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 16 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.119776 13966 raft_consensus.cc:2272] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.119532 13954 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 18 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:19.144665 13954 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.152685 13966 ts_tablet_manager.cc:1916] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:05:19.172685 13969 log.cc:927] Time spent T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:19.189939 13806 raft_consensus.cc:993] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:19.198700 13806 raft_consensus.cc:1081] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:19.200630 13806 raft_consensus.cc:993] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:19.201164 13806 raft_consensus.cc:1081] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:19.200560  8199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
I20260709 13:05:19.202186  8199 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.202521  8199 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.202702  8191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
I20260709 13:05:19.203162  8191 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.203454  8191 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.209988  8199 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.220129  8199 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:19.223119 13806 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.223654 13806 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.224433  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:19.224972  8274 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.227216 13806 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:19.230618  8807 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.233646  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:19.240070  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:19.240751  8269 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 19.
I20260709 13:05:19.245028  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:19.245548  8118 raft_consensus.cc:3055] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:19.245800  8118 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:19.246448  8118 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.247406  8118 raft_consensus.cc:3060] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.218222  8191 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.266899  8274 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:19.271586  8166 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:19.274262 13855 raft_consensus.cc:2804] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:19.274750 13855 raft_consensus.cc:697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:19.275549 13855 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:19.285708  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:19.289680 13952 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:19.290087 13952 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.290418 13952 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.297629  8118 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:19.304786  8120 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:19.325673 13926 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:19.335016  8191 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:19.335417 13952 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.337448  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:40542
I20260709 13:05:19.338004  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:19.351081  8809 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.379000  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:19.379835  8274 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.347522  8120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:19.381259  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "65d66cd655cd4400b079b4427061ca5e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:19.384142  8120 raft_consensus.cc:3055] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:19.384500  8120 raft_consensus.cc:740] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:19.382099 13952 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:19.343490 13966 ts_tablet_manager.cc:1929] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 13:05:19.385135  8120 consensus_queue.cc:260] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.383028  8809 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:19.390733  8163 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:19.394939 13926 raft_consensus.cc:2804] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:19.395578 13926 raft_consensus.cc:697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:19.396381 13926 consensus_queue.cc:237] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.396935  8120 raft_consensus.cc:3060] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.410065  8274 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d66cd655cd4400b079b4427061ca5e in term 20.
I20260709 13:05:19.413870  8091 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:19.413949 13966 log.cc:1199] T e848f577948c470fb4c95fcc2b55b7ef P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/e848f577948c470fb4c95fcc2b55b7ef
I20260709 13:05:19.428624 13975 tablet_replica.cc:333] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:19.429574 13975 raft_consensus.cc:2243] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.430176 13975 raft_consensus.cc:2272] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.432484  8120 raft_consensus.cc:2468] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:19.422067 13895 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:19.437438  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet e848f577948c470fb4c95fcc2b55b7ef (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:19.442472 13895 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 20 LEADER]: Becoming Leader. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:19.443360 13895 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.455840 13975 ts_tablet_manager.cc:1916] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:19.462674  8274 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:19.464309 13855 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:19.534795 13975 ts_tablet_manager.cc:1929] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:05:19.535266 13975 log.cc:1199] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/2f5cf690845d47f4a2d4e3ab5d8922c0
I20260709 13:05:19.537503  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:19.553448 13927 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:19.554013 13927 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:19.571776 13927 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:19.573541  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:19.575776  8274 raft_consensus.cc:2368] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 19. Current term is 20.
I20260709 13:05:19.574205  8121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65d66cd655cd4400b079b4427061ca5e" is_pre_election: true
I20260709 13:05:19.577601  8777 leader_election.cc:400] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 19. Current term is 20.
I20260709 13:05:19.577875  8777 leader_election.cc:403] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:19.578405 13510 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.636508  8199 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:19.639369 13619 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:19.657725  8120 raft_consensus.cc:1275] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:19.663770  8269 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:19.672412 13837 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:19.683976  8120 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:19.694222 13926 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:19.698764  8266 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:19.699909 13608 consensus_queue.cc:1048] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:19.702272 13718 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:19.744848 13510 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007) with higher term. Message: Invalid argument: T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f for earlier term 19. Current term is 20.
I20260709 13:05:19.850952  8023 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 12 to 14, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.852381  8023 catalog_manager.cc:5697] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.850857  8192 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:19.853735  8023 catalog_manager.cc:5697] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.857839  8023 catalog_manager.cc:5697] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.859454  8023 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 11 to 16, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 16 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.860772  8023 catalog_manager.cc:5697] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.858263 13814 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:05:19.890592  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:40542
I20260709 13:05:19.875630  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.892136  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:19.913625  8809 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:19.916481  8023 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 18, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 18 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.928741 13892 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:05:19.941016  8019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 284) took 14341 ms (client timeout 15000 ms). Trace:
I20260709 13:05:19.946982  8023 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 16 to 19, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 19 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:19.948585  8023 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.961146  8269 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:19.966171 13892 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:05:19.941452  8019 rpcz_store.cc:269] 0709 13:05:05.598733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.598981 (+   248us) service_pool.cc:224] Handling call
0709 13:05:19.940201 (+14341220us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:19.362561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:19.363090 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:19.363122 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:05:19.363139 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:19.364396 (+  1257us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:19.364472 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:19.364498 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:05:19.386188 (+ 21690us) tablet.cc:701] Row locks acquired
0709 13:05:19.386206 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:19.386333 (+   127us) write_op.cc:270] Start()
0709 13:05:19.386454 (+   121us) write_op.cc:276] Timestamp: P: 1783602319386291 usec, L: 0
0709 13:05:19.386471 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:05:19.399766 (+ 13295us) log.cc:844] Serialized 6299 byte log entry
0709 13:05:19.437861 (+ 38095us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b540006c0a0. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c92090 00007fbd24c9f6b8 00007fbd24c9f2fa 00007fbd24d23965 00007fbd24d23e09 00007fbd2875e581 00007fbd2875dd58 00007fbd287629f1 00007fbd287629a9 00007fbd28762939 00007fbd28762901
0709 13:05:19.496019 (+ 58158us) op_driver.cc:464] REPLICATION: finished
0709 13:05:19.518787 (+ 22768us) write_op.cc:301] APPLY: starting
0709 13:05:19.518863 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:19.557911 (+ 39048us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:19.557932 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:19.583661 (+ 25729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:19.583935 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:05:19.583979 (+    44us) write_op.cc:312] APPLY: finished
0709 13:05:19.584298 (+   319us) log.cc:844] Serialized 148 byte log entry
0709 13:05:19.584458 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.584618 (+   160us) write_op.cc:454] Released schema lock
0709 13:05:19.584669 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:19.585028 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.585058 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":893344,"reported_tablets":50,"spinlock_wait_cycles":35584,"child_traces":[["op",{"apply.queue_time_us":22550,"apply.run_cpu_time_us":17576,"apply.run_wall_time_us":66237,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71103,"num_ops":16,"prepare.queue_time_us":149087,"prepare.run_cpu_time_us":7092,"prepare.run_wall_time_us":75494,"replication_time_us":109389,"spinlock_wait_cycles":27941632,"thread_start_us":184992,"threads_started":2}]]}
I20260709 13:05:20.004877  8118 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:19.949947  8023 catalog_manager.cc:5697] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 9 to 18, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 18 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.007314 13913 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:20.017591  8809 raft_consensus.cc:1275] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:20.019989 13913 consensus_queue.cc:1048] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:20.007938  8023 catalog_manager.cc:5697] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.033267  8023 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 15 to 16, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 16 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.061590  8023 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.063102  8023 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 13, now has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.065004  8023 catalog_manager.cc:5697] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 15 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.066673  8023 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 8 to 9, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 9 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.067984  8023 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 11 to 15, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.123042  8023 catalog_manager.cc:5697] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 14 to 16, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 16 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.135934  8023 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 14, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.147290  8023 catalog_manager.cc:5697] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.153704  8023 catalog_manager.cc:5697] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.155153  8023 catalog_manager.cc:5697] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.156507  8023 catalog_manager.cc:5697] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.378690  8023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 171) took 1234 ms. Trace:
I20260709 13:05:20.384479  8020 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 12 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.386180  8020 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 9 to 10, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 10 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.387724  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 12 to 13, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.379077  8023 rpcz_store.cc:276] 0709 13:05:19.144166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.144303 (+   137us) service_pool.cc:224] Handling call
0709 13:05:20.378605 (+1234302us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:20.178320 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:20.178809 (+   489us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:20.178845 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:05:20.178861 (+    16us) tablet.cc:662] Decoding operations
0709 13:05:20.180448 (+  1587us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:20.180524 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:20.180550 (+    26us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:05:20.183379 (+  2829us) tablet.cc:701] Row locks acquired
0709 13:05:20.183399 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:05:20.183531 (+   132us) write_op.cc:270] Start()
0709 13:05:20.183643 (+   112us) write_op.cc:276] Timestamp: P: 1783602320183485 usec, L: 0
0709 13:05:20.183664 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:05:20.184637 (+   973us) log.cc:844] Serialized 9261 byte log entry
0709 13:05:20.208199 (+ 23562us) op_driver.cc:464] REPLICATION: finished
0709 13:05:20.210985 (+  2786us) write_op.cc:301] APPLY: starting
0709 13:05:20.211064 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:20.259566 (+ 48502us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:20.259663 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:20.310843 (+ 51180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:20.311421 (+   578us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:05:20.311465 (+    44us) write_op.cc:312] APPLY: finished
0709 13:05:20.311875 (+   410us) log.cc:844] Serialized 204 byte log entry
0709 13:05:20.312045 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:20.312226 (+   181us) write_op.cc:454] Released schema lock
0709 13:05:20.312283 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:20.312681 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:20.312707 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":119009,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":2548,"apply.run_cpu_time_us":27917,"apply.run_wall_time_us":101684,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100405,"num_ops":23,"prepare.queue_time_us":14023,"prepare.run_cpu_time_us":5061,"prepare.run_wall_time_us":23659,"replication_time_us":24390,"thread_start_us":26329,"threads_started":2}]]}
I20260709 13:05:20.389076  8020 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 14 to 19, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 19 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.429098  8020 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.431663  8020 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 11 to 16, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 16 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.442020  8020 catalog_manager.cc:5697] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 14 to 15, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.443835  8020 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 15, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.445717  8020 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 13 to 14, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 14 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.447643  8020 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.449057  8020 catalog_manager.cc:5697] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.466348  8020 catalog_manager.cc:5697] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 14 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.467618  8020 catalog_manager.cc:5697] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 14 to 15, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.468954  8020 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 13 to 15, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.470811  8020 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.472307  8020 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.474308  8020 catalog_manager.cc:5697] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.545624  8017 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.547501  8017 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 6 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65), VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66), VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67), VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.552016  8017 catalog_manager.cc:5697] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:20.591120  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet e848f577948c470fb4c95fcc2b55b7ef with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:50776
I20260709 13:05:20.609403  8022 catalog_manager.cc:5697] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 16 to 17, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 17 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.612521  8022 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.615281  8022 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.616961  8022 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.618309  8020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38666 (request call id 249) took 7538 ms. Trace:
I20260709 13:05:20.618680  8020 rpcz_store.cc:276] 0709 13:05:13.073703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.074295 (+   592us) service_pool.cc:224] Handling call
0709 13:05:20.611739 (+7537444us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:20.485547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:20.486026 (+   479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:20.486060 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:05:20.486076 (+    16us) tablet.cc:662] Decoding operations
0709 13:05:20.487280 (+  1204us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:20.487327 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:20.487353 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:05:20.488458 (+  1105us) tablet.cc:701] Row locks acquired
0709 13:05:20.488487 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:05:20.488616 (+   129us) write_op.cc:270] Start()
0709 13:05:20.488727 (+   111us) write_op.cc:276] Timestamp: P: 1783602320488573 usec, L: 0
0709 13:05:20.488748 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:05:20.489308 (+   560us) log.cc:844] Serialized 6699 byte log entry
0709 13:05:20.491127 (+  1819us) op_driver.cc:464] REPLICATION: finished
0709 13:05:20.491541 (+   414us) write_op.cc:301] APPLY: starting
0709 13:05:20.491615 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:20.499836 (+  8221us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:20.499921 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:20.526456 (+ 26535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:20.526730 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:05:20.526779 (+    49us) write_op.cc:312] APPLY: finished
0709 13:05:20.527132 (+   353us) log.cc:844] Serialized 156 byte log entry
0709 13:05:20.527864 (+   732us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:20.528023 (+   159us) write_op.cc:454] Released schema lock
0709 13:05:20.528074 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:20.528471 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:20.528497 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3628,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":19685,"apply.run_wall_time_us":36881,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71162,"num_ops":17,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":4025,"prepare.run_wall_time_us":5496,"replication_time_us":2254}]]}
I20260709 13:05:20.624847  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet e848f577948c470fb4c95fcc2b55b7ef (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:20.619923  8022 catalog_manager.cc:5697] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 13 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 15 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.634861  8022 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.636477  8022 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 11 to 12, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 65d66cd655cd4400b079b4427061ca5e (127.6.215.65). New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.637671  8022 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.639454  8022 catalog_manager.cc:5697] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 12 to 17, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 17 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.641417  8022 catalog_manager.cc:5697] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 13 to 14, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.643180  8022 catalog_manager.cc:5697] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.644711  8022 catalog_manager.cc:5697] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.646219  8022 catalog_manager.cc:5697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
W20260709 13:05:20.803633  8018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 259) took 17401 ms (client timeout 15000 ms). Trace:
W20260709 13:05:20.804031  8018 rpcz_store.cc:269] 0709 13:05:03.402269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.405510 (+  3241us) service_pool.cc:224] Handling call
0709 13:05:20.803450 (+17397940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18558,"reported_tablets":50}
I20260709 13:05:20.812695  8022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 260) took 1761 ms. Trace:
I20260709 13:05:20.813251  8022 rpcz_store.cc:276] 0709 13:05:19.051284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.051446 (+   162us) service_pool.cc:224] Handling call
0709 13:05:20.812635 (+1761189us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:20.651544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:20.652023 (+   479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:20.652054 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:05:20.652071 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:20.653093 (+  1022us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:20.653145 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:20.653171 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:05:20.654266 (+  1095us) tablet.cc:701] Row locks acquired
0709 13:05:20.654284 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:20.654422 (+   138us) write_op.cc:270] Start()
0709 13:05:20.654529 (+   107us) write_op.cc:276] Timestamp: P: 1783602320654385 usec, L: 0
0709 13:05:20.654551 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:20.655012 (+   461us) log.cc:844] Serialized 5159 byte log entry
0709 13:05:20.657087 (+  2075us) op_driver.cc:464] REPLICATION: finished
0709 13:05:20.657514 (+   427us) write_op.cc:301] APPLY: starting
0709 13:05:20.657581 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:20.663845 (+  6264us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:20.663935 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:20.683195 (+ 19260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:20.683435 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:05:20.683476 (+    41us) write_op.cc:312] APPLY: finished
0709 13:05:20.683769 (+   293us) log.cc:844] Serialized 121 byte log entry
0709 13:05:20.684459 (+   690us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:20.684605 (+   146us) write_op.cc:454] Released schema lock
0709 13:05:20.684652 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:20.685016 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:20.685042 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18087,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":14921,"apply.run_wall_time_us":27460,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54418,"num_ops":13,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":3695,"prepare.run_wall_time_us":3696,"replication_time_us":2434}]]}
I20260709 13:05:20.867715  8022 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 17 to 18, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 18 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.869275  8022 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.941983  8022 catalog_manager.cc:5697] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 12 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } }
I20260709 13:05:20.985944  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:40542
W20260709 13:05:20.992520  8021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 283) took 44210 ms (client timeout 15000 ms). Trace:
W20260709 13:05:20.994230  8021 rpcz_store.cc:269] 0709 13:04:36.781839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.781990 (+   151us) service_pool.cc:224] Handling call
0709 13:05:20.992104 (+44210114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11939,"reported_tablets":50}
I20260709 13:05:20.999228  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 2f5cf690845d47f4a2d4e3ab5d8922c0 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:21.079205  8121 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.104285  8191 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:21.105895 13885 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:21.124626  8809 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:21.138871 13885 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:21.182508 13814 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:21.190883  8809 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:21.210930  8018 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 10 to 11, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New cstate: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:21.226457  8264 tablet_service.cc:1558] Processing DeleteTablet for tablet 446d688479d34112bfc4ab0afb09d6f5 with delete_type TABLET_DATA_TOMBSTONED (TS 9e0c7bd2e224498bb1c68be20e5b3561 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40542
I20260709 13:05:21.227514 13997 tablet_replica.cc:333] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:21.228951  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:21.244020 13997 raft_consensus.cc:2243] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.244827 13997 raft_consensus.cc:2272] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.248611 13997 ts_tablet_manager.cc:1916] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:21.265537 13997 ts_tablet_manager.cc:1929] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:05:21.266435 13997 log.cc:1199] T 446d688479d34112bfc4ab0afb09d6f5 P 9e0c7bd2e224498bb1c68be20e5b3561: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/wals/446d688479d34112bfc4ab0afb09d6f5
I20260709 13:05:21.268289  8010 catalog_manager.cc:5028] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): tablet 446d688479d34112bfc4ab0afb09d6f5 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:21.292543  8191 raft_consensus.cc:2955] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:21.310582  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 446d688479d34112bfc4ab0afb09d6f5 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:21.342182  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:21.342793  8122 raft_consensus.cc:606] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:21.355031  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:21.355605  8122 raft_consensus.cc:606] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:21.357882  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b269caef5384838a52bcedc78464607"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:21.358364  8122 raft_consensus.cc:606] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:21.360661  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:21.361150  8122 raft_consensus.cc:606] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:21.370774  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:21.371294  8122 raft_consensus.cc:606] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:21.372267  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:21.373849  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:21.412803 13814 raft_consensus.cc:993] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.413303 13892 raft_consensus.cc:1081] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.416002  8265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:21.416532  8265 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.416862  8265 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.425763  8265 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.432592  8265 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:21.433956  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:21.441398  8809 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.435555  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:21.445802  8122 raft_consensus.cc:3055] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:21.446115  8122 raft_consensus.cc:740] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:21.446808  8122 consensus_queue.cc:260] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.447860  8122 raft_consensus.cc:3060] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.456004  8809 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:21.464932  8237 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:21.466089 13628 raft_consensus.cc:2804] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:21.466574 13628 raft_consensus.cc:697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:21.467396 13628 consensus_queue.cc:237] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.468748  8122 raft_consensus.cc:2468] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:21.509724  8018 catalog_manager.cc:5697] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 15 to 16, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 16 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.566954 13814 raft_consensus.cc:993] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.567423 13814 raft_consensus.cc:1081] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.568861  8266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:21.569335  8266 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.569667  8266 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.575894  8266 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.578032  8266 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:21.578474  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:21.584385  8122 raft_consensus.cc:3055] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:21.584715  8122 raft_consensus.cc:740] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:21.585403  8122 consensus_queue.cc:260] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.586418  8122 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.578751  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:21.589677  8809 raft_consensus.cc:3060] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.603881  8809 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:21.608749  8122 raft_consensus.cc:2468] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:21.612272  8237 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:21.613091 13628 raft_consensus.cc:2804] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:21.613585 13628 raft_consensus.cc:697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:21.614388 13628 consensus_queue.cc:237] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.623129 13954 raft_consensus.cc:993] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.624392 13954 raft_consensus.cc:1081] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.626005  8266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:21.626506  8266 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.626818  8266 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.636133  8266 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:21.640168  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:21.640709  8199 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.646538  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:21.647228  8118 raft_consensus.cc:3055] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:21.647504  8118 raft_consensus.cc:740] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:21.648205  8118 consensus_queue.cc:260] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:21.649210  8118 raft_consensus.cc:3060] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.669159 14004 raft_consensus.cc:993] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:21.672101 14004 raft_consensus.cc:1081] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:21.672806  8199 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:21.674551  8238 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:21.675350 13608 raft_consensus.cc:2804] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:21.675770 13608 raft_consensus.cc:697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:21.676640  8192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b269caef5384838a52bcedc78464607"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
I20260709 13:05:21.676489 13608 consensus_queue.cc:237] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:21.677104  8192 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.677484  8192 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.683648  8118 raft_consensus.cc:2468] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:21.679894  8266 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:21.688537  8192 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.691778  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:21.692343  8807 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.696882  8807 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:21.697860  8163 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:21.698868 13926 raft_consensus.cc:2804] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:21.699334 13926 raft_consensus.cc:697] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:21.700145 13926 consensus_queue.cc:237] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.697973  8192 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:21.740324  8018 catalog_manager.cc:5697] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 19 to 20, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 20 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.746133  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:21.747316  8122 raft_consensus.cc:3055] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:21.747741  8122 raft_consensus.cc:740] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:21.749101  8122 consensus_queue.cc:260] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:21.752573  8122 raft_consensus.cc:3060] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.797653  8019 catalog_manager.cc:5697] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.811836  8122 raft_consensus.cc:2468] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:21.860200 13954 raft_consensus.cc:993] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.860872 13954 raft_consensus.cc:1081] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:21.863140  8265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:21.863977  8265 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.864398  8265 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.879666  8265 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:21.882938  8265 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:21.889140  8019 catalog_manager.cc:5697] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 15 to 16, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 16 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.903827  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:21.904479  8118 raft_consensus.cc:3055] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:21.904755  8118 raft_consensus.cc:740] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:21.905516  8118 consensus_queue.cc:260] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:21.913573  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 48246us
I20260709 13:05:21.914729  8118 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:21.917387  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 75655.4us
W20260709 13:05:21.933143  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 79178.9us
I20260709 13:05:21.936894  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:21.968847  8192 raft_consensus.cc:3060] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.983026  8118 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
W20260709 13:05:22.029873  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 53302.7us
I20260709 13:05:22.038269  8192 raft_consensus.cc:2468] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:22.046353  8238 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:22.047678 14017 raft_consensus.cc:2804] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:22.048205 14017 raft_consensus.cc:697] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:22.049134 14017 consensus_queue.cc:237] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:22.057433  8808 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:22.067070  8122 raft_consensus.cc:1275] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:22.079274 14018 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:22.083758 14011 consensus_queue.cc:1048] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:22.087824  8122 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:22.095326 14016 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:22.142838  8018 catalog_manager.cc:5697] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 15 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.169677  8808 raft_consensus.cc:1275] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:22.174649 14018 consensus_queue.cc:1048] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:22.261328  8121 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:22.265620  8199 raft_consensus.cc:1275] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:22.272096 14017 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:22.278345 14017 consensus_queue.cc:1048] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:22.294399  8120 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:22.371718 14008 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:05:22.373171  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 74806.9us
I20260709 13:05:22.374938  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.376989  8808 raft_consensus.cc:1275] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:22.383041 13926 consensus_queue.cc:1048] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:05:22.431558  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 133509us
I20260709 13:05:22.562817  8200 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:22.579087 13628 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:05:22.625175  8121 raft_consensus.cc:1275] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:22.627079 13628 consensus_queue.cc:1048] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:22.642304  8122 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:22.679848  8273 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:05:22.680187  8088 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8339f0f377ff4af7947c4a11b4aea010. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.681711  8200 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:22.682040 13954 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:22.683444 13892 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:22.708981 13892 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.709653  8273 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.731144  8021 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 10, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.740270  8118 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:22.753758  8200 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:05:22.757129  8088 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db7845485d6b4a86b219eae83659a36e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.772507  8192 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:22.774281 14007 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:22.776816  8273 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:22.779309 14033 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:22.812999 13892 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.815088  8273 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.840212  8192 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.872054  8273 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:22.878805  8019 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:05:22.893472  8237 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f86e3e4c37f4426b821f0af0b5b1c516. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.896318  8200 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:22.897861 13628 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:22.907063  8121 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:22.908480 13628 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:05:22.946066 14048 log.cc:927] Time spent T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:05:22.947335 13628 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.963335  8121 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.966096  8118 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:22.965054  8192 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:22.979305  8018 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 9, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:23.006577  8088 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55917afdf34f4dd3985df6ff71c4d019. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.010967  8200 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:23.012353 13892 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:23.014765  8271 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:23.017163 13892 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:23.052001 13892 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:23.052969  8271 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:23.056188  8200 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:23.120729  8019 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 17 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:23.266574 14055 ts_tablet_manager.cc:933] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:05:23.281781 14055 tablet_copy_client.cc:323] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:05:23.283739  8134 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 8339f0f377ff4af7947c4a11b4aea010 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:05:23.284305  8134 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 8339f0f377ff4af7947c4a11b4aea010 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-8339f0f377ff4af7947c4a11b4aea010
I20260709 13:05:23.354622  8134 tablet_copy_source_session.cc:215] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.376946 14055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8339f0f377ff4af7947c4a11b4aea010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.380198 14057 ts_tablet_manager.cc:933] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:05:23.390821 14057 tablet_copy_client.cc:323] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:05:23.392757  8134 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet db7845485d6b4a86b219eae83659a36e from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:05:23.393287  8134 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet db7845485d6b4a86b219eae83659a36e from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-db7845485d6b4a86b219eae83659a36e
I20260709 13:05:23.406621 14055 tablet_copy_client.cc:806] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.407291 14055 tablet_copy_client.cc:670] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.421437 14055 tablet_copy_client.cc:538] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.441069  8134 tablet_copy_source_session.cc:215] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.445946 14057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7845485d6b4a86b219eae83659a36e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.450523 14059 ts_tablet_manager.cc:933] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:23.464154 14057 tablet_copy_client.cc:806] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.464857 14057 tablet_copy_client.cc:670] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.477942 14059 tablet_copy_client.cc:323] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:05:23.479964  8283 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet f86e3e4c37f4426b821f0af0b5b1c516 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:05:23.480512  8283 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet f86e3e4c37f4426b821f0af0b5b1c516 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-f86e3e4c37f4426b821f0af0b5b1c516
I20260709 13:05:23.478253 14057 tablet_copy_client.cc:538] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.501681 14057 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:23.477260 14055 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:23.512652  8283 tablet_copy_source_session.cc:215] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.520597 14059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86e3e4c37f4426b821f0af0b5b1c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.510246 14061 ts_tablet_manager.cc:933] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095)
I20260709 13:05:23.539001 14061 tablet_copy_client.cc:323] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.65:38095
I20260709 13:05:23.540764  8134 tablet_copy_service.cc:140] P 65d66cd655cd4400b079b4427061ca5e: Received BeginTabletCopySession request for tablet 55917afdf34f4dd3985df6ff71c4d019 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:53286)
I20260709 13:05:23.541311  8134 tablet_copy_service.cc:161] P 65d66cd655cd4400b079b4427061ca5e: Beginning new tablet copy session on tablet 55917afdf34f4dd3985df6ff71c4d019 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:53286: session id = 17c126976afd40d9a398d13a5ddd222f-55917afdf34f4dd3985df6ff71c4d019
I20260709 13:05:23.553933  8134 tablet_copy_source_session.cc:215] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.562043 14061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55917afdf34f4dd3985df6ff71c4d019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.574460  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:23.580082 14059 tablet_copy_client.cc:806] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.580657 14059 tablet_copy_client.cc:670] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.589468 14059 tablet_copy_client.cc:538] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.624420 14059 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:23.630013 14061 tablet_copy_client.cc:806] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.630754 14061 tablet_copy_client.cc:670] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.642298 14061 tablet_copy_client.cc:538] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.673336 14061 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:23.704171 14055 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:23.705225 14055 tablet_bootstrap.cc:492] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:23.710493 14055 ts_tablet_manager.cc:1403] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.233s	user 0.047s	sys 0.004s
I20260709 13:05:23.711566  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13dada18d63642d99cf497f978999d7a"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:23.712251  8122 raft_consensus.cc:606] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:23.769817 14066 raft_consensus.cc:993] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:23.770305 14066 raft_consensus.cc:1081] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:23.781334  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22c63c7039644c089bf014466158ac6b"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:23.782044  8122 raft_consensus.cc:606] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:23.806962  8200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13dada18d63642d99cf497f978999d7a"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
I20260709 13:05:23.807672  8200 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:23.808037  8200 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:23.850133 14067 raft_consensus.cc:993] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:23.850656  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:23.851239  8122 raft_consensus.cc:606] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Received request to transfer leadership to TS afd11cff97554063a80d743fdf2b934d
I20260709 13:05:23.853912  8122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e"
dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
mode: GRACEFUL
new_leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:50538
I20260709 13:05:23.854427  8122 raft_consensus.cc:606] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Received request to transfer leadership to TS 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:23.855641  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:23.857226  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:23.862946 14067 raft_consensus.cc:1081] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:23.866750 14055 raft_consensus.cc:359] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:23.867707 14055 raft_consensus.cc:740] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:23.868434 14055 consensus_queue.cc:260] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:23.875084  8274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22c63c7039644c089bf014466158ac6b"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:23.875638  8274 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:23.875993  8274 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:23.879892 14057 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:23.880816 14057 tablet_bootstrap.cc:492] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:23.890537  8200 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:23.892303  8808 raft_consensus.cc:1217] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:05:23.894407 14055 ts_tablet_manager.cc:1434] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.184s	user 0.007s	sys 0.001s
I20260709 13:05:23.895191 14057 ts_tablet_manager.cc:1403] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.394s	user 0.035s	sys 0.017s
W20260709 13:05:23.901465  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 49386.8us
W20260709 13:05:23.923552  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 52075.9us
W20260709 13:05:23.952033  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 138199us
I20260709 13:05:23.952201  8274 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:23.963372  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 124274us
I20260709 13:05:23.966694  8274 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:23.969165 14057 raft_consensus.cc:359] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:23.970090 14057 raft_consensus.cc:740] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:23.970760 14057 consensus_queue.cc:260] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:23.971776  8134 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-8339f0f377ff4af7947c4a11b4aea010 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:05:23.972231  8134 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-8339f0f377ff4af7947c4a11b4aea010 on tablet 8339f0f377ff4af7947c4a11b4aea010 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:23.997699  8200 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:24.016769  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:24.017427  8196 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:24.022490 14066 raft_consensus.cc:993] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:24.023062 14066 raft_consensus.cc:1081] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Signalling peer 9e0c7bd2e224498bb1c68be20e5b3561 to start an election
I20260709 13:05:24.041985 14057 ts_tablet_manager.cc:1434] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 13:05:24.049520  8116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:24.050189  8116 raft_consensus.cc:3055] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:24.050508  8116 raft_consensus.cc:740] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:24.051204  8116 consensus_queue.cc:260] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.055500  8116 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.057818  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:24.058427  8269 raft_consensus.cc:3060] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.069469  8118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:24.070353  8118 raft_consensus.cc:3055] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:24.070670  8118 raft_consensus.cc:740] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:24.076315  8269 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:24.077152  8196 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:24.089147  8238 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:24.091818  8118 consensus_queue.cc:260] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.107757 14079 raft_consensus.cc:2804] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:24.108359 14079 raft_consensus.cc:697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:24.109259 14079 consensus_queue.cc:237] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.114923  8116 raft_consensus.cc:2468] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:24.116444  8269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e"
dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
 from {username='slave'} at 127.0.0.1:44562
I20260709 13:05:24.117035  8269 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.117470  8269 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.118734  8118 raft_consensus.cc:3060] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:24.127099  8088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 199678us
I20260709 13:05:24.144476  8269 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.153092  8134 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-db7845485d6b4a86b219eae83659a36e received from {username='slave'} at 127.0.0.1:53286
I20260709 13:05:24.137118  8118 raft_consensus.cc:2468] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 11.
I20260709 13:05:24.153820  8134 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-db7845485d6b4a86b219eae83659a36e on tablet db7845485d6b4a86b219eae83659a36e with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:24.151089  8163 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:24.157586 14080 raft_consensus.cc:2804] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:24.158074 14080 raft_consensus.cc:697] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:24.159250 14080 consensus_queue.cc:237] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.195972  8269 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:24.197019  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:24.197713  8196 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.209208  8196 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:24.212090  8122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:24.212690  8122 raft_consensus.cc:3055] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:24.212944  8122 raft_consensus.cc:740] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:24.214565  8238 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:24.215339 14077 raft_consensus.cc:2804] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:24.215860 14077 raft_consensus.cc:697] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:24.216775 14077 consensus_queue.cc:237] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.245378  8122 consensus_queue.cc:260] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.248911 14065 raft_consensus.cc:993] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: : Instructing follower afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:24.249487 14067 raft_consensus.cc:1081] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Signalling peer afd11cff97554063a80d743fdf2b934d to start an election
I20260709 13:05:24.261842  8122 raft_consensus.cc:3060] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.262588  8199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878"
dest_uuid: "afd11cff97554063a80d743fdf2b934d"
 from {username='slave'} at 127.0.0.1:50494
I20260709 13:05:24.263407  8199 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.263986  8199 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.257118 14059 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.286660 14059 tablet_bootstrap.cc:492] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:24.288102 14059 ts_tablet_manager.cc:1403] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.664s	user 0.040s	sys 0.043s
I20260709 13:05:24.341562  8122 raft_consensus.cc:2468] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:24.354300  8807 raft_consensus.cc:1217] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
W20260709 13:05:24.385267  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 156281us
W20260709 13:05:24.389500  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 105515us
I20260709 13:05:24.385982  8199 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.418443 14074 raft_consensus.cc:1064] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:24.418979  8199 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:24.434885  8123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "65d66cd655cd4400b079b4427061ca5e"
I20260709 13:05:24.434291  8021 catalog_manager.cc:5697] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 10 to 11, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 11 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:24.435456  8123 raft_consensus.cc:3055] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:24.435763  8123 raft_consensus.cc:740] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65d66cd655cd4400b079b4427061ca5e, State: Running, Role: LEADER
I20260709 13:05:24.436463  8123 consensus_queue.cc:260] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.439137  8123 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.443161  8019 catalog_manager.cc:5697] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 12 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 13 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.420981 14059 raft_consensus.cc:359] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:24.456332 14059 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:24.457149 14059 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:24.460176 14059 ts_tablet_manager.cc:1434] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.172s	user 0.007s	sys 0.000s
I20260709 13:05:24.428278 14074 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:24.482295  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:24.482877  8274 raft_consensus.cc:3060] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.503511  8123 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:24.504892  8163 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:24.505851 14087 raft_consensus.cc:2804] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:24.506470 14087 raft_consensus.cc:697] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:24.507711 14087 consensus_queue.cc:237] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:24.510013  8274 raft_consensus.cc:2468] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
I20260709 13:05:24.514034  8283 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-f86e3e4c37f4426b821f0af0b5b1c516 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:24.514483  8283 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-f86e3e4c37f4426b821f0af0b5b1c516 on tablet f86e3e4c37f4426b821f0af0b5b1c516 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:24.572860  8807 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:24.584306  8199 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:24.586136 14077 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:24.595170  8123 raft_consensus.cc:1275] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:24.599053 14083 consensus_queue.cc:1048] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:24.600914 14061 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.602427 14061 tablet_bootstrap.cc:492] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:24.602876 14074 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:24.606745 14061 ts_tablet_manager.cc:1403] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.934s	user 0.055s	sys 0.022s
I20260709 13:05:24.623658  8199 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:24.625629 13892 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:24.647399  8274 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:24.683956 14061 raft_consensus.cc:359] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:24.687305 14061 raft_consensus.cc:740] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:24.689431 14061 consensus_queue.cc:260] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:24.696110 14061 ts_tablet_manager.cc:1434] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.004s
I20260709 13:05:24.717172 14073 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:24.718320  8134 tablet_copy_service.cc:342] P 65d66cd655cd4400b079b4427061ca5e: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-55917afdf34f4dd3985df6ff71c4d019 received from {username='slave'} at 127.0.0.1:53286
I20260709 13:05:24.718865  8134 tablet_copy_service.cc:434] P 65d66cd655cd4400b079b4427061ca5e: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-55917afdf34f4dd3985df6ff71c4d019 on tablet 55917afdf34f4dd3985df6ff71c4d019 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:24.720395  8118 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:24.723016 14087 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:24.786388  8273 raft_consensus.cc:1275] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:24.788200 13926 consensus_queue.cc:1048] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:05:24.827121  8811 raft_consensus.cc:1217] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:05:24.847291  8123 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:24.863474 14071 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:24.873570  8199 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:24.951066  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:24.876806 14079 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:05:25.007328  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54272.1us
W20260709 13:05:25.025385  8089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 62034.9us
W20260709 13:05:25.034586 14105 log.cc:927] Time spent T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:05:25.068498  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 45740.4us
W20260709 13:05:25.095317 14106 log.cc:927] Time spent T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:25.103731  8807 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:25.123615  8091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 61735.5us
I20260709 13:05:25.187211  8274 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.196883  8120 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:25.200017  8021 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 10 to 11, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.215226 14073 raft_consensus.cc:1064] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:25.218449  8808 raft_consensus.cc:1217] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:05:25.229118 13718 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:05:25.233247 14073 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:25.234395  8018 catalog_manager.cc:5697] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.241091  8274 raft_consensus.cc:1275] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:25.263249 13926 consensus_queue.cc:1048] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:25.279608  8808 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:25.280510  8199 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:25.281090 14120 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:25.282186 14117 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:25.288599  8200 raft_consensus.cc:1275] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:25.321874  8269 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:25.340878 14072 raft_consensus.cc:1064] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:25.343616 14072 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:25.348755 14076 consensus_queue.cc:1048] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:25.352653 14120 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:25.359428  8808 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:25.365656  8200 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:25.373528  8019 catalog_manager.cc:5697] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.376614  8273 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:25.376600 14072 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:25.379431 14072 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:25.381330 14074 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:25.380684 14073 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.390290  8196 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.403630  8807 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.442588  8122 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:25.442672  8018 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.444391 14072 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.451066  8808 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:25.452471 14120 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:25.458843  8807 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.463223  8269 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:25.476577 14073 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:25.479013 14120 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.481608  8808 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.492725  8200 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.499410  8018 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.511518  8269 raft_consensus.cc:2955] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.551100  8271 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.535349  8022 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 11 to 12, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 15 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.593564  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8339f0f377ff4af7947c4a11b4aea010 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:05:25.678474  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 54279.8us
I20260709 13:05:25.690198  8116 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:25.705106  8273 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:25.721995 14115 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:05:25.732235  8808 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:25.737164 14072 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:05:25.756851  8273 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:25.781176  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 46237.2us
I20260709 13:05:25.807334 14114 raft_consensus.cc:1064] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:25.814512 14120 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.820376  8274 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.829872 14114 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:25.906642  8192 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:25.908685  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db7845485d6b4a86b219eae83659a36e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.910941  8022 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 10 to 11, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 12 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:25.934540  8807 raft_consensus.cc:2955] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:25.958873  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 50527.9us
I20260709 13:05:25.959640 14082 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:25.964484  8122 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:25.991917 14111 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:26.003621  8808 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:26.022189 14082 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:26.040906  8122 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:26.053961  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 8339f0f377ff4af7947c4a11b4aea010 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:34392
I20260709 13:05:26.054283  8182 tablet_service.cc:1558] Processing DeleteTablet for tablet db7845485d6b4a86b219eae83659a36e with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:34392
I20260709 13:05:26.067097  8809 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:26.068540  8273 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 65d66cd655cd4400b079b4427061ca5e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:26.068490 14120 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:26.070111 14143 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:26.070801 14150 tablet_replica.cc:333] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:26.073331 14111 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.076815 14150 raft_consensus.cc:2243] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.076998 14085 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.089082 14150 raft_consensus.cc:2272] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.088900  8811 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.089677  8274 raft_consensus.cc:2955] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.092342 14150 ts_tablet_manager.cc:1916] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.109548  8007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55917afdf34f4dd3985df6ff71c4d019 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:26.124078 14150 ts_tablet_manager.cc:1929] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:05:26.124637 14150 log.cc:1199] T 8339f0f377ff4af7947c4a11b4aea010 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/8339f0f377ff4af7947c4a11b4aea010
I20260709 13:05:26.126452 14150 tablet_replica.cc:333] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:26.126060  8019 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 13 to 14, VOTER afd11cff97554063a80d743fdf2b934d (127.6.215.66) evicted. New cstate: current_term: 17 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.127554 14150 raft_consensus.cc:2243] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.128294 14150 raft_consensus.cc:2272] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.128950  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 8339f0f377ff4af7947c4a11b4aea010 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:26.097761  8116 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.134207 14150 ts_tablet_manager.cc:1916] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.139961  8183 tablet_service.cc:1558] Processing DeleteTablet for tablet 55917afdf34f4dd3985df6ff71c4d019 with delete_type TABLET_DATA_TOMBSTONED (TS afd11cff97554063a80d743fdf2b934d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:34392
I20260709 13:05:26.176141  8192 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.176753  8811 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.189715 14150 ts_tablet_manager.cc:1929] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:05:26.190244 14150 log.cc:1199] T db7845485d6b4a86b219eae83659a36e P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/db7845485d6b4a86b219eae83659a36e
I20260709 13:05:26.191818  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet db7845485d6b4a86b219eae83659a36e (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:26.192003 14150 tablet_replica.cc:333] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:26.193259 14150 raft_consensus.cc:2243] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.198164 14150 raft_consensus.cc:2272] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.222497 14150 ts_tablet_manager.cc:1916] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.254155  8019 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e reported cstate change: config changed from index 9 to 10, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.310591  8274 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:26.329615  8811 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:26.330108  8192 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:26.332744 14111 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:26.337232 14111 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:26.340462 14109 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.345268  8192 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.352656  8811 raft_consensus.cc:2955] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.380203  8010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f86e3e4c37f4426b821f0af0b5b1c516 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:26.391376  8020 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 10 to 11, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 13 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:26.394663 14150 ts_tablet_manager.cc:1929] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:05:26.395155 14150 log.cc:1199] T 55917afdf34f4dd3985df6ff71c4d019 P afd11cff97554063a80d743fdf2b934d: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/wals/55917afdf34f4dd3985df6ff71c4d019
I20260709 13:05:26.396764  8008 catalog_manager.cc:5028] TS afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): tablet 55917afdf34f4dd3985df6ff71c4d019 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:26.413023  8107 tablet_service.cc:1558] Processing DeleteTablet for tablet f86e3e4c37f4426b821f0af0b5b1c516 with delete_type TABLET_DATA_TOMBSTONED (TS 65d66cd655cd4400b079b4427061ca5e not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50776
I20260709 13:05:26.451943 14151 tablet_replica.cc:333] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:26.453050 14151 raft_consensus.cc:2243] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.453855 14151 raft_consensus.cc:2272] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.457229 14151 ts_tablet_manager.cc:1916] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.519090 14151 ts_tablet_manager.cc:1929] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:05:26.521978 14151 log.cc:1199] T f86e3e4c37f4426b821f0af0b5b1c516 P 65d66cd655cd4400b079b4427061ca5e: Deleting WAL directory at /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/wals/f86e3e4c37f4426b821f0af0b5b1c516
I20260709 13:05:26.525045  8007 catalog_manager.cc:5028] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): tablet f86e3e4c37f4426b821f0af0b5b1c516 (table test-workload [id=c9876b25242c426292b7284a80fd52e1]) successfully deleted
I20260709 13:05:26.527709  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:26.602509  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:26.618657  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:26.960484  8007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19747a1b37df480faebc96d93689cda5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 65d66cd655cd4400b079b4427061ca5e from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "65d66cd655cd4400b079b4427061ca5e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:27.338120  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 66495.6us
W20260709 13:05:27.357980  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 83313.3us
I20260709 13:05:27.581113  8191 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:05:27.595369  8163 consensus_peers.cc:597] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7685faa95b5f44629fc266055fc278aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.597900  8273 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:27.598513  8122 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:27.599838 14182 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:27.601521 14179 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:27.635345  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:27.652868 14154 raft_consensus.cc:2955] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:27.673034  8271 raft_consensus.cc:2955] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:27.684196  8191 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:27.690428  8018 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 18 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.731806  8118 raft_consensus.cc:2955] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:27.779578  8271 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:27.786633 14182 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:27.812975  8122 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:27.841859 14152 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:27.844595  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
W20260709 13:05:27.852007  8163 consensus_peers.cc:597] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6579e4214554536b3727b869a8aedfa. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.858312  8163 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:05:27.876570 14182 raft_consensus.cc:2955] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:27.914296  8021 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 17 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.917197  8273 raft_consensus.cc:2955] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:05:27.922955  8163 consensus_peers.cc:597] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.921716  8191 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:05:27.923955  8163 consensus_peers.cc:597] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.940340  8237 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.941890  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 46586us
W20260709 13:05:27.943214  8237 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.946532  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.962388  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.969014  8163 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 157272e89e0f4099b4d825211d7d823a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.969631  8273 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:05:27.971946  8163 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.971974 14168 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:28.012538 14168 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:28.013670  8273 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:28.016237  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:28.017758  8163 consensus_peers.cc:597] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.019941  7005 tablet_replica.cc:333] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.020767  7005 raft_consensus.cc:2243] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.029125  7005 raft_consensus.cc:2272] T 7685faa95b5f44629fc266055fc278aa P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.033468  8832 debug-util.cc:398] Leaking SignalData structure 0x7b080035c320 after lost signal to thread 7008
W20260709 13:05:28.034531  8832 debug-util.cc:398] Leaking SignalData structure 0x7b08002e74e0 after lost signal to thread 8057
W20260709 13:05:28.035982  8832 debug-util.cc:398] Leaking SignalData structure 0x7b080013bd80 after lost signal to thread 8149
I20260709 13:05:28.035485  8271 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:05:28.037679  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:28.038563  8832 debug-util.cc:398] Leaking SignalData structure 0x7b0800193220 after lost signal to thread 8298
W20260709 13:05:28.039860  8832 debug-util.cc:398] Leaking SignalData structure 0x7b0800288fc0 after lost signal to thread 8835
I20260709 13:05:28.042234  8021 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 16 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.050161  7005 tablet_replica.cc:333] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.051121  7005 raft_consensus.cc:2243] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.051592  7005 raft_consensus.cc:2272] T bc9f1ca41df6462b902893527ceb3878 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.054121  7005 tablet_replica.cc:333] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.054868  7005 raft_consensus.cc:2243] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.055406  7005 raft_consensus.cc:2272] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.063022  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433): Couldn't send request to peer 17c126976afd40d9a398d13a5ddd222f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8843c2ad2d543b89354e114ebd9d638. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.068244  8191 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:05:28.071450  8163 consensus_peers.cc:597] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.074182 14175 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:28.082042  7005 tablet_replica.cc:333] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
W20260709 13:05:28.081257  8163 consensus_peers.cc:597] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.089748  7005 raft_consensus.cc:2243] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.093703  7005 raft_consensus.cc:2272] T 4fc42e8321e24c91a3684956eeb796b7 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.100538  7005 tablet_replica.cc:333] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.101445  7005 raft_consensus.cc:2243] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.102208  7005 raft_consensus.cc:2272] T 22c63c7039644c089bf014466158ac6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.109134  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.111478  7005 tablet_replica.cc:333] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.112452  7005 raft_consensus.cc:2243] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:28.113148  8237 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.113405  7005 raft_consensus.cc:2272] T ccbf67588374458ebbd07bc5aeeb3b5a P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.116897  7005 tablet_replica.cc:333] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.117727  7005 raft_consensus.cc:2243] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.118803  7005 raft_consensus.cc:2272] T bd9e13ff887048ca88ba20c2768182d3 P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.121274  7005 tablet_replica.cc:333] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.121960  7005 raft_consensus.cc:2243] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.122557  7005 raft_consensus.cc:2272] T 6b269caef5384838a52bcedc78464607 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.125083 14180 raft_consensus.cc:2955] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
I20260709 13:05:28.126928  8191 raft_consensus.cc:2955] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:05:28.135677  8237 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.137957  7005 tablet_replica.cc:333] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.138823  7005 raft_consensus.cc:2243] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.139372  7005 raft_consensus.cc:2272] T c8addb0a61b24a3fa8f4700e78ac3a48 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.150969  8163 consensus_peers.cc:597] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.155898  8021 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index -1 to 12, NON_VOTER 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) added. New cstate: current_term: 21 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } } }
W20260709 13:05:28.157419  8163 consensus_peers.cc:597] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.159987  7005 tablet_replica.cc:333] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.160820  7005 raft_consensus.cc:2243] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.161813  7005 raft_consensus.cc:2272] T 8339f0f377ff4af7947c4a11b4aea010 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.164332  7005 tablet_replica.cc:333] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.165513  7005 raft_consensus.cc:2243] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.166078  7005 raft_consensus.cc:2272] T 157272e89e0f4099b4d825211d7d823a P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.168864  7005 tablet_replica.cc:333] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.169629  7005 raft_consensus.cc:2243] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.170653  7005 raft_consensus.cc:2272] T 79c1b3089e984aa991014bbd831e7bfc P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.172358  8163 consensus_peers.cc:597] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.173298  7005 tablet_replica.cc:333] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.174111  7005 raft_consensus.cc:2243] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:05:28.174760  8237 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.175109  7005 raft_consensus.cc:2272] T c788fd48c46f4ede898fe663e6cf64cc P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.175362  8237 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.178182  7005 tablet_replica.cc:333] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.179131  7005 raft_consensus.cc:2243] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.180133  7005 raft_consensus.cc:2272] T 446d688479d34112bfc4ab0afb09d6f5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.182703  7005 tablet_replica.cc:333] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.183399  7005 raft_consensus.cc:2243] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.184314  7005 raft_consensus.cc:2272] T a4e63fd519e64f52b42bde9b044f1a9d P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.188450  8163 consensus_peers.cc:597] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.192745  7005 tablet_replica.cc:333] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.193585  7005 raft_consensus.cc:2243] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.194594  7005 raft_consensus.cc:2272] T 0862042002d04bcbb6dd1a4c89ed990c P 65d66cd655cd4400b079b4427061ca5e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.198586  7005 tablet_replica.cc:333] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.199362  7005 raft_consensus.cc:2243] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.200075  7005 raft_consensus.cc:2272] T 45f9d10e30d545a18e699e9ccaea3e4e P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.202724  7005 tablet_replica.cc:333] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
W20260709 13:05:28.203540  8237 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.203583  7005 raft_consensus.cc:2243] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.204399  7005 raft_consensus.cc:2272] T ff5d69caf66c468aa9766af3b02649b0 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.206809  7005 tablet_replica.cc:333] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.207579  7005 raft_consensus.cc:2243] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.209022  7005 raft_consensus.cc:2272] T 19747a1b37df480faebc96d93689cda5 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.209600  8163 consensus_peers.cc:597] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.211611  7005 tablet_replica.cc:333] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.212410  7005 raft_consensus.cc:2243] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.212908  7005 raft_consensus.cc:2272] T fe00257dce7d4bb38119184a1572ed9e P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.215353  7005 tablet_replica.cc:333] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.216084  7005 raft_consensus.cc:2243] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.219555  7005 raft_consensus.cc:2272] T 60fac097ca0e444dbe442019479fc818 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.231568  8163 consensus_peers.cc:597] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:28.236956  8237 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.241808 14202 ts_tablet_manager.cc:933] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:28.244189  7005 tablet_replica.cc:333] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.245023  7005 raft_consensus.cc:2243] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.245985  7005 raft_consensus.cc:2272] T 55917afdf34f4dd3985df6ff71c4d019 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.249307  7005 tablet_replica.cc:333] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.256085  7005 raft_consensus.cc:2243] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.255964 14202 tablet_copy_client.cc:323] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:05:28.256747  7005 raft_consensus.cc:2272] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.258172  8209 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 7685faa95b5f44629fc266055fc278aa from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:05:28.258769  8209 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 7685faa95b5f44629fc266055fc278aa from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-7685faa95b5f44629fc266055fc278aa
I20260709 13:05:28.259522  7005 tablet_replica.cc:333] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.266417  8209 tablet_copy_source_session.cc:215] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.266829  7005 raft_consensus.cc:2243] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.267494  7005 raft_consensus.cc:2272] T 363112022a444c2f8b7cf6e11c7c1c36 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.270341  7005 tablet_replica.cc:333] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.271047  7005 raft_consensus.cc:2243] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.271643  7005 raft_consensus.cc:2272] T e7922a990c04422aa6d20dbef2f00976 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.274013 14202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685faa95b5f44629fc266055fc278aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:28.289903  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.290437  7005 tablet_replica.cc:333] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.291357  7005 raft_consensus.cc:2243] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.292268  7005 raft_consensus.cc:2272] T db7845485d6b4a86b219eae83659a36e P 65d66cd655cd4400b079b4427061ca5e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.295383  7005 tablet_replica.cc:333] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.296253  7005 raft_consensus.cc:2243] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:28.296384  8163 consensus_peers.cc:597] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.317780  7005 raft_consensus.cc:2272] T 621c07aa07044d69b33dead0af7e7fd9 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.320648  7005 tablet_replica.cc:333] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
W20260709 13:05:28.326401  8163 consensus_peers.cc:597] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.333292  7005 raft_consensus.cc:2243] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.333890 14205 ts_tablet_manager.cc:933] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:28.337049 14202 tablet_copy_client.cc:806] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.337626 14202 tablet_copy_client.cc:670] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
W20260709 13:05:28.338737  8163 consensus_peers.cc:597] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:28.339385  8237 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.334061  7005 raft_consensus.cc:2272] T 327bf050c29d49408e736f7e8fda9e6b P 65d66cd655cd4400b079b4427061ca5e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.344791  7005 tablet_replica.cc:333] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.345569  7005 raft_consensus.cc:2243] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.346191  7005 raft_consensus.cc:2272] T d6579e4214554536b3727b869a8aedfa P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.348846  7005 tablet_replica.cc:333] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.349670  7005 raft_consensus.cc:2243] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.350227  7005 raft_consensus.cc:2272] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 65d66cd655cd4400b079b4427061ca5e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.353955  8774 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.354199 14205 tablet_copy_client.cc:323] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:05:28.354560 14202 tablet_copy_client.cc:538] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.358349  8209 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet d6579e4214554536b3727b869a8aedfa from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:05:28.358857  8209 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet d6579e4214554536b3727b869a8aedfa from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-d6579e4214554536b3727b869a8aedfa
I20260709 13:05:28.362686  7005 tablet_replica.cc:333] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.363626  7005 raft_consensus.cc:2243] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.364924  7005 raft_consensus.cc:2272] T b9f91b8425044826becb1f4ae12269f8 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:28.365970  8774 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.369038  8209 tablet_copy_source_session.cc:215] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.372484 14205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6579e4214554536b3727b869a8aedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.379315 14202 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:28.386467  7005 tablet_replica.cc:333] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.392750  7005 raft_consensus.cc:2243] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.393473  7005 raft_consensus.cc:2272] T e052a7e080bb4a1e9a5ae52b54c2408b P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.396145  7005 tablet_replica.cc:333] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.409988  7005 raft_consensus.cc:2243] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.412117  7005 raft_consensus.cc:2272] T 89c4577341fc4203869bd3f8476d9c43 P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.408929 14205 tablet_copy_client.cc:806] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.414040 14205 tablet_copy_client.cc:670] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.416638  7005 tablet_replica.cc:333] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
W20260709 13:05:28.418534  8774 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.418613  7005 raft_consensus.cc:2243] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.419368  7005 raft_consensus.cc:2272] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.421626 14205 tablet_copy_client.cc:538] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.425705  7005 tablet_replica.cc:333] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.426491  7005 raft_consensus.cc:2243] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.430364  7005 raft_consensus.cc:2272] T 13dada18d63642d99cf497f978999d7a P 65d66cd655cd4400b079b4427061ca5e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.432111 14205 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:28.436038  7005 tablet_replica.cc:333] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.436882  7005 raft_consensus.cc:2243] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.443696  7005 raft_consensus.cc:2272] T 05f6533c9e4149aa9b528e746b4052b3 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.455086  7005 tablet_replica.cc:333] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.455814  7005 raft_consensus.cc:2243] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.456367  7005 raft_consensus.cc:2272] T d4d62387bcf94eaaaf201aeca2c2a48f P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.459254  7005 tablet_replica.cc:333] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.462766  7005 raft_consensus.cc:2243] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.463372  7005 raft_consensus.cc:2272] T b3e62d20a8d54072882e6b574cdddee5 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.471539  7005 tablet_replica.cc:333] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.472226  7005 raft_consensus.cc:2243] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.479417  7005 raft_consensus.cc:2272] T 587b9bcf479d417dbc213189e328a0f8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.482013  7005 tablet_replica.cc:333] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.482671  7005 raft_consensus.cc:2243] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.483536  7005 raft_consensus.cc:2272] T 76f64012d7a146ddb8774cc4299a38e8 P 65d66cd655cd4400b079b4427061ca5e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.486035  7005 tablet_replica.cc:333] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.486655  7005 raft_consensus.cc:2243] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.487510  7005 raft_consensus.cc:2272] T d0ae8ee6216f434eb7857a29d9b682d9 P 65d66cd655cd4400b079b4427061ca5e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.489790  7005 tablet_replica.cc:333] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.506201  7005 raft_consensus.cc:2243] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.506770  7005 raft_consensus.cc:2272] T 2d9a86475338460da550bd2a16b10c49 P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.509609  7005 tablet_replica.cc:333] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.511059  7005 raft_consensus.cc:2243] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.511546  7005 raft_consensus.cc:2272] T e8843c2ad2d543b89354e114ebd9d638 P 65d66cd655cd4400b079b4427061ca5e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.513953  7005 tablet_replica.cc:333] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.514586  7005 raft_consensus.cc:2243] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.515161  7005 raft_consensus.cc:2272] T 607b372ee65444fb8187089e3657ab3b P 65d66cd655cd4400b079b4427061ca5e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.533965  7005 tablet_replica.cc:333] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.534438 14208 ts_tablet_manager.cc:933] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:28.534634  7005 raft_consensus.cc:2243] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.535270  7005 raft_consensus.cc:2272] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.537937  7005 tablet_replica.cc:333] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.538585  7005 raft_consensus.cc:2243] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.539605  7005 raft_consensus.cc:2272] T 3ca6717bd9844d668ee0a2fff3b530f4 P 65d66cd655cd4400b079b4427061ca5e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.552527 14202 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=3 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.557106  7005 tablet_replica.cc:333] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e: stopping tablet replica
I20260709 13:05:28.557865  7005 raft_consensus.cc:2243] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:28.558379  7005 raft_consensus.cc:2272] T 07a2d8845b23413289268a178d97a8ea P 65d66cd655cd4400b079b4427061ca5e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.559371 14202 tablet_bootstrap.cc:492] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:28.561692 14208 tablet_copy_client.cc:323] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.67:43007
I20260709 13:05:28.563882  8283 tablet_copy_service.cc:140] P 9e0c7bd2e224498bb1c68be20e5b3561: Received BeginTabletCopySession request for tablet e8843c2ad2d543b89354e114ebd9d638 from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:34584)
I20260709 13:05:28.564381  8283 tablet_copy_service.cc:161] P 9e0c7bd2e224498bb1c68be20e5b3561: Beginning new tablet copy session on tablet e8843c2ad2d543b89354e114ebd9d638 from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:34584: session id = 17c126976afd40d9a398d13a5ddd222f-e8843c2ad2d543b89354e114ebd9d638
I20260709 13:05:28.560127 14202 ts_tablet_manager.cc:1403] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.181s	user 0.040s	sys 0.008s
I20260709 13:05:28.584769  8283 tablet_copy_source_session.cc:215] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.593096 14202 raft_consensus.cc:359] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:28.594003 14202 raft_consensus.cc:740] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:28.594743 14202 consensus_queue.cc:260] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:28.610057 14208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8843c2ad2d543b89354e114ebd9d638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.632385 14205 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.633334 14205 tablet_bootstrap.cc:492] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:28.634047 14205 ts_tablet_manager.cc:1403] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.202s	user 0.031s	sys 0.014s
I20260709 13:05:28.636595 14211 ts_tablet_manager.cc:933] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: Initiating tablet copy from peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:28.645937 14205 raft_consensus.cc:359] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:28.646787 14205 raft_consensus.cc:740] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:28.647516 14202 ts_tablet_manager.cc:1434] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:05:28.647394 14205 consensus_queue.cc:260] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:28.649114  8209 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-7685faa95b5f44629fc266055fc278aa received from {username='slave'} at 127.0.0.1:36640
I20260709 13:05:28.649534  8209 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-7685faa95b5f44629fc266055fc278aa on tablet 7685faa95b5f44629fc266055fc278aa with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:28.660483  8811 raft_consensus.cc:1217] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:05:28.680635 14205 ts_tablet_manager.cc:1434] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:05:28.688887  8209 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-d6579e4214554536b3727b869a8aedfa received from {username='slave'} at 127.0.0.1:36640
I20260709 13:05:28.689303  8209 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-d6579e4214554536b3727b869a8aedfa on tablet d6579e4214554536b3727b869a8aedfa with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:28.720644 14208 tablet_copy_client.cc:806] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.753895 14211 tablet_copy_client.cc:323] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.215.66:37313
I20260709 13:05:28.758991  8209 tablet_copy_service.cc:140] P afd11cff97554063a80d743fdf2b934d: Received BeginTabletCopySession request for tablet 157272e89e0f4099b4d825211d7d823a from peer 17c126976afd40d9a398d13a5ddd222f ({username='slave'} at 127.0.0.1:36640)
I20260709 13:05:28.759528  8209 tablet_copy_service.cc:161] P afd11cff97554063a80d743fdf2b934d: Beginning new tablet copy session on tablet 157272e89e0f4099b4d825211d7d823a from peer 17c126976afd40d9a398d13a5ddd222f at {username='slave'} at 127.0.0.1:36640: session id = 17c126976afd40d9a398d13a5ddd222f-157272e89e0f4099b4d825211d7d823a
I20260709 13:05:28.767150  8209 tablet_copy_source_session.cc:215] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.774152 14208 tablet_copy_client.cc:670] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.812618 14211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157272e89e0f4099b4d825211d7d823a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:28.934185  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 129362us
I20260709 13:05:28.934406  8811 raft_consensus.cc:1217] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:05:28.996754 14208 tablet_copy_client.cc:538] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:29.021298 14211 tablet_copy_client.cc:806] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:29.030361 14211 tablet_copy_client.cc:670] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:29.038489 14208 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:29.053457 14211 tablet_copy_client.cc:538] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:29.068878 14211 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: Bootstrap starting.
I20260709 13:05:29.090845 14232 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.091394 14232 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.098388  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.100862 14232 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:29.129561  8237 leader_election.cc:336] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.130097  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.130878 14230 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:29.165879 14230 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.166378 14230 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:29.168604 14230 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.180205  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:29.182633  8237 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.185881  8238 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:29.186899 14222 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:29.200543 14225 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.201094 14225 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.205765 14225 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:29.207711  8774 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.207864  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.207747 14182 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.210427  8777 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:29.209131 14182 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.212759 14182 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.214762  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.215699 14225 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:29.222029  8163 leader_election.cc:336] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.222441  8163 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.223692 14182 raft_consensus.cc:2749] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:29.249015 14214 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.249598 14214 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.252099 14214 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.253630  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.254879  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.263625  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:29.264891 14214 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:29.268260  8163 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.270546 14213 raft_consensus.cc:1064] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:29.273483 14213 consensus_queue.cc:237] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.277819 14214 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.278342 14214 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.280189 14214 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.281704  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:29.284155  8163 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.284533  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.285173 14214 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:29.290966  8271 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:29.292372  8811 raft_consensus.cc:1275] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:29.292232 14213 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:29.297765 14230 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.298231 14230 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.299044 14222 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.299544 14222 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.300176 14230 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.301512 14222 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.303385  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.303725  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:29.309180  8237 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.309669  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:29.311172  8237 leader_election.cc:336] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:29.312532  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.313447 14230 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:29.314096 14230 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:29.317307 14213 consensus_queue.cc:1048] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:29.319964 14208 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.321007 14208 tablet_bootstrap.cc:492] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
W20260709 13:05:29.327198  8163 consensus_peers.cc:597] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:29.334951 14208 ts_tablet_manager.cc:1403] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.297s	user 0.024s	sys 0.021s
I20260709 13:05:29.348284 14208 raft_consensus.cc:359] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:29.351652 14208 raft_consensus.cc:740] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:29.353243 14208 consensus_queue.cc:260] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:29.356841 14208 ts_tablet_manager.cc:1434] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:05:29.360741  8283 tablet_copy_service.cc:342] P 9e0c7bd2e224498bb1c68be20e5b3561: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-e8843c2ad2d543b89354e114ebd9d638 received from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:29.360984 14223 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.361321  8283 tablet_copy_service.cc:434] P 9e0c7bd2e224498bb1c68be20e5b3561: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-e8843c2ad2d543b89354e114ebd9d638 on tablet e8843c2ad2d543b89354e114ebd9d638 with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:29.361542 14223 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.367394 14223 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.370209  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.370832  8191 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:29.371950  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:29.373553 14225 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:29.373934 14225 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.374279 14225 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.377736 14171 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.391748 14171 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.393812 14171 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.408792  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.421175 14232 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.421763 14232 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.423676 14232 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.424755 14214 raft_consensus.cc:2955] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:29.436357 14215 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.436888 14215 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.427255  8811 raft_consensus.cc:2955] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:29.450588 14171 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.451287 14171 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.452937 14215 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.448665 14222 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.453707 14222 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.455215  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.455432 14222 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.455817  8273 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 12.
I20260709 13:05:29.467818  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.468381  8811 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:29.472071  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.477669  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:29.480775 14222 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:29.481101 14222 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.481459 14222 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.453222 14171 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:29.494716  8237 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.501092 14171 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.502480 14171 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.476926 14218 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.510036 14211 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.509084 14161 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.511039 14211 tablet_bootstrap.cc:492] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: Bootstrap complete.
I20260709 13:05:29.510296 14218 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.528990 14171 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:29.531847  8237 leader_election.cc:336] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.534577  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.511062 14161 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.535763 14241 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.542333 14232 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:29.544636  8774 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:29.545620  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.546059  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:29.547132  8774 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.550724 14171 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:29.527935 14211 ts_tablet_manager.cc:1403] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: Time spent bootstrapping tablet: real 0.459s	user 0.054s	sys 0.022s
I20260709 13:05:29.560796 14218 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.562983 14225 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.564947 14225 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:29.565415  8774 leader_election.cc:336] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.567866 14222 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.571637  8273 raft_consensus.cc:2955] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:29.576131 14222 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:29.567989  8774 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.585160 14230 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.585479 14161 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.539497 14241 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.586463 14230 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.587680 14241 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.589135 14230 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.592861 14182 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.593442 14182 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:29.593590  8163 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.594476  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.595083  8191 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
W20260709 13:05:29.595583  8237 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:29.596161  8237 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:29.596589  8237 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.556732 14211 raft_consensus.cc:359] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
I20260709 13:05:29.600441  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:29.601001  8811 raft_consensus.cc:3060] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.601679  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.602294  8191 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 9.
I20260709 13:05:29.603737 14215 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.604218 14215 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.605334  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.606086 14215 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.607009  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:29.607177  8811 raft_consensus.cc:2468] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 21.
I20260709 13:05:29.607534  8191 raft_consensus.cc:3060] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.609795  8777 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.611531  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.612048  8237 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.612103  8811 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:29.611433  8018 catalog_manager.cc:5697] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:29.610078  8775 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.617120  8191 raft_consensus.cc:2468] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:29.621520  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.622156  8809 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:29.595463 14182 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.628871 14222 raft_consensus.cc:2804] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:29.629434 14215 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.629441 14222 raft_consensus.cc:697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:29.630517 14222 consensus_queue.cc:237] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.638238 14245 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.638844 14245 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:29.641508 14215 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:29.642462 14245 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.643451 14215 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.608456 14211 raft_consensus.cc:740] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Initialized, Role: LEARNER
I20260709 13:05:29.646242 14211 consensus_queue.cc:260] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: NON_VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: true } }
W20260709 13:05:29.650405  8163 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.655359  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.655998  8269 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:29.656383  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.657308 14218 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:29.658716  8775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49864.1us
I20260709 13:05:29.658870 14218 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.659682  8775 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:29.660635 14242 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:29.660992 14242 raft_consensus.cc:493] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:29.674015  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 64292.9us
I20260709 13:05:29.670071  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:29.679224  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.679894  8811 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:29.655287 14243 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.682284  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:29.682747 14243 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.683761  8809 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 13.
I20260709 13:05:29.661326 14242 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.657474 14223 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.685142  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:29.686844  8774 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.678382 14215 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:29.694128  8811 raft_consensus.cc:1217] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 13:05:29.689007  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.678187 14171 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:29.695029  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.695616  8191 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:29.699939  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.700912  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.701176  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.701778  8273 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:29.701874 14182 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:29.702363 14182 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.702715 14182 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.700868  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.704525  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.684790 14244 raft_consensus.cc:2804] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:29.681239 14218 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.688316 14232 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:29.693816 14215 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.704632 14171 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.724264 14224 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:29.724723 14224 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.725072 14224 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.728328 14241 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.728863 14241 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.730963 14241 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:29.733224  8163 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.733713  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:29.734598  8163 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:29.735334  8163 leader_election.cc:336] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.735673  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:29.737363 14221 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:29.738049 14221 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:29.746942  8774 leader_election.cc:336] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.748755 14217 raft_consensus.cc:1064] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
W20260709 13:05:29.752420  8774 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:29.752925  8774 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:29.753302  8774 leader_election.cc:336] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.722805 14244 raft_consensus.cc:697] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:29.757109 14244 consensus_queue.cc:237] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:29.763736  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 58482.8us
I20260709 13:05:29.766111  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.720131 14232 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.703785 14223 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.761907 14215 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:29.762152 14171 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:29.723467 14243 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.778041 14232 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.781554  8777 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.782828  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:29.785290  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.785929  8265 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:29.786509 14249 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:29.786911 14249 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.787230 14249 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.791159 14241 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:29.807170 14180 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.807780 14180 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:29.811439 14217 consensus_queue.cc:237] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.813905 14180 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.818102 14223 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.826057 14249 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.832162 14161 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.832655 14161 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:29.833333  8774 leader_election.cc:336] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.834482 14161 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:29.849334  8774 leader_election.cc:336] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.781283 14251 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:29.869289  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 152529us
I20260709 13:05:29.862998 14251 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.873857  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.874495  8196 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:29.875519  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.876132  8196 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 13.
I20260709 13:05:29.880856  8777 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.872311 14249 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.883316  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:29.883878  8265 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:29.884605 14224 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.885535  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:29.886037  8271 raft_consensus.cc:3060] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.886535 14224 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.875088 14251 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:29.889655  8191 raft_consensus.cc:2393] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate afd11cff97554063a80d743fdf2b934d in this term.
W20260709 13:05:29.893883  8237 leader_election.cc:336] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.894398 14211 ts_tablet_manager.cc:1434] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: Time spent starting tablet: real 0.341s	user 0.018s	sys 0.000s
I20260709 13:05:29.871608 14232 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.897629  8267 raft_consensus.cc:2393] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17c126976afd40d9a398d13a5ddd222f in current term 14: Already voted for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in this term.
I20260709 13:05:29.898576 14242 raft_consensus.cc:515] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.900576 14242 leader_election.cc:290] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.905200 14249 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.905723 14249 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.907019  8775 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:29.904917 14215 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:29.908670  8237 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.913601  8271 raft_consensus.cc:2468] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:29.914664  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:29.916409  8811 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.919832  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:29.920446  8191 raft_consensus.cc:3060] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.915735  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0862042002d04bcbb6dd1a4c89ed990c" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:29.921630  8196 raft_consensus.cc:3060] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.927098  8191 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:29.929077  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.930294 14180 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:29.930657 14180 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.930992  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.931007 14180 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.931951  8196 raft_consensus.cc:2468] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 10.
I20260709 13:05:29.932322 14260 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:29.932611  8811 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:29.909394  8209 tablet_copy_service.cc:342] P afd11cff97554063a80d743fdf2b934d: Request end of tablet copy session 17c126976afd40d9a398d13a5ddd222f-157272e89e0f4099b4d825211d7d823a received from {username='slave'} at 127.0.0.1:36640
W20260709 13:05:29.938546  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 57800.6us
I20260709 13:05:29.939342  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.939394  8237 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:29.940894  8777 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:29.897660 14232 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.933159 14260 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.882282 14182 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.941203  8209 tablet_copy_service.cc:434] P afd11cff97554063a80d743fdf2b934d: ending tablet copy session 17c126976afd40d9a398d13a5ddd222f-157272e89e0f4099b4d825211d7d823a on tablet 157272e89e0f4099b4d825211d7d823a with peer 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:29.952837 14256 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:29.956207 14171 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.958176 14171 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:29.951216  8777 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.952381 14255 raft_consensus.cc:3060] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.961782 14182 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.965081 14258 raft_consensus.cc:2804] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:29.965590 14258 raft_consensus.cc:697] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:29.966526 14249 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:29.966378 14258 consensus_queue.cc:237] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.949394 14244 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:29.967316 14244 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.967684 14244 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.943778 14223 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:29.970085  8774 leader_election.cc:336] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:29.977272  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:29.977015 14223 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.978922 14223 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.979657  8775 leader_election.cc:304] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:29.982110 14256 raft_consensus.cc:2804] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:29.982577 14256 raft_consensus.cc:697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:29.983374 14256 consensus_queue.cc:237] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.987242  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:29.987897  8200 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:29.989748 14251 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.990604 14223 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.991711 14251 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:29.950129 14260 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.998878 14213 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
I20260709 13:05:29.977535 14232 raft_consensus.cc:2804] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:29.999392 14213 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:29.996598  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:30.004303  8163 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.004381  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:30.009542  8809 raft_consensus.cc:3060] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:30.010224 14213 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:30.000015 14232 raft_consensus.cc:697] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:30.019021  8808 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:30.020103  8809 raft_consensus.cc:2468] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:29.987203 14215 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:30.027647  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 88312.6us
I20260709 13:05:30.027681  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:30.029318  8267 raft_consensus.cc:3060] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:30.008342 14242 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:30.035444 14255 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:30.038094  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:30.040800  8774 leader_election.cc:336] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.031585 14242 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65d66cd655cd4400b079b4427061ca5e)
W20260709 13:05:30.041565  8774 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.041682 14242 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.043063 14223 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:30.045698  8811 raft_consensus.cc:2468] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:30.048705  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:30.049247  8808 raft_consensus.cc:3060] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.050619  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd9e13ff887048ca88ba20c2768182d3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:30.051133  8273 raft_consensus.cc:3060] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:30.014037 14180 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:30.092010  8774 leader_election.cc:336] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.097610  8808 raft_consensus.cc:2468] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 15.
I20260709 13:05:30.093905  8267 raft_consensus.cc:2468] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
I20260709 13:05:30.040726 14232 consensus_queue.cc:237] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.101022 14180 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:30.102273 14244 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.099056  8273 raft_consensus.cc:2468] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 19.
I20260709 13:05:30.104796 14244 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:30.106582 14260 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:30.108584 14260 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:30.110133  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 57978.4us
W20260709 13:05:30.112663  8237 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:30.112907  8774 leader_election.cc:336] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.123769  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:30.124392  8267 raft_consensus.cc:3060] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:30.128078  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:30.128657  8274 raft_consensus.cc:3060] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:30.129876  8777 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:30.131162 14258 raft_consensus.cc:2804] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:30.131843 14258 raft_consensus.cc:697] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:30.132179  8267 raft_consensus.cc:2468] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:30.132736 14258 consensus_queue.cc:237] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.133275  8237 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:30.139360  8274 raft_consensus.cc:2468] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:30.140587  8267 raft_consensus.cc:1275] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:30.140601 14232 raft_consensus.cc:2804] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:30.141430  8777 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:30.141765 14232 raft_consensus.cc:697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:30.138281  8166 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:30.142560  8777 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:30.143812 14252 raft_consensus.cc:2804] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:30.144330 14252 raft_consensus.cc:697] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:30.145164 14252 consensus_queue.cc:237] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.147212 14249 raft_consensus.cc:2804] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:30.147683 14249 raft_consensus.cc:697] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:30.137701  8163 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:30.148452 14249 consensus_queue.cc:237] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.153663 14217 raft_consensus.cc:2804] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:30.154217 14217 raft_consensus.cc:697] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 19 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:30.155090 14217 consensus_queue.cc:237] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:30.156953  8163 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:30.157539 14215 raft_consensus.cc:2804] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:30.158133 14213 raft_consensus.cc:2804] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:30.123481 14242 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.158632 14213 raft_consensus.cc:697] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:30.159246  8809 raft_consensus.cc:2393] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 15: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:30.159475 14213 consensus_queue.cc:237] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:30.161996  8163 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.157994 14215 raft_consensus.cc:697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:30.164132 14215 consensus_queue.cc:237] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.157964 14267 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:30.169206  8811 raft_consensus.cc:1217] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:05:30.173381  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:30.173900  8191 raft_consensus.cc:3060] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:30.175194  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:30.175751  8192 raft_consensus.cc:3060] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.182812  8192 raft_consensus.cc:2468] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 14.
I20260709 13:05:30.142726 14232 consensus_queue.cc:237] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.183346  8191 raft_consensus.cc:2468] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
W20260709 13:05:30.186131  8237 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:30.186911  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.197674 14245 consensus_queue.cc:1048] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:30.193565  8238 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:30.207170 14242 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Requested vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:30.214440  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:30.215065  8196 raft_consensus.cc:3060] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.229964  8238 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:30.235896  8196 raft_consensus.cc:2468] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:30.237062  8775 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
W20260709 13:05:30.241549  8237 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:30.245774  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45144.1us
I20260709 13:05:30.248870 14268 raft_consensus.cc:2804] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:30.265865 14268 raft_consensus.cc:697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:30.266765 14268 consensus_queue.cc:237] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:30.274662 14222 raft_consensus.cc:1064] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:30.278519  8811 raft_consensus.cc:1275] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:30.240715 14256 raft_consensus.cc:2804] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:30.293704  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 63672.7us
W20260709 13:05:30.294274  8163 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:30.294955  8163 leader_election.cc:336] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:30.295331  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:30.298743  8163 consensus_peers.cc:597] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.290714 14264 raft_consensus.cc:2804] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:30.308281 14266 log.cc:927] Time spent T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:30.301944 14224 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:30.330116 14222 consensus_queue.cc:237] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.293875 14230 consensus_queue.cc:1048] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:05:30.303756 14256 raft_consensus.cc:697] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:30.334511 14256 consensus_queue.cc:237] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.318742 14264 raft_consensus.cc:697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:30.338052 14264 consensus_queue.cc:237] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:30.358698  8774 leader_election.cc:336] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:30.359505  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.362564  8774 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.368371  8274 raft_consensus.cc:1275] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:30.371619  8199 raft_consensus.cc:1275] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:30.373682 14252 consensus_queue.cc:1048] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:05:30.404824  8021 catalog_manager.cc:5697] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 18 to 19, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 19 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.379752 14241 consensus_queue.cc:1048] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:05:30.433048  8163 consensus_peers.cc:597] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.433611  8163 consensus_peers.cc:597] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.463555  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 182847us
W20260709 13:05:30.466588  8237 leader_election.cc:336] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:30.471103  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.513157  8237 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.513630  8237 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.514008  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:30.514066  8196 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:30.518337  8808 raft_consensus.cc:1275] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 LEARNER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:05:30.521633  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.528249 14161 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:05:30.559916  8196 raft_consensus.cc:1275] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:05:30.568441 14258 consensus_queue.cc:1048] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:30.574579 14230 consensus_queue.cc:1048] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:30.586776  8273 raft_consensus.cc:1275] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:30.591388 14244 consensus_queue.cc:1048] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:30.601881  8199 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:05:30.594729  8163 consensus_peers.cc:597] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.615926  8163 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.616430  8163 consensus_peers.cc:597] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:30.600589  8021 catalog_manager.cc:5697] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 17 to 18, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 18 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.618203 14264 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:05:30.622470  8774 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.566421  8020 catalog_manager.cc:5697] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 20 to 21, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 21 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:30.633706  8774 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.628895  8237 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:30.631711  8021 catalog_manager.cc:5697] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 14 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:30.639155  8774 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.634661  8020 catalog_manager.cc:5697] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 17 to 18, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 18 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.640758  8020 catalog_manager.cc:5697] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.640954 14213 raft_consensus.cc:2955] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.637593  8021 catalog_manager.cc:5697] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:30.642095 14283 log.cc:927] Time spent T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:05:30.655493  8274 raft_consensus.cc:1275] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:30.659619  8811 raft_consensus.cc:2955] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.656749  8020 catalog_manager.cc:5697] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 15 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.663797  8020 catalog_manager.cc:5697] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 15 to 16, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 16 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.669467  8808 raft_consensus.cc:1275] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:05:30.666337  8020 catalog_manager.cc:5697] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 13 to 14, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 14 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.678956 14232 consensus_queue.cc:1048] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:30.675673 14242 consensus_queue.cc:1048] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:05:30.696377  8808 raft_consensus.cc:1275] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:05:30.710028  8774 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.710721  8273 raft_consensus.cc:2955] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.722805 14221 consensus_queue.cc:1048] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:05:30.734411  8774 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.743404  8267 raft_consensus.cc:1275] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:05:30.745702  8163 consensus_peers.cc:597] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.784200 14245 raft_consensus.cc:1064] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: attempting to promote NON_VOTER 17c126976afd40d9a398d13a5ddd222f to VOTER
I20260709 13:05:30.791930  8267 raft_consensus.cc:1275] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:30.793964  8809 raft_consensus.cc:1275] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:30.793552 14230 raft_consensus.cc:2955] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.756498 14221 consensus_queue.cc:1048] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:05:30.795773 14245 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:30.797228  8018 catalog_manager.cc:5697] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 9 to 10, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 10 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.798933  8018 catalog_manager.cc:5697] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 12 to 13, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 13 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:30.800390  8237 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.806100  8163 consensus_peers.cc:597] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.806861  8163 consensus_peers.cc:597] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.807433  8163 consensus_peers.cc:597] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:30.812160  8807 raft_consensus.cc:2955] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.816004 14253 consensus_queue.cc:1048] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:30.843539 14298 consensus_queue.cc:1048] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:05:30.850518  8809 raft_consensus.cc:1275] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:30.854712  8200 raft_consensus.cc:1275] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:30.849086  8021 catalog_manager.cc:5697] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 16 to 17, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 17 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.858553  8021 catalog_manager.cc:5697] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 15 to 16, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 16 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.863607 14232 consensus_queue.cc:1048] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:05:30.865581  8163 consensus_peers.cc:597] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:30.867136 14244 consensus_queue.cc:1048] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:30.860256  8021 catalog_manager.cc:5697] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:30.874904  8191 raft_consensus.cc:1275] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:30.887231 14264 consensus_queue.cc:1048] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:05:30.944080  8191 raft_consensus.cc:1275] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:05:30.944684 14302 log.cc:927] Time spent T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:05:30.946763  8274 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:30.949952 14282 consensus_queue.cc:1048] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:05:30.955503 14299 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:30.968196  8774 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.980475  8163 consensus_peers.cc:597] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.981007  8163 consensus_peers.cc:597] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.992868  8237 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.993412  8237 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.996176  8163 consensus_peers.cc:597] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.996711  8163 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:31.022589  8163 consensus_peers.cc:597] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.025638  8237 consensus_peers.cc:597] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:31.026149  8237 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.026573  8237 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.027143  8237 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.027866  8237 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:31.028364  8237 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.028648  8196 raft_consensus.cc:2955] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
W20260709 13:05:31.036079  8163 consensus_peers.cc:597] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:31.114905  8021 catalog_manager.cc:5697] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:31.118327  8020 catalog_manager.cc:5697] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 14 to 15, leader changed from 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 15 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:31.130894  8809 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 LEARNER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:05:31.144132  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.169970  8774 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.176091  8238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:37313, user_credentials={real_user=slave}} blocked reactor thread for 49399.6us
I20260709 13:05:31.183116 14267 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:05:31.212826  8163 consensus_peers.cc:597] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.374316  8774 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:32.448632 14323 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:32.449276 14323 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:32.451485 14323 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:32.557578 14325 raft_consensus.cc:493] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:32.558362 14325 raft_consensus.cc:515] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:32.560566 14325 leader_election.cc:290] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.305935 14232 raft_consensus.cc:493] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.307385 14232 raft_consensus.cc:515] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.332042 14232 leader_election.cc:290] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.332772 14232 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.333531 14232 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.337469 14232 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.348383 14245 raft_consensus.cc:493] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.359932 14250 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.402257 14250 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.404776 14250 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.398262 14273 raft_consensus.cc:493] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.405766 14273 raft_consensus.cc:515] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.408185 14273 leader_election.cc:290] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.408679 14273 raft_consensus.cc:493] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.378703 14264 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.409906 14264 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.412298 14264 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.402199 14245 raft_consensus.cc:515] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.415061 14245 leader_election.cc:290] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.415570 14245 raft_consensus.cc:493] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.416255 14245 raft_consensus.cc:515] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.409308 14273 raft_consensus.cc:515] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.419682 14273 leader_election.cc:290] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.421216 14245 leader_election.cc:290] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:33.645439  8166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.013s	sys 0.034s
W20260709 13:05:33.645958  8166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.013s	sys 0.036s
I20260709 13:05:33.650861 14298 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.651981 14215 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.651750 14298 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.652974 14215 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.654616 14298 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.656750 14215 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.660946 14298 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.661263 14325 raft_consensus.cc:493] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.661947 14298 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.662236 14325 raft_consensus.cc:515] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.664914 14298 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.664949 14325 leader_election.cc:290] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.665390 14282 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.666831 14299 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.667526 14282 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.665916 14264 raft_consensus.cc:493] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.671051 14264 raft_consensus.cc:515] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.672358 14282 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.672947 14282 raft_consensus.cc:493] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.666157 14250 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.665966 14214 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.664846 14263 raft_consensus.cc:493] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.692929 14263 raft_consensus.cc:515] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.686885 14245 raft_consensus.cc:493] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.695468 14214 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.695643 14245 raft_consensus.cc:515] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.696367 14263 leader_election.cc:290] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.666672 14232 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.697774 14214 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.667652 14299 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.673249 14264 leader_election.cc:290] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.688512 14273 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.698159 14232 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.705156 14273 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.707026 14232 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.645390 14326 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.707572 14232 raft_consensus.cc:493] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.708353 14232 raft_consensus.cc:515] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.708245 14326 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.712988 14326 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.703704 14264 raft_consensus.cc:493] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.717093 14264 raft_consensus.cc:515] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.721639 14250 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.724607 14250 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.735162 14264 leader_election.cc:290] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.737236 14299 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.673712 14282 raft_consensus.cc:515] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:33.744498  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 67373.4us
I20260709 13:05:33.745622 14299 raft_consensus.cc:493] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.746291 14299 raft_consensus.cc:515] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.748329 14299 leader_election.cc:290] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.749001 14299 raft_consensus.cc:493] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.750869 14299 raft_consensus.cc:515] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.753796 14217 raft_consensus.cc:493] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.754541 14217 raft_consensus.cc:515] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.756479 14217 leader_election.cc:290] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.761943 14264 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.762665 14260 raft_consensus.cc:493] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.763499 14260 raft_consensus.cc:515] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.759620 14249 raft_consensus.cc:493] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
W20260709 13:05:33.787791  8054 debug-util.cc:398] Leaking SignalData structure 0x7b0800317c80 after lost signal to thread 7008
W20260709 13:05:33.789302  8054 debug-util.cc:398] Leaking SignalData structure 0x7b080012fc00 after lost signal to thread 8057
I20260709 13:05:33.794085 14249 raft_consensus.cc:515] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.794950 14329 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.795699 14329 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.796520 14249 leader_election.cc:290] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.787623 14161 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.802970 14161 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.762657 14264 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.805745 14161 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.807103 14309 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.807652 14249 raft_consensus.cc:493] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.807958 14309 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.808539 14249 raft_consensus.cc:515] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.760035 14326 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.780493 14245 leader_election.cc:290] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:33.817632  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 72185.7us
I20260709 13:05:33.820353 14329 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.820887 14241 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.820968 14327 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.821689 14241 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.822009 14327 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.824141 14327 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.824877 14241 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.825615 14326 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.826697 14241 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.808017 14260 leader_election.cc:290] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.827574 14241 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.828086 14326 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.830298 14232 leader_election.cc:290] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.830119 14241 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.831440 14249 leader_election.cc:290] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.802958 14328 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.834865 14251 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.837733 14251 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.839984 14251 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.841301 14264 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.881121 14267 raft_consensus.cc:493] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.886014 14267 raft_consensus.cc:515] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.888967 14267 leader_election.cc:290] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.890090 14309 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:33.881762 14328 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:33.896166  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 45842us
I20260709 13:05:33.902143 14309 raft_consensus.cc:493] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.903288 14328 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.903028 14309 raft_consensus.cc:515] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: false } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:33.909276  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1ca0 after lost signal to thread 8224
W20260709 13:05:33.909665  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08001715e0 after lost signal to thread 8225
I20260709 13:05:33.911763 14332 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.913932 14328 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.914726 14328 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.917075 14249 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.917824 14249 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.919180 14253 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.919894 14253 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.921495 14241 raft_consensus.cc:493] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.922215 14241 raft_consensus.cc:515] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.924181 14241 leader_election.cc:290] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.926064  8200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50482 (request call id 3043) took 2616 ms. Trace:
I20260709 13:05:33.926461  8200 rpcz_store.cc:276] 0709 13:05:31.309735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.924769 (+2615034us) service_pool.cc:224] Handling call
0709 13:05:33.925369 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.925651 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.925675 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:33.925724 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:33.925751 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.925796 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.925888 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:33.929426 14334 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:33.930199 14334 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.912601 14332 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.935532 14332 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.936510 14309 leader_election.cc:290] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.937481 14334 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.939071 14253 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.956174  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c63c7039644c089bf014466158ac6b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.961807  8266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c1b3089e984aa991014bbd831e7bfc" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.962466  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60fac097ca0e444dbe442019479fc818" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.963325  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.966558 14282 leader_election.cc:290] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.966980  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.970115 14267 raft_consensus.cc:493] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:33.970738 14267 raft_consensus.cc:515] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:33.971428 14213 raft_consensus.cc:493] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:33.972010 14213 raft_consensus.cc:515] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:33.973392 14267 leader_election.cc:290] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.974049 14213 leader_election.cc:290] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.975315 14249 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:33.976050  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb920 after lost signal to thread 8298
W20260709 13:05:33.976346  8054 debug-util.cc:398] Leaking SignalData structure 0x7b0800232a00 after lost signal to thread 8299
W20260709 13:05:33.978282  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae6e0 after lost signal to thread 8835
W20260709 13:05:33.978538  8054 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3ea0 after lost signal to thread 8836
I20260709 13:05:33.980508  8018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47912 (request call id 214) took 2853 ms. Trace:
I20260709 13:05:33.980851  8018 rpcz_store.cc:276] 0709 13:05:31.127101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.127240 (+   139us) service_pool.cc:224] Handling call
0709 13:05:31.226060 (+ 98820us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b540006bb54. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c92090 00007fbd24d30f3a 00007fbd2aae71cc 00007fbd2abe537e 00007fbd290a62a4 00007fbd290a6232 00007fbd290a6161 00007fbd290a60dc 00007fbd290a5392 00007fbd2306348c 00007fbd230628c6
0709 13:05:33.980306 (+2754246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11318,"reported_tablets":12,"spinlock_wait_cycles":139079040}
I20260709 13:05:33.988504 14328 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:33.989187  8019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38688 (request call id 335) took 2687 ms. Trace:
I20260709 13:05:33.989665  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3d4a04ded8480c86cbdcb830e8fd57" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.990384 14299 leader_election.cc:290] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:33.999396  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.000411  8021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38674 (request call id 302) took 2765 ms. Trace:
I20260709 13:05:34.009536  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:33.989624  8019 rpcz_store.cc:276] 0709 13:05:31.301180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.301322 (+   142us) service_pool.cc:224] Handling call
0709 13:05:33.669141 (+2367819us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b54002b0110. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd21ac3db1 00007fbd21c03b71 00007fbd21c040b2 00007fbd2ab7da89 00007fbd2ab15da6 00007fbd2aae7088 00007fbd2abe537e 00007fbd290a62a4 00007fbd290a6232 00007fbd290a6161 00007fbd290a60dc
0709 13:05:33.989030 (+319889us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139223,"reported_tablets":1,"spinlock_wait_cycles":189263616}
I20260709 13:05:34.013983 14273 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:34.000900  8021 rpcz_store.cc:276] 0709 13:05:31.234540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.236850 (+  2310us) service_pool.cc:224] Handling call
0709 13:05:34.000191 (+2763341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176517,"reported_tablets":6,"spinlock_wait_cycles":2304}
I20260709 13:05:34.017885  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.023912  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e62d20a8d54072882e6b574cdddee5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.029594  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.031239 14244 raft_consensus.cc:493] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:34.031867 14244 raft_consensus.cc:515] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.032517  8191 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:34.034010 14244 leader_election.cc:290] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:34.042407  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe00257dce7d4bb38119184a1572ed9e" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.043084  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d62387bcf94eaaaf201aeca2c2a48f" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.043648  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2d8845b23413289268a178d97a8ea" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.045032 14328 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:34.045547  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.045583 14328 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.046885  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.048030  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:34.048718  8774 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:34.049563 14337 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:34.050166 14337 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.050591  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9d10e30d545a18e699e9ccaea3e4e" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.052104  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7922a990c04422aa6d20dbef2f00976" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.047955 14328 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:34.052681 14337 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:34.050194 14244 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:34.053752  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5cf690845d47f4a2d4e3ab5d8922c0" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.059006  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.059597  8271 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:34.061951 14244 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.064548 14244 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:34.072410  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.073014  8271 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 19.
I20260709 13:05:34.074441  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.074751  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc42e8321e24c91a3684956eeb796b7" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.074992  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.076002  8191 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:34.076208  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.077250  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5d69caf66c468aa9766af3b02649b0" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.077574  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.078656  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.089794  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6533c9e4149aa9b528e746b4052b3" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.099366  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.106002  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.106529  8191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.106668  8192 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:34.107189  8191 raft_consensus.cc:2468] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 21.
I20260709 13:05:34.109548  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b269caef5384838a52bcedc78464607" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.109823  8199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446d688479d34112bfc4ab0afb09d6f5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.110067  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.110690  8192 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 13.
W20260709 13:05:34.115967  8237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111) [suppressed 286 similar messages]
I20260709 13:05:34.119917  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.124610  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.126798  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.129974  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ae8ee6216f434eb7857a29d9b682d9" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.131161  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.135255  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.138347  8775 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:34.139273 14328 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:34.139660 14328 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:34.140015 14328 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.145707  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.146425  8273 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:34.161593  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848f577948c470fb4c95fcc2b55b7ef" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.162330 14328 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.170213 14328 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:34.173316  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.174659  8775 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:34.175799 14249 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:34.176162 14249 raft_consensus.cc:493] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:34.176532 14249 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:34.185458  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 69604.8us
I20260709 13:05:34.186836 14245 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:34.193938  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19747a1b37df480faebc96d93689cda5" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.194612  8806 raft_consensus.cc:2468] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 14.
I20260709 13:05:34.188154 14249 raft_consensus.cc:515] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.211717  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.212244  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.212670  8806 raft_consensus.cc:2393] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 14: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:34.212990  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.214015  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.214663 14249 leader_election.cc:290] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:34.215565 14299 raft_consensus.cc:493] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:34.216200 14299 raft_consensus.cc:515] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:34.218452  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e63fd519e64f52b42bde9b044f1a9d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.219780 14299 leader_election.cc:290] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:34.220840 14299 raft_consensus.cc:493] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:34.224411  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.226024  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.227100  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:34.206076  8237 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:34.231493  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.231773  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.232095  8195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.234010  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b9bcf479d417dbc213189e328a0f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.228578 14299 raft_consensus.cc:515] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:34.237203 14299 leader_election.cc:290] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:34.256523  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0b25b4cb7b4ba18663e77cdacc4dbb" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.258811  8809 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:34.264032  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9f1ca41df6462b902893527ceb3878" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.268937  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.274616  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2c54c9c07a444898c0a63f323dfd5d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.277209  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8addb0a61b24a3fa8f4700e78ac3a48" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.277706  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2628cd0cb14e318af904dd53421357" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.278002  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55917afdf34f4dd3985df6ff71c4d019" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.278885  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.279070  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b5bde69aba40fd84e97b20005e3997" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:34.277594  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 70416.5us
I20260709 13:05:34.287436  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e50e42ace14a4db7be14613c771220" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.287463  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.292070  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
I20260709 13:05:34.296460  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.297652  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dada18d63642d99cf497f978999d7a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.296525  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbf67588374458ebbd07bc5aeeb3b5a" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.298918  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9a86475338460da550bd2a16b10c49" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.298944  8809 raft_consensus.cc:2468] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 18.
I20260709 13:05:34.301932  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
I20260709 13:05:34.300488  8777 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.307566  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.308456 14244 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.309010  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327bf050c29d49408e736f7e8fda9e6b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.310779  8811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.311040  8807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788fd48c46f4ede898fe663e6cf64cc" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.311393  8811 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:34.311909  8806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db7845485d6b4a86b219eae83659a36e" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.312417  8808 raft_consensus.cc:1240] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:34.313573  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8339f0f377ff4af7947c4a11b4aea010" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.314509  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf74acfb5ea42d6ab6d4dfdb9067cd9" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.317356  8166 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:34.323819  8166 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:34.322184  8197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:34.328344  8196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d"
I20260709 13:05:34.329630  8196 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:34.329649  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.328099 14213 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:34.324198 14245 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:34.328599  8163 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.334077  8163 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.327072 14263 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:34.331645  8021 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d reported cstate change: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.337365  8777 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.330761 14213 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
W20260709 13:05:34.338867  8163 leader_election.cc:336] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.333758 14245 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:34.340281  8163 leader_election.cc:304] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.336642 14273 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.340827 14244 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:34.339833  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:34.368696  8163 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.369426  8163 leader_election.cc:336] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.369943  8163 leader_election.cc:336] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.370672  8163 leader_election.cc:336] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.371097  8163 leader_election.cc:304] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.366040  8809 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:34.344234 14245 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.343065 14213 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:34.381768  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86e3e4c37f4426b821f0af0b5b1c516" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:34.378522  8267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:34.391010  8166 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.347050 14263 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:34.399628  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292514be4a7b4f768913b094de3d5d6d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:34.376590 14217 raft_consensus.cc:2749] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:34.429062  8237 leader_election.cc:336] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.430289  8237 leader_election.cc:336] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.430848  8237 leader_election.cc:336] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.431281  8237 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.431614  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.378333 14299 raft_consensus.cc:2749] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:34.443603  8237 leader_election.cc:336] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.455137  8237 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.455552  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.465610 14334 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.467100  8804 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:34.475306  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:34.475790  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 83071.7us
I20260709 13:05:34.458554 14282 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:34.481570 14245 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.479722 14309 raft_consensus.cc:2749] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:05:34.589587  8166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 198663us
I20260709 13:05:34.640878  8200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e052a7e080bb4a1e9a5ae52b54c2408b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "afd11cff97554063a80d743fdf2b934d" is_pre_election: true
W20260709 13:05:34.650216  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 195089us
I20260709 13:05:34.653491  8200 raft_consensus.cc:1240] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:34.663105 14337 consensus_queue.cc:1059] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:34.664149 14309 raft_consensus.cc:3055] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:34.664507 14309 raft_consensus.cc:740] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:34.665453 14309 consensus_queue.cc:260] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.666766 14309 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.600745  8196 raft_consensus.cc:2468] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 14.
I20260709 13:05:34.604176 14245 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:34.607702 14263 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:34.670552  8775 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.672531 14337 raft_consensus.cc:2804] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:34.672996 14337 raft_consensus.cc:697] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:34.477708 14217 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.669909  8195 raft_consensus.cc:1240] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Rejecting Update request from peer 9e0c7bd2e224498bb1c68be20e5b3561 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:34.677847  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 239315us
I20260709 13:05:34.679451  8163 leader_election.cc:304] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.680130 14299 raft_consensus.cc:2749] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.608577 14213 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:34.681284  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.690274  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.685177  8163 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:34.691363  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.691810  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.692405  8163 leader_election.cc:304] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.694800  8163 leader_election.cc:304] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
W20260709 13:05:34.695580  8774 leader_election.cc:336] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.696132  8274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f91b8425044826becb1f4ae12269f8" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.696475  8163 leader_election.cc:304] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.696507  8774 leader_election.cc:304] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.697837 14337 consensus_queue.cc:237] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.698634 14264 consensus_queue.cc:1059] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:34.695567 14245 raft_consensus.cc:2749] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:34.699672 14273 raft_consensus.cc:2749] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:34.700443  8774 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.701134 14264 raft_consensus.cc:3055] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:34.703662 14264 raft_consensus.cc:740] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:34.702524  8271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c80cbb5d28348cdbb8e0e9ef4d3bf28" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:34.704562  8163 leader_election.cc:304] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:34.704671  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.705605  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.695173 14217 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:34.715302  8163 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.718808  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:34.719103  8163 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:34.719367  8237 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.716888  8774 leader_election.cc:336] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.719786  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.719902  8774 leader_election.cc:304] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.696192 14253 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:34.721068  8237 leader_election.cc:336] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.721653  8237 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.721992  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.722755 14263 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:34.722787 14349 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:34.724927  8237 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.725399  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.726161 14334 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.704128 14336 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:34.727476  8237 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.727941  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:34.729697  8237 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.730082  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:34.730584  8163 leader_election.cc:336] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.730995  8163 leader_election.cc:304] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:34.731909  8163 leader_election.cc:336] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.732174 14347 raft_consensus.cc:2749] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.732887 14241 raft_consensus.cc:2749] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.720814 14273 raft_consensus.cc:2749] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:34.736406 14282 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.713774 14327 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.728031 14348 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.690985  8265 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } attrs { replace: true } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:34.714323 14245 raft_consensus.cc:2749] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.745134  8163 leader_election.cc:304] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:34.747300  8163 leader_election.cc:336] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.747390 14348 raft_consensus.cc:2749] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:34.747701  8163 leader_election.cc:304] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.727169 14350 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.749961 14222 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.750355 14264 consensus_queue.cc:260] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.751710 14264 raft_consensus.cc:3060] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:34.757272  8200 raft_consensus.cc:1240] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Rejecting Update request from peer 17c126976afd40d9a398d13a5ddd222f for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:34.759308 14253 consensus_queue.cc:1059] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:34.760391 14253 raft_consensus.cc:3055] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:34.760680 14253 raft_consensus.cc:740] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
W20260709 13:05:34.765934  8163 leader_election.cc:336] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.766389  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.781857  8804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:34.790652  8804 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 15.
W20260709 13:05:34.793545  8239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.775185 14348 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.769383 14245 raft_consensus.cc:2749] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.796425  8163 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:34.797724 14245 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:34.798193 14245 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:34.799466 14253 consensus_queue.cc:260] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.800935 14253 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:34.800647 14245 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:34.815970  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 99088.3us
W20260709 13:05:34.817960  8163 leader_election.cc:336] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.823163  8163 leader_election.cc:304] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.825378 14267 raft_consensus.cc:2749] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:34.821945 14244 raft_consensus.cc:2749] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:34.827155  8774 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:34.827296  8163 leader_election.cc:336] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.829805  8163 leader_election.cc:304] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.831208 14267 raft_consensus.cc:2749] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:34.881438  8163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 54160.1us
W20260709 13:05:34.898624  8163 leader_election.cc:336] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.899083  8163 leader_election.cc:304] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.843772 14213 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:34.877836  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 79778.5us
I20260709 13:05:34.903509  8237 leader_election.cc:304] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.901487 14267 raft_consensus.cc:2749] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:34.904753 14263 raft_consensus.cc:2749] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:34.904839  8809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:34.906201  8237 leader_election.cc:304] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.907011 14263 raft_consensus.cc:2749] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:34.906754  8192 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.908314  8237 leader_election.cc:304] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.909034 14263 raft_consensus.cc:2749] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.910111  8237 leader_election.cc:304] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.910810 14263 raft_consensus.cc:2749] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.911837  8237 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.911979  8809 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 20.
I20260709 13:05:34.912581 14263 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.913669  8237 leader_election.cc:304] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.914348 14263 raft_consensus.cc:2749] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:34.916806  8237 leader_election.cc:304] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.917512 14263 raft_consensus.cc:2749] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.919082  8237 leader_election.cc:304] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.919842 14263 raft_consensus.cc:2749] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:34.897473  8774 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:34.921120  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 93994.4us
W20260709 13:05:34.921618  8774 leader_election.cc:336] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.921969  8774 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.922753 14253 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:34.922997  8774 leader_election.cc:336] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.923429  8774 leader_election.cc:304] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:34.924180 14360 raft_consensus.cc:2749] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:34.925053  8018 catalog_manager.cc:5697] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 13 to 14, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 14 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.925941  8237 leader_election.cc:304] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:34.921240 14263 consensus_queue.cc:1059] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:05:34.926735 14364 raft_consensus.cc:2749] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:34.927167 14263 raft_consensus.cc:3055] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:34.927503 14263 raft_consensus.cc:740] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:34.928239  8237 leader_election.cc:304] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.928407 14263 consensus_queue.cc:260] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.928933 14364 raft_consensus.cc:2749] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:34.931497  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.932164 14364 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:34.921198 14244 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.936018 14263 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:34.924229  8774 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.941100  8774 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.932135  8163 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 
I20260709 13:05:34.943037  8237 leader_election.cc:304] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.956997 14213 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:34.942919  8021 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 14 to 15, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 15 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.957515 14213 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 20 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:34.958490 14213 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:34.959817  8809 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:34.957480 14263 raft_consensus.cc:2749] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.963366 14299 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:34.968828  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:34.970754  8273 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:05:34.971108  8237 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.971570  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.972916 14245 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:34.977174 14364 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:34.983064  8774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 58850.7us
I20260709 13:05:34.983323 14244 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:34.983742  8774 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:34.984164  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:34.984879 14360 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.985950  8809 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:34.988444 14273 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:34.994122  8273 raft_consensus.cc:2955] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:35.014927  8008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 157272e89e0f4099b4d825211d7d823a with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:35.019042  8018 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f reported cstate change: config changed from index 13 to 14, VOTER 65d66cd655cd4400b079b4427061ca5e (127.6.215.65) evicted. New cstate: current_term: 16 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } } }
I20260709 13:05:35.020213  8021 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d reported cstate change: term changed from 19 to 20, leader changed from 17c126976afd40d9a398d13a5ddd222f (127.6.215.68) to afd11cff97554063a80d743fdf2b934d (127.6.215.66). New cstate: current_term: 20 leader_uuid: "afd11cff97554063a80d743fdf2b934d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:35.024117  8774 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:35.033739  8774 leader_election.cc:336] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:35.034140  8774 leader_election.cc:304] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:35.034793 14244 raft_consensus.cc:2749] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:35.036716  8774 leader_election.cc:336] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:35.037108  8774 leader_election.cc:304] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:35.046073 14244 raft_consensus.cc:2749] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:35.047794  8774 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:35.053656  8774 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:35.057998 14244 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:35.059793  8774 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:35.060187  8774 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
W20260709 13:05:35.061088  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:35.061477  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:35.061597 14253 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:35.062358 14253 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:35.152817  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.177845  8163 consensus_peers.cc:597] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.216763  8163 consensus_peers.cc:597] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.224725  8007 catalog_manager.cc:4755] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 157272e89e0f4099b4d825211d7d823a: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:35.228606  8774 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:35.300268  8804 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:35.305085 14245 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:05:35.359429  8265 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:35.372076  8265 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:35.374055 14217 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:35.382513  8192 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:35.382503  8272 raft_consensus.cc:1275] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:35.387146 14244 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:35.389465 14360 consensus_queue.cc:1048] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:35.405826  8272 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:35.413318  8272 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:35.416957 14245 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:35.491410  8810 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Refusing update from remote peer afd11cff97554063a80d743fdf2b934d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:35.494159 14245 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:05:35.610617  8237 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.656777  8237 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:35.694036  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
W20260709 13:05:35.695328  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.715867  8163 consensus_peers.cc:597] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.742622  8238 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.751417  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.765792  8775 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.766394  8775 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.766919  8775 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.767596  8238 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.779008  8163 consensus_peers.cc:597] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.779642  8163 consensus_peers.cc:597] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.782397  8774 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.793512  8238 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.869643  8163 consensus_peers.cc:597] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.870325  8163 consensus_peers.cc:597] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.871860  8163 consensus_peers.cc:597] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.880122  8238 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.897102  8238 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.900266  8777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:43007, user_credentials={real_user=slave}} blocked reactor thread for 91421.3us
W20260709 13:05:35.920841  8238 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.918711  8775 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.927361  8775 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.932631  8774 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:35.933128  8775 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.951184  8775 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.963285  8238 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.972621  8238 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.975389  8775 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:35.984710  8237 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.025780  8238 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.040681  8775 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.047194  8238 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.063452  8163 consensus_peers.cc:597] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.067302  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.077374  8774 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.080742  8774 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.089298  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:36.092486  8163 consensus_peers.cc:597] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.095636  8774 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.096489  7005 tablet_replica.cc:333] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.097488  7005 raft_consensus.cc:2243] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.098587  7005 raft_consensus.cc:2272] T bc9f1ca41df6462b902893527ceb3878 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.101418  7005 tablet_replica.cc:333] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
W20260709 13:05:36.117750  8775 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.120282  8163 consensus_peers.cc:597] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.127058  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.102169  7005 raft_consensus.cc:2243] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.149262  7005 raft_consensus.cc:2272] T 7685faa95b5f44629fc266055fc278aa P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.150918  8775 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.163755  7005 tablet_replica.cc:333] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.166193  7005 raft_consensus.cc:2243] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:36.169215  8163 consensus_peers.cc:597] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.169837  8774 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.173389  7005 raft_consensus.cc:2272] T ccbf67588374458ebbd07bc5aeeb3b5a P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.176827  7005 tablet_replica.cc:333] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.177704  7005 raft_consensus.cc:2243] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.183454  7005 raft_consensus.cc:2272] T e848f577948c470fb4c95fcc2b55b7ef P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.185766  8775 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.186275  7005 tablet_replica.cc:333] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.187121  7005 raft_consensus.cc:2243] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:05:36.194010  8237 consensus_peers.cc:597] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.202049  8238 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.202565  7005 raft_consensus.cc:2272] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.205257  8775 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.205330  7005 tablet_replica.cc:333] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.207376  7005 raft_consensus.cc:2243] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.210996  7005 raft_consensus.cc:2272] T 4fc42e8321e24c91a3684956eeb796b7 P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.212611  8237 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.216500  8163 consensus_peers.cc:597] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.218631  7005 tablet_replica.cc:333] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.219543  7005 raft_consensus.cc:2243] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.220127  7005 raft_consensus.cc:2272] T 22c63c7039644c089bf014466158ac6b P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.222734  7005 tablet_replica.cc:333] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.223459  7005 raft_consensus.cc:2243] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.224479  7005 raft_consensus.cc:2272] T 76f64012d7a146ddb8774cc4299a38e8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.235745  8237 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.238505  8775 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.247562  7005 tablet_replica.cc:333] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.252002  7005 raft_consensus.cc:2243] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.253152  7005 raft_consensus.cc:2272] T c8addb0a61b24a3fa8f4700e78ac3a48 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.259236  7005 tablet_replica.cc:333] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.260010  7005 raft_consensus.cc:2243] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.260975  7005 raft_consensus.cc:2272] T 6b269caef5384838a52bcedc78464607 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.261056  8238 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.263099 14217 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:36.263635 14217 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.265761 14217 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:36.267040  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:36.267624  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:36.268337  8810 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 17: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:36.267622  8273 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:36.275463  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:36.276526 14357 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.276895 14357 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:36.277230 14357 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.263622  7005 tablet_replica.cc:333] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.282599  7005 raft_consensus.cc:2243] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.283265  7005 raft_consensus.cc:2272] T 729f99fd4567469babdeb05f3b4b3d27 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.287431  7005 tablet_replica.cc:333] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.288203  7005 raft_consensus.cc:2243] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.290632 14357 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.293150  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:36.294843  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:36.295336 14357 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Requested vote from peers 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:36.295517  8810 raft_consensus.cc:2393] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate afd11cff97554063a80d743fdf2b934d in current term 17: Already voted for candidate 17c126976afd40d9a398d13a5ddd222f in this term.
I20260709 13:05:36.309069  8273 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd11cff97554063a80d743fdf2b934d in term 17.
I20260709 13:05:36.315428  8166 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f
I20260709 13:05:36.316045  7005 raft_consensus.cc:2272] T 19747a1b37df480faebc96d93689cda5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.317338 14357 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:36.317929 14357 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Becoming Leader. State: Replica: afd11cff97554063a80d743fdf2b934d, State: Running, Role: LEADER
I20260709 13:05:36.318768 14357 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.321144  7005 tablet_replica.cc:333] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.321938  7005 raft_consensus.cc:2243] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.322644  7005 raft_consensus.cc:2272] T 0862042002d04bcbb6dd1a4c89ed990c P afd11cff97554063a80d743fdf2b934d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.331382  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.338147  8163 consensus_peers.cc:597] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.344185  7005 tablet_replica.cc:333] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.345016  7005 raft_consensus.cc:2243] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.346091  7005 raft_consensus.cc:2272] T 45f9d10e30d545a18e699e9ccaea3e4e P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.368554  8237 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.386188  7005 tablet_replica.cc:333] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.387146  7005 raft_consensus.cc:2243] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.388823  7005 raft_consensus.cc:2272] T 446d688479d34112bfc4ab0afb09d6f5 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.395205  7005 tablet_replica.cc:333] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.422096  7005 raft_consensus.cc:2243] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.422797  7005 raft_consensus.cc:2272] T a4e63fd519e64f52b42bde9b044f1a9d P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.439248  8237 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.445631  7005 tablet_replica.cc:333] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.446478  7005 raft_consensus.cc:2243] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.447435  7005 raft_consensus.cc:2272] T 292514be4a7b4f768913b094de3d5d6d P afd11cff97554063a80d743fdf2b934d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.449918  7005 tablet_replica.cc:333] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.450474  7005 raft_consensus.cc:2243] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.451207  7005 raft_consensus.cc:2272] T 157272e89e0f4099b4d825211d7d823a P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.452973  7005 tablet_replica.cc:333] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.462699  7005 raft_consensus.cc:2243] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.463721  7005 raft_consensus.cc:2272] T ff5d69caf66c468aa9766af3b02649b0 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.466985  7005 tablet_replica.cc:333] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.467876  7005 raft_consensus.cc:2243] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.468437  7005 raft_consensus.cc:2272] T 5d2c54c9c07a444898c0a63f323dfd5d P afd11cff97554063a80d743fdf2b934d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.486266  7005 tablet_replica.cc:333] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.487066  7005 raft_consensus.cc:2243] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.487991  7005 raft_consensus.cc:2272] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.514932  7005 tablet_replica.cc:333] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.515753  7005 raft_consensus.cc:2243] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.516273  7005 raft_consensus.cc:2272] T fe00257dce7d4bb38119184a1572ed9e P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.522836  7005 tablet_replica.cc:333] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.524209  7005 raft_consensus.cc:2243] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.525270  7005 pending_rounds.cc:70] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Trying to abort 1 pending ops.
I20260709 13:05:36.525614  7005 pending_rounds.cc:77] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d: Aborting op as it isn't in flight: id { term: 17 index: 14 } timestamp: 7305635169645039616 op_type: NO_OP noop_request { }
I20260709 13:05:36.526037  7005 raft_consensus.cc:2889] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:36.526602  7005 raft_consensus.cc:2272] T 1f5168daf09c45b4accfa213d5b29a43 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.536389  8237 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.541258  7005 tablet_replica.cc:333] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.542385  7005 raft_consensus.cc:2243] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.544250  7005 raft_consensus.cc:2272] T e577a5a5d0ab4664ab92aed9a58cfb2d P afd11cff97554063a80d743fdf2b934d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.549191  7005 tablet_replica.cc:333] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.550221  7005 raft_consensus.cc:2243] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.551192  7005 raft_consensus.cc:2272] T e7922a990c04422aa6d20dbef2f00976 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.555297  8007 catalog_manager.cc:4755] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 157272e89e0f4099b4d825211d7d823a: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:36.560170  7005 tablet_replica.cc:333] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.561043  7005 raft_consensus.cc:2243] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:05:36.560950  8163 consensus_peers.cc:597] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.565785  7005 raft_consensus.cc:2272] T 607b372ee65444fb8187089e3657ab3b P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.580768  7005 tablet_replica.cc:333] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.586408  7005 raft_consensus.cc:2243] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.587621  7005 raft_consensus.cc:2272] T 8f66db9a2fdf400a9046121a4b3b1b3b P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.594494  7005 tablet_replica.cc:333] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.596490  7005 raft_consensus.cc:2243] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.597108  7005 raft_consensus.cc:2272] T 587b9bcf479d417dbc213189e328a0f8 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.608129  7005 tablet_replica.cc:333] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.608870  7005 raft_consensus.cc:2243] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.610064  7005 raft_consensus.cc:2272] T d6579e4214554536b3727b869a8aedfa P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.622901  7005 tablet_replica.cc:333] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.628181  7005 raft_consensus.cc:2243] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.629386  7005 raft_consensus.cc:2272] T b9f91b8425044826becb1f4ae12269f8 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.639420  7005 tablet_replica.cc:333] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.640146  7005 raft_consensus.cc:2243] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.641283  7005 raft_consensus.cc:2272] T e052a7e080bb4a1e9a5ae52b54c2408b P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.644049  7005 tablet_replica.cc:333] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.644761  7005 raft_consensus.cc:2243] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.656260  7005 raft_consensus.cc:2272] T 89c4577341fc4203869bd3f8476d9c43 P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.667539  7005 tablet_replica.cc:333] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.668292  7005 raft_consensus.cc:2243] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.671350  7005 raft_consensus.cc:2272] T 9e2628cd0cb14e318af904dd53421357 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.675971  8237 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.686131  7005 tablet_replica.cc:333] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.686861  7005 raft_consensus.cc:2243] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.687346  7005 raft_consensus.cc:2272] T 26e50e42ace14a4db7be14613c771220 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.690011  7005 tablet_replica.cc:333] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.690768  7005 raft_consensus.cc:2243] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.691972  7005 raft_consensus.cc:2272] T bd9e13ff887048ca88ba20c2768182d3 P afd11cff97554063a80d743fdf2b934d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.694458  7005 tablet_replica.cc:333] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.695103  7005 raft_consensus.cc:2243] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.695611  7005 raft_consensus.cc:2272] T 363112022a444c2f8b7cf6e11c7c1c36 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.698060  7005 tablet_replica.cc:333] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
W20260709 13:05:36.702569  8237 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.703260  8237 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.698706  7005 raft_consensus.cc:2243] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.707772  7005 raft_consensus.cc:2272] T f86e3e4c37f4426b821f0af0b5b1c516 P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.716116  7005 tablet_replica.cc:333] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.716641 14217 raft_consensus.cc:493] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:36.716873  7005 raft_consensus.cc:2243] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.717190 14217 raft_consensus.cc:515] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.718010  7005 raft_consensus.cc:2272] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P afd11cff97554063a80d743fdf2b934d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.720707 14217 leader_election.cc:290] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:36.721647  7005 tablet_replica.cc:333] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.723287  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:36.725102 14357 raft_consensus.cc:493] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17c126976afd40d9a398d13a5ddd222f)
I20260709 13:05:36.727851  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8843c2ad2d543b89354e114ebd9d638" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:36.731562 14244 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.757951  7005 raft_consensus.cc:2243] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.761250  7005 raft_consensus.cc:2272] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.753587 14357 raft_consensus.cc:515] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.763669 14357 leader_election.cc:290] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:36.764393  7005 tablet_replica.cc:333] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.766420 14244 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.768435 14244 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:36.765148  7005 raft_consensus.cc:2243] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.769444  7005 raft_consensus.cc:2272] T 05f6533c9e4149aa9b528e746b4052b3 P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.771363  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:36.772042  7005 tablet_replica.cc:333] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.772823  7005 raft_consensus.cc:2243] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:36.773888  7005 raft_consensus.cc:2272] T 13dada18d63642d99cf497f978999d7a P afd11cff97554063a80d743fdf2b934d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.775840  8163 leader_election.cc:336] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:36.776561  7005 tablet_replica.cc:333] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.777102  8163 leader_election.cc:304] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:36.779189  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca6717bd9844d668ee0a2fff3b530f4" candidate_uuid: "afd11cff97554063a80d743fdf2b934d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:36.778802 14217 raft_consensus.cc:2749] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:36.771983  8265 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:36.788527  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:36.789284 14244 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:36.789716 14244 raft_consensus.cc:493] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.790246 14244 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:36.797869  8775 leader_election.cc:336] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:36.789750  8163 leader_election.cc:336] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:36.800105  8163 leader_election.cc:304] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afd11cff97554063a80d743fdf2b934d; no voters: 17c126976afd40d9a398d13a5ddd222f, 65d66cd655cd4400b079b4427061ca5e
I20260709 13:05:36.800856 14357 raft_consensus.cc:2749] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.808029 14244 raft_consensus.cc:515] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.777292  7005 raft_consensus.cc:2243] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:05:36.820042  8775 leader_election.cc:336] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.819000  7005 raft_consensus.cc:2272] T 2d9a86475338460da550bd2a16b10c49 P afd11cff97554063a80d743fdf2b934d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.831415  7005 tablet_replica.cc:333] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.832149  7005 raft_consensus.cc:2243] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.833046  7005 raft_consensus.cc:2272] T e8843c2ad2d543b89354e114ebd9d638 P afd11cff97554063a80d743fdf2b934d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.852926 14244 leader_election.cc:290] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:36.855554  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5168daf09c45b4accfa213d5b29a43" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:36.856146  8273 raft_consensus.cc:3060] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:36.864410  8774 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.868762  8273 raft_consensus.cc:2468] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
I20260709 13:05:36.870281  8777 leader_election.cc:304] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:36.871490 14244 raft_consensus.cc:2804] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:36.872601 14244 raft_consensus.cc:697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:36.873800 14244 consensus_queue.cc:237] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:36.877182  7005 tablet_replica.cc:333] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.879287  7005 raft_consensus.cc:2243] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.879995  7005 raft_consensus.cc:2272] T d4d62387bcf94eaaaf201aeca2c2a48f P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.903189  7005 tablet_replica.cc:333] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.903898  7005 raft_consensus.cc:2243] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.905382  7005 raft_consensus.cc:2272] T 3ca6717bd9844d668ee0a2fff3b530f4 P afd11cff97554063a80d743fdf2b934d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.913126  7005 tablet_replica.cc:333] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.913847  7005 raft_consensus.cc:2243] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.920662  7005 raft_consensus.cc:2272] T 07a2d8845b23413289268a178d97a8ea P afd11cff97554063a80d743fdf2b934d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.933599  7005 tablet_replica.cc:333] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d: stopping tablet replica
I20260709 13:05:36.934235  7005 raft_consensus.cc:2243] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.935111  7005 raft_consensus.cc:2272] T 09b5bde69aba40fd84e97b20005e3997 P afd11cff97554063a80d743fdf2b934d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:36.937770  8774 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:36.945545  8774 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:36.950287  8021 catalog_manager.cc:5697] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 16 to 18, leader changed from 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 18 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:37.061554  8237 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:37.189996 14384 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.190815 14384 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:37.192869 14384 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:37.198573  8238 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.251965  8237 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.252521  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.254866 14386 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.264340 14386 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.265125  8273 raft_consensus.cc:1275] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:37.264871 14386 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.266758 14360 consensus_queue.cc:1048] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:37.268419 14386 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:37.274080  8238 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.276988  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:37.295184  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.296337 14386 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:37.300992 14244 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.301577 14244 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.302738 14382 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.303603 14244 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:37.303316 14382 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.306001 14382 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:37.309033  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:37.309684  8265 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
W20260709 13:05:37.315498  8237 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:37.322135  8775 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.322773  8775 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.324270  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.324695  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:37.325538  8774 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.325914  8774 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.327128 14360 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:37.327705 14360 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:37.362323  8775 consensus_peers.cc:597] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.416504 14253 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.417018 14253 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.419071 14253 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:37.419482 14253 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.420168 14253 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:37.423425  8775 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.432646  8775 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.433524 14253 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:37.455559  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.456022  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.473477 14253 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:37.486539  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.486981  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.487768 14253 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:37.551749 14253 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.552313 14253 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.554353 14253 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:37.559717  8774 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:37.562947  8775 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.563359  8775 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.564437 14253 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.577174 14253 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.577716 14253 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.579823 14253 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:37.583570  8265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
W20260709 13:05:37.596017  8775 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.596439  8775 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.597514 14360 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:37.604018 14384 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.604561 14384 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:37.606592 14384 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:37.615128  8238 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.615829  8237 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.616214  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.617466 14384 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:37.628024 14360 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.628587 14360 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.630614 14360 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:37.635354 14384 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.635888 14384 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:37.636251  8775 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.638010  8774 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.638418  8774 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.639672 14360 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:37.643150  8238 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.645721 14384 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:37.647261 14386 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.647765 14386 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:37.649678 14386 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:37.651110  8237 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.651510  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.653720 14384 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:37.658937  8238 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.663197  8237 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.663661  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.667701 14384 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:37.669548  8007 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.215.65:38095, user_credentials={real_user=slave}} blocked reactor thread for 65996.9us
W20260709 13:05:37.672148  8007 catalog_manager.cc:4755] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 157272e89e0f4099b4d825211d7d823a: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.696031 14384 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.696599 14384 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:37.698638 14384 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:37.708973  8237 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:37.709686  8238 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.710080  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.710743 14386 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:37.777886  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:37.790802 14384 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.791358 14384 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.804637 14384 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:37.810484  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:37.816231  8238 leader_election.cc:336] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.816637  8238 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 17c126976afd40d9a398d13a5ddd222f, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.817693 14384 raft_consensus.cc:2749] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.829243 14382 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.829807 14382 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.831735 14382 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:37.835217  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:37.836499  8273 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 15.
I20260709 13:05:37.838899  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:37.846330 14360 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:37.846719 14360 raft_consensus.cc:493] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.847043 14360 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:37.863243  8775 leader_election.cc:336] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.899299 14244 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.899852 14244 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.904059 14386 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.905032 14244 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:37.904940 14386 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.905745 14384 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.906242 14384 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.908392 14384 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:37.910681 14386 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:37.912175  8237 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:37.915190 14382 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.915758 14382 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:37.916132  8238 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.916651  8238 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.917086  8238 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.917802 14384 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:37.918761  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:37.919387  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
I20260709 13:05:37.921407 14382 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:37.922681  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:37.930012 14360 raft_consensus.cc:515] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.933648  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:37.945452  8808 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:37.933241  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
W20260709 13:05:37.940047  8774 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:37.941926  8238 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:37.946424  8810 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 16.
I20260709 13:05:37.949265  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:37.950536 14407 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:37.950888 14407 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.951205 14407 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.961738 14407 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.969071 14386 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.977530 14386 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:37.979476 14386 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:37.969170  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f66db9a2fdf400a9046121a4b3b1b3b" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561"
I20260709 13:05:37.982429  8273 raft_consensus.cc:3060] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:37.984443  8238 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.970598 14360 leader_election.cc:290] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:37.990465  8775 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.990885  8775 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:37.991796  8775 leader_election.cc:336] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:37.991914  8238 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:37.992743 14386 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:37.993237 14386 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:37.995142 14386 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:37.996024  8273 raft_consensus.cc:2468] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 16.
I20260709 13:05:37.997174  8777 leader_election.cc:304] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 
I20260709 13:05:37.998750 14382 raft_consensus.cc:2804] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:38.000491  8238 leader_election.cc:336] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:38.003454  8237 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:38.007072  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.007894 14384 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.992245 14360 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.008178  8775 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:38.003842  8774 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:38.003489 14382 raft_consensus.cc:697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Becoming Leader. State: Replica: 17c126976afd40d9a398d13a5ddd222f, State: Running, Role: LEADER
I20260709 13:05:38.014253 14382 consensus_queue.cc:237] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:38.016096 14360 raft_consensus.cc:2749] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:38.004320 14407 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:38.019184  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:38.020063  8810 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 20.
I20260709 13:05:38.021606  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157272e89e0f4099b4d825211d7d823a" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:38.022079  8810 raft_consensus.cc:3060] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:38.030741  8775 leader_election.cc:336] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:38.029170  8810 raft_consensus.cc:2468] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:38.033915  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.035744 14407 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:38.036145 14407 raft_consensus.cc:493] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Starting leader election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:38.036530 14407 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.040414  8021 catalog_manager.cc:5697] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f reported cstate change: term changed from 15 to 16, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 17c126976afd40d9a398d13a5ddd222f (127.6.215.68). New cstate: current_term: 16 leader_uuid: "17c126976afd40d9a398d13a5ddd222f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.056460  8237 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.057229 14360 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:38.058414 14360 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:38.061187 14360 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:38.065553 14384 raft_consensus.cc:2804] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:38.066078 14384 raft_consensus.cc:697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:38.066900 14384 consensus_queue.cc:237] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:38.075284 14407 raft_consensus.cc:515] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:38.078758  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:38.079963 14407 leader_election.cc:290] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: Requested vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:38.082921  8775 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:38.085685  8238 leader_election.cc:336] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:38.087072  8775 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.087760 14382 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:38.088948  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e577a5a5d0ab4664ab92aed9a58cfb2d" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f"
I20260709 13:05:38.089543  8810 raft_consensus.cc:3060] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.102087  8810 raft_consensus.cc:2468] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 21.
I20260709 13:05:38.103214  8237 leader_election.cc:304] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.103987 14407 raft_consensus.cc:2804] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:38.104549 14407 raft_consensus.cc:697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Becoming Leader. State: Replica: 9e0c7bd2e224498bb1c68be20e5b3561, State: Running, Role: LEADER
I20260709 13:05:38.105425 14407 consensus_queue.cc:237] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:38.118611  7005 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8221)
I20260709 13:05:38.127350 14407 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:38.128000 14407 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:38.137476  8775 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.138381  8237 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:38.140585 14407 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:38.144419  8238 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:38.145905  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.146663 14386 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:38.155378  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:38.166164  8021 catalog_manager.cc:5697] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 16 to 17, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 17 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.177587 14384 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:38.178123 14384 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:38.180038 14384 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:38.185776  8021 catalog_manager.cc:5697] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 reported cstate change: term changed from 20 to 21, leader changed from afd11cff97554063a80d743fdf2b934d (127.6.215.66) to 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67). New cstate: current_term: 21 leader_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:38.189445  8237 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:38.190167  8238 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:38.190555  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.191655 14407 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:38.235894 14407 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:38.236385 14407 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:38.238667 14407 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:38.239017  8237 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.241955  8238 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.246518  8237 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:38.249158  8238 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.249641  8238 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:38.250000  8238 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.250660 14407 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:38.260596  8237 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.278736  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.280766  8775 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.299194  8775 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.311832  8238 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.314649  8238 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.323309  8238 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.338406  8775 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.347908  8775 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.368710  8775 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.406154  8775 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.425792  8775 consensus_peers.cc:597] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:38.426229  8775 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.440881  8774 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.444665  8238 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.459146  8775 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.469981  8238 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.478722  8238 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.515388  8774 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.521430  8774 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:38.540956  8810 raft_consensus.cc:1275] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:38.542196 14384 consensus_queue.cc:1048] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:05:38.553730  8237 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.565943  8774 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.582288  8775 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.585112  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.596011  8775 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:38.603955  8273 raft_consensus.cc:1275] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Refusing update from remote peer 17c126976afd40d9a398d13a5ddd222f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:38.607720 14360 consensus_queue.cc:1048] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:38.612636  8237 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.616789  8238 consensus_peers.cc:597] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:38.617316  8238 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:38.636471  8775 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.650736  8774 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.676182  8775 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:38.683496  8810 raft_consensus.cc:1275] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Refusing update from remote peer 9e0c7bd2e224498bb1c68be20e5b3561: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:38.687299 14384 consensus_queue.cc:1048] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:05:38.699636  8237 consensus_peers.cc:597] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.736989  8238 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.748653  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.793489 14419 log.cc:927] Time spent T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:05:38.849990  8238 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:38.860997  8237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:34433, user_credentials={real_user=slave}} blocked reactor thread for 65248.8us
W20260709 13:05:38.896971  8237 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.907361  8237 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.918026  8238 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:38.928627 14360 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:38.929246 14360 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:38.931270 14360 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:38.942154  8775 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:38.943828  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:38.944231  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:38.945143 14360 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:38.983258  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:38.998486  8774 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.000346  8237 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.039320  8775 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:39.058975 14244 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.059474 14244 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:39.072117  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.082249 14244 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:39.087308 14384 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.098762 14384 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:39.101061 14384 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:39.095535  8775 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:39.101922  8775 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.102626 14360 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:39.116606  8237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111) [suppressed 650 similar messages]
W20260709 13:05:39.119091  7005 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8221)
W20260709 13:05:39.125779  8238 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:39.159440 14244 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.160017 14244 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:39.161935 14244 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:39.192862  8237 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.193305  8237 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:39.199920  8775 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.200951  8774 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.201370  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.203949 14244 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.211539 14407 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.234632 14244 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.235158 14244 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:39.236979 14244 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:39.256780 14384 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.257431 14384 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:39.259497 14384 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:39.269057  8238 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.276988  8237 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:39.279145  8775 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.287750  8237 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:39.295497  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.295962  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.296609 14244 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.299098 14384 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.299767 14384 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:39.304131 14384 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:39.323042  8774 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:39.332561  8238 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.339056  8237 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.340185  8237 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.340571  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.353718  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:39.354430  8810 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
I20260709 13:05:39.365509 14384 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:39.368714  8237 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:39.369254  8237 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.369720  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.381054 14384 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:39.435896  8774 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:39.446475 14244 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.446947 14244 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:39.448737 14244 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:39.453537  8775 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.472465  8774 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:39.485142  8774 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.485581  8774 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.522054 14244 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:39.581699 14384 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.582193 14384 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:39.586635 14407 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.587159 14407 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:39.589080 14407 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:39.596166 14384 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:39.599265  8238 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.602365  8238 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:39.615483 14421 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.616056 14421 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:39.622254 14421 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:39.653072 14407 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.653666 14407 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:39.666092 14407 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:39.703532  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:39.704192  8810 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
W20260709 13:05:39.709551  8238 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.714718  8237 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.715162  8237 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:39.715988  8237 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.716657 14384 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.716363  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:39.706879  8775 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.752856  8775 consensus_peers.cc:597] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:39.760469 14384 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.768712 14384 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.769188 14384 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:39.770937 14384 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:39.776116  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.776597  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.777261 14244 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:39.780068 14407 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:39.780576 14407 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:39.783314 14407 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:39.831804  8237 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.832343  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.836359 14407 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:39.845281  8238 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.846966  8238 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:39.851308  8007 catalog_manager.cc:4755] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 157272e89e0f4099b4d825211d7d823a: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:39.866991  8237 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:39.873306  8237 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.873829  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.874502 14384 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:39.875499  8237 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:39.875880  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:39.876506 14384 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:39.880116  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:40.119586  7005 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8221)
I20260709 13:05:40.170545 14407 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:40.171191 14407 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:40.173314 14407 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:40.179689  8238 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:40.180444  8237 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:40.180845  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:40.181560 14407 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:40.214382 14407 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:40.214895 14407 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:40.216964 14407 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:40.227058  8237 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:40.233999  8238 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:40.234478  8238 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:40.239666 14384 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.259157 14407 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:40.259722 14407 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:40.261896 14407 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:40.267844  8237 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:40.270530  8238 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:40.270938  8238 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:40.272212 14384 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:40.409744  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:40.548900  8238 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.612277  8775 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.639631  8238 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.695801  8238 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.730712  8237 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:40.746752  8775 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.782372  8774 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:40.787212  8775 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.830660  8238 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:40.844162  8238 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.844681  8774 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:40.846271  8775 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.856822  8775 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.863657  8238 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.869978  8237 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:40.893502  8238 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:40.893988  8774 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:40.935689  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:40.951792  8238 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.011363  8775 consensus_peers.cc:597] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:41.035233  8238 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.041532  8775 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.045799  8774 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.054711  8775 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.055135  8237 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:41.071657 14244 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.072217 14244 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:41.075911  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:41.076403 14244 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:41.076514  8269 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
W20260709 13:05:41.092751  8775 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:41.093792  8774 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:41.094244  8774 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:41.095504 14244 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:41.115281  8238 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:41.118101 14407 raft_consensus.cc:493] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.118593 14407 raft_consensus.cc:515] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:41.120708 14407 leader_election.cc:290] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.121236  7005 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8221)
I20260709 13:05:41.134892 14421 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.135495 14421 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:41.145190  8237 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:41.146209 14421 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.151260  8775 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:41.159592  8238 leader_election.cc:336] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:41.163827  8238 leader_election.cc:304] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:41.163399  8775 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.162923  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:41.165207  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:41.168116 14407 raft_consensus.cc:2749] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.173391 14421 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:41.196060  8775 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:41.223498 14421 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.224149 14421 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:41.226214 14421 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.247819  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.250088  8774 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:41.261802  8774 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.289918  8775 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.297564  8775 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.301043  8775 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:41.302670  8775 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:41.296985  8237 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.296036  8238 consensus_peers.cc:597] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:41.310869 14427 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:41.330880  8238 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.339474  8775 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.341529  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.375041  8775 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:41.377872  8237 consensus_peers.cc:597] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.405099  8774 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.406204  8238 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:41.436627 14421 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.437197 14421 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:41.439157 14421 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.446272  8775 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:41.450001  8237 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.450793  8774 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.451298  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:41.454777  8774 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:41.457495 14421 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:41.472505 14384 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.473023 14384 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:41.475378 14384 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:41.481832  8238 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:41.484952  8237 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:41.485116  8808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:41.485502  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:41.485908  8808 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
I20260709 13:05:41.486788 14384 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:41.521942  8237 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.546160  8237 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.575021  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.577929  8237 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.591915  8775 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:41.618129 14384 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.618619 14384 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:41.620425 14384 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.624027  8237 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:41.625600  8238 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:41.626056  8238 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:41.627107 14384 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:41.741266  8238 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:41.760228 14407 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.760732 14407 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:41.763530 14407 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.772325  8237 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:41.807080  8238 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:41.835325  8237 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:41.809104  8238 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:41.838626 14384 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:41.860807  8774 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.874015  8237 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:41.896162  8237 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:41.913167  8774 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:41.989462 14244 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:41.989936 14244 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:41.991719 14244 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:41.999059  8775 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:42.007299 14244 raft_consensus.cc:493] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:42.007853 14244 raft_consensus.cc:515] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:42.009931 14244 leader_election.cc:290] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:42.021075  8775 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:42.022303  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:42.023128  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:42.025647 14244 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:42.038363  8774 leader_election.cc:336] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:42.039819  8774 leader_election.cc:304] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:42.040547 14244 raft_consensus.cc:2749] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:42.098291  8237 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:42.121676  7005 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8221)
W20260709 13:05:42.149216  8774 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:42.198834  8775 consensus_peers.cc:597] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:42.305598  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:42.434258 14384 raft_consensus.cc:493] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:42.434700 14384 raft_consensus.cc:515] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:42.436368 14384 leader_election.cc:290] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:42.446028  8237 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:42.447166  8238 leader_election.cc:336] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:42.447614  8238 leader_election.cc:304] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:42.449473 14384 raft_consensus.cc:2749] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.493877 14384 raft_consensus.cc:493] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:42.494324 14384 raft_consensus.cc:515] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:42.496125 14384 leader_election.cc:290] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:42.500706  8238 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:42.501142  8237 leader_election.cc:336] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:42.501551  8237 leader_election.cc:304] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:42.503225 14407 raft_consensus.cc:2749] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.630664 14427 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:42.631276 14427 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:42.633307 14427 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:42.641940  8775 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:42.642719  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:42.643118  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:42.644126 14244 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:42.760515 14384 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:42.761018 14384 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:42.770536  8238 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:42.780202 14384 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
I20260709 13:05:42.806524  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:42.807196  8810 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 18.
W20260709 13:05:42.819351  8237 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:42.820003  8237 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:42.825740 14407 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.917529 14407 raft_consensus.cc:493] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:42.917991 14407 raft_consensus.cc:515] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:42.929080 14407 leader_election.cc:290] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:42.956696  8238 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:42.957502  8238 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:42.959331  8775 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:42.998968  8238 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.005105  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.030786  8237 leader_election.cc:336] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:43.034555  8237 leader_election.cc:304] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:43.037161 14407 raft_consensus.cc:2749] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:43.105602 14407 raft_consensus.cc:493] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:43.106084 14407 raft_consensus.cc:515] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
W20260709 13:05:43.112365  8238 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:43.113117 14407 leader_election.cc:290] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:43.122164  7005 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8221)
W20260709 13:05:43.123850  8237 leader_election.cc:336] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:43.124338  8237 leader_election.cc:304] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:43.125061 14407 raft_consensus.cc:2749] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:43.157109  8775 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.165202  8238 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.193208  8238 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.203001  8774 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.248951  8775 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.276800  8238 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.278347  8775 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.298368  8774 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:43.311589 14384 raft_consensus.cc:493] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:43.312109 14384 raft_consensus.cc:515] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:43.313861 14384 leader_election.cc:290] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:43.357438 14428 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:43.358038 14428 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:43.360496 14428 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:43.362763  8273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:43.363381  8273 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 17.
W20260709 13:05:43.350831  8238 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:43.389956  8774 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:43.391001  8237 leader_election.cc:336] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:43.395607  8237 leader_election.cc:304] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:43.396430  8775 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.397290  8775 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:43.397727 14384 raft_consensus.cc:2749] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:43.400059  8775 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:43.400873  8775 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:43.405460 14427 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:43.417443  8238 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.420045  8774 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.447574  8237 consensus_peers.cc:597] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.498955  8237 consensus_peers.cc:597] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.536072  8775 consensus_peers.cc:597] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:43.536199  8238 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.547291  8238 consensus_peers.cc:597] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:43.569876  8775 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:43.577898 14384 raft_consensus.cc:493] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:43.578418 14384 raft_consensus.cc:515] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:43.580101 14384 leader_election.cc:290] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:43.587878  8238 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:43.590480 14384 raft_consensus.cc:493] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:43.591008 14384 raft_consensus.cc:515] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:43.593146 14384 leader_election.cc:290] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:43.608162  8237 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.635572  8237 consensus_peers.cc:597] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.636529  8237 consensus_peers.cc:597] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.633488  8238 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:43.664496  8775 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.664779  8237 leader_election.cc:336] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:43.665447  8237 leader_election.cc:304] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:43.668287 14407 raft_consensus.cc:2749] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:43.671515  8238 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.673828  8238 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.673038  8237 leader_election.cc:336] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:43.674790  8237 leader_election.cc:304] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:43.676333 14407 raft_consensus.cc:2749] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:43.705507  8238 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.707355  8775 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.708498  8238 consensus_peers.cc:597] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:43.740345  8775 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.770870  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.835207  8774 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.840533  8774 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.871766  8775 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.874073  8774 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.952270  8237 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:43.962366  8237 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:43.963214  8775 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.963755  8775 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.996364  8007 catalog_manager.cc:4755] TS 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 157272e89e0f4099b4d825211d7d823a: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:44.005717  8238 consensus_peers.cc:597] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:44.012005  8237 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:44.032873  8775 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:44.041982  8774 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:44.046752  8237 consensus_peers.cc:597] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:44.074035  8237 consensus_peers.cc:597] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.122764  7005 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8221)
W20260709 13:05:44.128731  8237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111) [suppressed 649 similar messages]
W20260709 13:05:44.148260  8237 consensus_peers.cc:597] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.214043  8237 consensus_peers.cc:597] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.237793  8237 consensus_peers.cc:597] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:44.283823  8237 consensus_peers.cc:597] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.303109  8237 consensus_peers.cc:597] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.331934  8238 consensus_peers.cc:597] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:44.359352 14428 raft_consensus.cc:493] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:44.360376 14428 raft_consensus.cc:515] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:44.362927 14428 leader_election.cc:290] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:44.374629  8774 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.375434  8775 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:44.376382  8774 leader_election.cc:336] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:44.376864  8774 leader_election.cc:304] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:44.379422 14428 raft_consensus.cc:2749] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:44.448392 14428 raft_consensus.cc:493] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:44.449153 14428 raft_consensus.cc:515] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:44.451499 14428 leader_election.cc:290] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:44.508335  8775 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:44.566955  8774 leader_election.cc:336] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:44.567503  8774 leader_election.cc:304] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:44.568252 14436 raft_consensus.cc:2749] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:44.574674  8774 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.655316  8237 consensus_peers.cc:597] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:05:44.729069 14428 raft_consensus.cc:493] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:44.729802 14428 raft_consensus.cc:515] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:44.753144 14428 leader_election.cc:290] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:44.756238  8269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685faa95b5f44629fc266055fc278aa" candidate_uuid: "17c126976afd40d9a398d13a5ddd222f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" is_pre_election: true
I20260709 13:05:44.757385  8269 raft_consensus.cc:2468] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c126976afd40d9a398d13a5ddd222f in term 18.
W20260709 13:05:44.770679  8775 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:44.801431  8774 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:44.857210  8774 leader_election.cc:336] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:44.865990  8774 leader_election.cc:304] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f, 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:44.869503 14428 raft_consensus.cc:2749] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:44.865499  8775 consensus_peers.cc:597] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:44.939860  8237 consensus_peers.cc:597] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:05:45.006160 14438 raft_consensus.cc:493] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:45.006978 14438 raft_consensus.cc:515] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } attrs { replace: true } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:45.010229 14438 leader_election.cc:290] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 17c126976afd40d9a398d13a5ddd222f (127.6.215.68:34433)
W20260709 13:05:45.032917  8238 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:45.033068  8810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6579e4214554536b3727b869a8aedfa" candidate_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17c126976afd40d9a398d13a5ddd222f" is_pre_election: true
I20260709 13:05:45.041733  8810 raft_consensus.cc:2468] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e0c7bd2e224498bb1c68be20e5b3561 in term 17.
W20260709 13:05:45.043711  8237 leader_election.cc:336] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:45.076514  8237 leader_election.cc:304] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:45.083449 14431 raft_consensus.cc:2749] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:45.182063  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
I20260709 13:05:45.187815 14431 raft_consensus.cc:493] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:45.188537 14431 raft_consensus.cc:515] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } }
I20260709 13:05:45.191115 14431 leader_election.cc:290] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:45.197288  8238 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:45.225571  8237 leader_election.cc:336] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:45.226157  8237 leader_election.cc:304] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e0c7bd2e224498bb1c68be20e5b3561; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:45.226977 14431 raft_consensus.cc:2749] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:45.333841  8775 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:45.366712  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
W20260709 13:05:45.390875  8777 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.394542  8777 consensus_peers.cc:597] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.446946  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:45.449875  7005 tablet_replica.cc:333] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.451150  7005 raft_consensus.cc:2243] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.452088  7005 raft_consensus.cc:2272] T bc9f1ca41df6462b902893527ceb3878 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.460035  7005 tablet_replica.cc:333] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.460850  7005 raft_consensus.cc:2243] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.462826  7005 raft_consensus.cc:2272] T e848f577948c470fb4c95fcc2b55b7ef P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.467376  7005 tablet_replica.cc:333] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
W20260709 13:05:45.468472  8777 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.469394  7005 raft_consensus.cc:2243] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.470834  7005 raft_consensus.cc:2272] T 22c63c7039644c089bf014466158ac6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.474689  7005 tablet_replica.cc:333] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.475613  7005 raft_consensus.cc:2243] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.477185  7005 raft_consensus.cc:2272] T ccbf67588374458ebbd07bc5aeeb3b5a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.480047  7005 tablet_replica.cc:333] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
W20260709 13:05:45.480468  8775 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:45.481038  7005 raft_consensus.cc:2243] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.482077  7005 raft_consensus.cc:2272] T 7685faa95b5f44629fc266055fc278aa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.485242  7005 tablet_replica.cc:333] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.486023  7005 raft_consensus.cc:2243] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.487423  7005 raft_consensus.cc:2272] T d0ae8ee6216f434eb7857a29d9b682d9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.490128  7005 tablet_replica.cc:333] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.490648  7005 raft_consensus.cc:2243] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.491220  7005 raft_consensus.cc:2272] T 76f64012d7a146ddb8774cc4299a38e8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.493216  7005 tablet_replica.cc:333] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.493765  7005 raft_consensus.cc:2243] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.494279  7005 raft_consensus.cc:2272] T c8addb0a61b24a3fa8f4700e78ac3a48 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.496376  7005 tablet_replica.cc:333] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.496908  7005 raft_consensus.cc:2243] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.498309  7005 raft_consensus.cc:2272] T 19747a1b37df480faebc96d93689cda5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.501168  7005 tablet_replica.cc:333] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.501988  7005 raft_consensus.cc:2243] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.502774  7005 raft_consensus.cc:2272] T 729f99fd4567469babdeb05f3b4b3d27 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.505642  7005 tablet_replica.cc:333] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.506891  7005 raft_consensus.cc:2243] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.509167  7005 raft_consensus.cc:2272] T 8339f0f377ff4af7947c4a11b4aea010 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.512238  7005 tablet_replica.cc:333] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.513088  7005 raft_consensus.cc:2243] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.513775  7005 raft_consensus.cc:2272] T 292514be4a7b4f768913b094de3d5d6d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.516333  7005 tablet_replica.cc:333] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.517073  7005 raft_consensus.cc:2243] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.519277  7005 raft_consensus.cc:2272] T 157272e89e0f4099b4d825211d7d823a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.521727  7005 tablet_replica.cc:333] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.522424  7005 raft_consensus.cc:2243] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.523614  7005 raft_consensus.cc:2272] T 79c1b3089e984aa991014bbd831e7bfc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.526464  7005 tablet_replica.cc:333] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.527205  7005 raft_consensus.cc:2243] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.527850  7005 raft_consensus.cc:2272] T c788fd48c46f4ede898fe663e6cf64cc P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.529984  8777 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.531217  8777 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.530642  7005 tablet_replica.cc:333] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.532481  7005 raft_consensus.cc:2243] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.533641  7005 raft_consensus.cc:2272] T ff5d69caf66c468aa9766af3b02649b0 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.536270  7005 tablet_replica.cc:333] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.537125  7005 raft_consensus.cc:2243] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.537889  7005 raft_consensus.cc:2272] T 5d2c54c9c07a444898c0a63f323dfd5d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.541688  8777 consensus_peers.cc:597] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.543440  7005 tablet_replica.cc:333] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.544312  7005 raft_consensus.cc:2243] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.545616  7005 raft_consensus.cc:2272] T 60fac097ca0e444dbe442019479fc818 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.549118  8774 consensus_peers.cc:597] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:05:45.550068  7005 tablet_replica.cc:333] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.550874  7005 raft_consensus.cc:2243] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.551262 14428 raft_consensus.cc:493] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:45.552994 14428 raft_consensus.cc:515] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:45.555392 14428 leader_election.cc:290] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
I20260709 13:05:45.552376  7005 raft_consensus.cc:2272] T 55917afdf34f4dd3985df6ff71c4d019 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.558641  7005 tablet_replica.cc:333] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.559415  7005 raft_consensus.cc:2243] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.559989  7005 raft_consensus.cc:2272] T 1f5168daf09c45b4accfa213d5b29a43 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.560710  8774 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:45.562517  7005 tablet_replica.cc:333] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.564700  7005 raft_consensus.cc:2243] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:05:45.563318  8238 consensus_peers.cc:597] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:45.571908  8777 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.572729  8238 consensus_peers.cc:597] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:45.574963  8774 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:05:45.572919  7005 raft_consensus.cc:2272] T fe00257dce7d4bb38119184a1572ed9e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.577948  7005 tablet_replica.cc:333] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.578682  7005 raft_consensus.cc:2243] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:05:45.578987  8777 consensus_peers.cc:597] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.580027  7005 raft_consensus.cc:2272] T e577a5a5d0ab4664ab92aed9a58cfb2d P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.580914  8775 leader_election.cc:336] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:45.581719  8775 leader_election.cc:304] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:45.582480 14428 raft_consensus.cc:2749] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:45.583249  7005 tablet_replica.cc:333] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.584450  7005 raft_consensus.cc:2243] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.586345  7005 raft_consensus.cc:2272] T 1c80cbb5d28348cdbb8e0e9ef4d3bf28 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.590844  8777 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.592147  7005 tablet_replica.cc:333] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.593078  7005 raft_consensus.cc:2243] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.594620  7005 raft_consensus.cc:2272] T db7845485d6b4a86b219eae83659a36e P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.598162  7005 tablet_replica.cc:333] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.598913  7005 raft_consensus.cc:2243] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.600078  7005 raft_consensus.cc:2272] T b9f91b8425044826becb1f4ae12269f8 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.602875  8777 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.603116  7005 tablet_replica.cc:333] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.603997  7005 raft_consensus.cc:2243] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:45.604453  8775 consensus_peers.cc:597] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:45.604979  7005 raft_consensus.cc:2272] T e052a7e080bb4a1e9a5ae52b54c2408b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.608043  7005 tablet_replica.cc:333] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.608731  7005 raft_consensus.cc:2243] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.609848  7005 raft_consensus.cc:2272] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.612430  7005 tablet_replica.cc:333] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.613165  7005 raft_consensus.cc:2243] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.613873  7005 raft_consensus.cc:2272] T 13dada18d63642d99cf497f978999d7a P 9e0c7bd2e224498bb1c68be20e5b3561 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.616531  7005 tablet_replica.cc:333] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.617201  7005 raft_consensus.cc:2243] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.618726  7005 raft_consensus.cc:2272] T 05f6533c9e4149aa9b528e746b4052b3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.621312  7005 tablet_replica.cc:333] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.622015  7005 raft_consensus.cc:2243] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.623064  7005 raft_consensus.cc:2272] T d4d62387bcf94eaaaf201aeca2c2a48f P 9e0c7bd2e224498bb1c68be20e5b3561 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.625438  7005 tablet_replica.cc:333] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.626140  7005 raft_consensus.cc:2243] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.626693  7005 raft_consensus.cc:2272] T f86e3e4c37f4426b821f0af0b5b1c516 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.629141  7005 tablet_replica.cc:333] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
W20260709 13:05:45.629642  8775 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:45.629832  7005 raft_consensus.cc:2243] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.631057  7005 raft_consensus.cc:2272] T b3e62d20a8d54072882e6b574cdddee5 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.633584  7005 tablet_replica.cc:333] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.634265  7005 raft_consensus.cc:2243] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.635389  7005 raft_consensus.cc:2272] T d6579e4214554536b3727b869a8aedfa P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.637897  7005 tablet_replica.cc:333] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.638578  7005 raft_consensus.cc:2243] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.639214  7005 raft_consensus.cc:2272] T 621c07aa07044d69b33dead0af7e7fd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.641846  7005 tablet_replica.cc:333] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.642560  7005 raft_consensus.cc:2243] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.643119  7005 raft_consensus.cc:2272] T 327bf050c29d49408e736f7e8fda9e6b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.644575  8775 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:45.645689  7005 tablet_replica.cc:333] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.646435  7005 raft_consensus.cc:2243] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.647100  7005 raft_consensus.cc:2272] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 9e0c7bd2e224498bb1c68be20e5b3561 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.649516  7005 tablet_replica.cc:333] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.650219  7005 raft_consensus.cc:2243] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.650959  7005 raft_consensus.cc:2272] T 9e2628cd0cb14e318af904dd53421357 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.653373  7005 tablet_replica.cc:333] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.654040  7005 raft_consensus.cc:2243] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.654667  7005 raft_consensus.cc:2272] T 26e50e42ace14a4db7be14613c771220 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.657163  7005 tablet_replica.cc:333] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.657837  7005 raft_consensus.cc:2243] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.658489  7005 raft_consensus.cc:2272] T bd9e13ff887048ca88ba20c2768182d3 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.660981  7005 tablet_replica.cc:333] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.661672  7005 raft_consensus.cc:2243] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.662855  7005 raft_consensus.cc:2272] T 363112022a444c2f8b7cf6e11c7c1c36 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.665285  7005 tablet_replica.cc:333] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.665977  7005 raft_consensus.cc:2243] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.666486  7005 raft_consensus.cc:2272] T 8f66db9a2fdf400a9046121a4b3b1b3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.666968  8777 consensus_peers.cc:597] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.669049  7005 tablet_replica.cc:333] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.669775  7005 raft_consensus.cc:2243] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.670573  7005 raft_consensus.cc:2272] T 607b372ee65444fb8187089e3657ab3b P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.672957  7005 tablet_replica.cc:333] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.673614  7005 raft_consensus.cc:2243] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.674232  7005 raft_consensus.cc:2272] T 1c0b25b4cb7b4ba18663e77cdacc4dbb P 9e0c7bd2e224498bb1c68be20e5b3561 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.674386  8777 consensus_peers.cc:597] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.676736  7005 tablet_replica.cc:333] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.677412  7005 raft_consensus.cc:2243] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.678299  7005 raft_consensus.cc:2272] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.680722  7005 tablet_replica.cc:333] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.681366  7005 raft_consensus.cc:2243] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.682113  7005 raft_consensus.cc:2272] T 2d9a86475338460da550bd2a16b10c49 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.684507  7005 tablet_replica.cc:333] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.685128  7005 raft_consensus.cc:2243] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.686733  7005 raft_consensus.cc:2272] T e8843c2ad2d543b89354e114ebd9d638 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.689320  7005 tablet_replica.cc:333] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.689989  7005 raft_consensus.cc:2243] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.691090  7005 raft_consensus.cc:2272] T 07a2d8845b23413289268a178d97a8ea P 9e0c7bd2e224498bb1c68be20e5b3561 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.693390  7005 tablet_replica.cc:333] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561: stopping tablet replica
I20260709 13:05:45.693948  7005 raft_consensus.cc:2243] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.694545  7005 raft_consensus.cc:2272] T 09b5bde69aba40fd84e97b20005e3997 P 9e0c7bd2e224498bb1c68be20e5b3561 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.714460  8777 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.723939  8777 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.726475  8774 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:45.757001  8777 consensus_peers.cc:597] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.765375  8777 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.833952  8777 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.852397 14440 raft_consensus.cc:493] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:45.853070 14440 raft_consensus.cc:515] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:45.856009 14440 leader_election.cc:290] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:45.859045  8775 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:45.860720  8774 leader_election.cc:336] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:45.861117  8774 leader_election.cc:304] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
I20260709 13:05:45.862483 14440 raft_consensus.cc:2749] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.868729 14440 raft_consensus.cc:493] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader afd11cff97554063a80d743fdf2b934d)
I20260709 13:05:45.869318 14440 raft_consensus.cc:515] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:45.871308 14440 leader_election.cc:290] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313)
W20260709 13:05:45.876113  8775 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
W20260709 13:05:45.877843  8774 leader_election.cc:336] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:45.878218  8774 leader_election.cc:304] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:45.879209  8777 consensus_peers.cc:597] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f -> Peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Couldn't send request to peer 9e0c7bd2e224498bb1c68be20e5b3561. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.879354 14440 raft_consensus.cc:2749] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:45.979409  8775 consensus_peers.cc:597] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.092798  8775 consensus_peers.cc:597] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.114580  8774 consensus_peers.cc:597] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:46.175374  8774 consensus_peers.cc:597] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:46.177477  8774 consensus_peers.cc:597] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:05:46.198539  8775 consensus_peers.cc:597] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.248055  8775 consensus_peers.cc:597] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.289072  8774 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:46.294947  8775 consensus_peers.cc:597] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:46.300830  8774 consensus_peers.cc:597] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:05:46.372215  8775 consensus_peers.cc:597] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.377409  8775 consensus_peers.cc:597] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.452356  8775 consensus_peers.cc:597] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:46.468952  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
W20260709 13:05:46.498196  8775 consensus_peers.cc:597] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:05:46.500675  8775 consensus_peers.cc:597] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f -> Peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Couldn't send request to peer afd11cff97554063a80d743fdf2b934d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:05:46.513653 14428 raft_consensus.cc:493] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:46.514209 14428 raft_consensus.cc:515] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:46.516237 14428 leader_election.cc:290] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:46.516968 14428 raft_consensus.cc:493] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:46.517546 14428 raft_consensus.cc:515] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "afd11cff97554063a80d743fdf2b934d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37313 } attrs { replace: true } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
W20260709 13:05:46.522100  8777 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111)
I20260709 13:05:46.526089 14428 leader_election.cc:290] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
W20260709 13:05:46.526165  8774 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
W20260709 13:05:46.529911  8775 leader_election.cc:336] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:46.530323  8775 leader_election.cc:304] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 9e0c7bd2e224498bb1c68be20e5b3561, afd11cff97554063a80d743fdf2b934d
W20260709 13:05:46.531894  8777 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111)
I20260709 13:05:46.532344  8777 leader_election.cc:304] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:46.533471 14436 raft_consensus.cc:2749] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:46.533818  8775 leader_election.cc:336] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer afd11cff97554063a80d743fdf2b934d (127.6.215.66:37313): Network error: Client connection negotiation failed: client connection to 127.6.215.66:37313: connect: Connection refused (error 111)
I20260709 13:05:46.533332 14428 raft_consensus.cc:2749] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:46.564610  8774 consensus_peers.cc:597] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f -> Peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Couldn't send request to peer 65d66cd655cd4400b079b4427061ca5e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:05:46.584884  7005 tablet_server.cc:179] TabletServer@127.6.215.68:0 shutting down...
I20260709 13:05:46.631002  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:46.631855  7005 tablet_replica.cc:333] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.632928  7005 raft_consensus.cc:2243] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.633908  7005 raft_consensus.cc:2272] T 157272e89e0f4099b4d825211d7d823a P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.636381  7005 tablet_replica.cc:333] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.637238  7005 raft_consensus.cc:2243] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.637982  7005 raft_consensus.cc:2272] T 7685faa95b5f44629fc266055fc278aa P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.640884  7005 tablet_replica.cc:333] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.641764  7005 raft_consensus.cc:2243] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.642781  7005 raft_consensus.cc:2272] T 55917afdf34f4dd3985df6ff71c4d019 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.645151  7005 tablet_replica.cc:333] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.645785  7005 raft_consensus.cc:2243] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.646560  7005 raft_consensus.cc:2272] T f86e3e4c37f4426b821f0af0b5b1c516 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.648986  7005 tablet_replica.cc:333] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.649660  7005 raft_consensus.cc:2243] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.651132  7005 raft_consensus.cc:2272] T db7845485d6b4a86b219eae83659a36e P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.654515  7005 tablet_replica.cc:333] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.655175  7005 raft_consensus.cc:2243] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.656524  7005 raft_consensus.cc:2272] T 8339f0f377ff4af7947c4a11b4aea010 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.659034  7005 tablet_replica.cc:333] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.659586  7005 raft_consensus.cc:2243] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.660405  7005 raft_consensus.cc:2272] T 2f5cf690845d47f4a2d4e3ab5d8922c0 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.662295  7005 tablet_replica.cc:333] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.662822  7005 raft_consensus.cc:2243] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.663408  7005 raft_consensus.cc:2272] T ccbf67588374458ebbd07bc5aeeb3b5a P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.665437  7005 tablet_replica.cc:333] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.666126  7005 raft_consensus.cc:2243] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.666596  7005 raft_consensus.cc:2272] T 19747a1b37df480faebc96d93689cda5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.669184  7005 tablet_replica.cc:333] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.669909  7005 raft_consensus.cc:2243] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.670569  7005 raft_consensus.cc:2272] T 79c1b3089e984aa991014bbd831e7bfc P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.672714  7005 tablet_replica.cc:333] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.673313  7005 raft_consensus.cc:2243] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.674206  7005 raft_consensus.cc:2272] T 292514be4a7b4f768913b094de3d5d6d P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.676075  7005 tablet_replica.cc:333] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.676590  7005 raft_consensus.cc:2243] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.677381  7005 raft_consensus.cc:2272] T 09b5bde69aba40fd84e97b20005e3997 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.679375  7005 tablet_replica.cc:333] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.680071  7005 raft_consensus.cc:2243] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.680751  7005 raft_consensus.cc:2272] T 6b269caef5384838a52bcedc78464607 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.683597  7005 tablet_replica.cc:333] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.684391  7005 raft_consensus.cc:2243] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.685076  7005 raft_consensus.cc:2272] T b3e62d20a8d54072882e6b574cdddee5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.687508  7005 tablet_replica.cc:333] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.688066  7005 raft_consensus.cc:2243] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.688638  7005 raft_consensus.cc:2272] T 45f9d10e30d545a18e699e9ccaea3e4e P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.691252  7005 tablet_replica.cc:333] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.692003  7005 raft_consensus.cc:2243] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.692663  7005 raft_consensus.cc:2272] T d6579e4214554536b3727b869a8aedfa P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.695238  7005 tablet_replica.cc:333] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.695734  7005 raft_consensus.cc:2243] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.696504  7005 raft_consensus.cc:2272] T 327bf050c29d49408e736f7e8fda9e6b P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.698791  7005 tablet_replica.cc:333] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.699481  7005 raft_consensus.cc:2243] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.700569  7005 raft_consensus.cc:2272] T 621c07aa07044d69b33dead0af7e7fd9 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.703280  7005 tablet_replica.cc:333] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.704037  7005 raft_consensus.cc:2243] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.705040  7005 raft_consensus.cc:2272] T 1f5168daf09c45b4accfa213d5b29a43 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.707074  7005 tablet_replica.cc:333] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.707617  7005 raft_consensus.cc:2243] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.708472  7005 raft_consensus.cc:2272] T 8f66db9a2fdf400a9046121a4b3b1b3b P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.710565  7005 tablet_replica.cc:333] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.711652  7005 raft_consensus.cc:2243] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.712164  7005 raft_consensus.cc:2272] T 446d688479d34112bfc4ab0afb09d6f5 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.714717  7005 tablet_replica.cc:333] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.715366  7005 raft_consensus.cc:2243] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.716328  7005 raft_consensus.cc:2272] T 587b9bcf479d417dbc213189e328a0f8 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.718791  7005 tablet_replica.cc:333] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.719278  7005 raft_consensus.cc:2243] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.720204  7005 raft_consensus.cc:2272] T a4e63fd519e64f52b42bde9b044f1a9d P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.722601  7005 tablet_replica.cc:333] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.723268  7005 raft_consensus.cc:2243] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.724248  7005 raft_consensus.cc:2272] T c788fd48c46f4ede898fe663e6cf64cc P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.726298  7005 tablet_replica.cc:333] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.726786  7005 raft_consensus.cc:2243] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.727221  7005 raft_consensus.cc:2272] T 2a3d4a04ded8480c86cbdcb830e8fd57 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.729126  7005 tablet_replica.cc:333] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.729632  7005 raft_consensus.cc:2243] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.730393  7005 raft_consensus.cc:2272] T e848f577948c470fb4c95fcc2b55b7ef P 17c126976afd40d9a398d13a5ddd222f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.732178  7005 tablet_replica.cc:333] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.732648  7005 raft_consensus.cc:2243] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.733649  7005 raft_consensus.cc:2272] T 3ca6717bd9844d668ee0a2fff3b530f4 P 17c126976afd40d9a398d13a5ddd222f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.736174  7005 tablet_replica.cc:333] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.736639  7005 raft_consensus.cc:2243] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.737623  7005 raft_consensus.cc:2272] T 26e50e42ace14a4db7be14613c771220 P 17c126976afd40d9a398d13a5ddd222f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.739428  7005 tablet_replica.cc:333] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.739926  7005 raft_consensus.cc:2243] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.740665  7005 raft_consensus.cc:2272] T 9e2628cd0cb14e318af904dd53421357 P 17c126976afd40d9a398d13a5ddd222f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.742558  7005 tablet_replica.cc:333] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.743079  7005 raft_consensus.cc:2243] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.744045  7005 raft_consensus.cc:2272] T 3771ea49d91a4d3f8c3b8c67db52b9ab P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.746024  7005 tablet_replica.cc:333] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.746497  7005 raft_consensus.cc:2243] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.746881  7005 raft_consensus.cc:2272] T 4fc42e8321e24c91a3684956eeb796b7 P 17c126976afd40d9a398d13a5ddd222f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.748608  7005 tablet_replica.cc:333] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.749100  7005 raft_consensus.cc:2243] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.749980  7005 raft_consensus.cc:2272] T 89c4577341fc4203869bd3f8476d9c43 P 17c126976afd40d9a398d13a5ddd222f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.751946  7005 tablet_replica.cc:333] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.752415  7005 raft_consensus.cc:2243] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.752853  7005 raft_consensus.cc:2272] T e577a5a5d0ab4664ab92aed9a58cfb2d P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.754846  7005 tablet_replica.cc:333] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.755359  7005 raft_consensus.cc:2243] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.755874  7005 raft_consensus.cc:2272] T e8843c2ad2d543b89354e114ebd9d638 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.758226  7005 tablet_replica.cc:333] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.758756  7005 raft_consensus.cc:2243] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.759302  7005 raft_consensus.cc:2272] T d0ae8ee6216f434eb7857a29d9b682d9 P 17c126976afd40d9a398d13a5ddd222f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.761720  7005 tablet_replica.cc:333] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.762166  7005 raft_consensus.cc:2243] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.762935  7005 raft_consensus.cc:2272] T 729f99fd4567469babdeb05f3b4b3d27 P 17c126976afd40d9a398d13a5ddd222f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.763780 14436 raft_consensus.cc:493] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e0c7bd2e224498bb1c68be20e5b3561)
I20260709 13:05:46.764259 14436 raft_consensus.cc:515] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "65d66cd655cd4400b079b4427061ca5e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 38095 } } peers { permanent_uuid: "9e0c7bd2e224498bb1c68be20e5b3561" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 43007 } } peers { permanent_uuid: "17c126976afd40d9a398d13a5ddd222f" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 34433 } attrs { promote: false } }
I20260709 13:05:46.765116  7005 tablet_replica.cc:333] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.765894  7005 raft_consensus.cc:2243] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.766341 14436 leader_election.cc:290] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095), 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007)
I20260709 13:05:46.766935  7005 raft_consensus.cc:2272] T 5d2c54c9c07a444898c0a63f323dfd5d P 17c126976afd40d9a398d13a5ddd222f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.769635  7005 tablet_replica.cc:333] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.770269  7005 raft_consensus.cc:2243] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:46.770264  8774 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65d66cd655cd4400b079b4427061ca5e (127.6.215.65:38095): Network error: Client connection negotiation failed: client connection to 127.6.215.65:38095: connect: Connection refused (error 111)
I20260709 13:05:46.771015  7005 raft_consensus.cc:2272] T e7922a990c04422aa6d20dbef2f00976 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:46.772197  8777 leader_election.cc:336] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111)
I20260709 13:05:46.772675  8777 leader_election.cc:304] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17c126976afd40d9a398d13a5ddd222f; no voters: 65d66cd655cd4400b079b4427061ca5e, 9e0c7bd2e224498bb1c68be20e5b3561
I20260709 13:05:46.773286  7005 tablet_replica.cc:333] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.773501 14436 raft_consensus.cc:2749] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:46.774029  7005 raft_consensus.cc:2243] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.774776  7005 raft_consensus.cc:2272] T 8cf74acfb5ea42d6ab6d4dfdb9067cd9 P 17c126976afd40d9a398d13a5ddd222f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.776494  7005 tablet_replica.cc:333] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.776922  7005 raft_consensus.cc:2243] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.777477  7005 raft_consensus.cc:2272] T 60fac097ca0e444dbe442019479fc818 P 17c126976afd40d9a398d13a5ddd222f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.779176  7005 tablet_replica.cc:333] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f: stopping tablet replica
I20260709 13:05:46.779587  7005 raft_consensus.cc:2243] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:05:46.780390  7005 raft_consensus.cc:2272] T 0862042002d04bcbb6dd1a4c89ed990c P 17c126976afd40d9a398d13a5ddd222f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.117858  7005 tablet_server.cc:196] TabletServer@127.6.215.68:0 shutdown complete.
I20260709 13:05:47.187052  7005 master.cc:562] Master@127.6.215.126:41935 shutting down...
W20260709 13:05:47.225675  8071 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:05:47.225997  8071 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:05:47.226183  8071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:05:51.893867  8010 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111) [suppressed 314 similar messages]
W20260709 13:05:51.896725  8010 catalog_manager.cc:4755] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): ChangeConfig:REMOVE_PEER RPC failed for tablet ccbf67588374458ebbd07bc5aeeb3b5a: Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111)
W20260709 13:06:26.966938  8010 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 13:06:26.970453  8010 catalog_manager.cc:4755] TS 9e0c7bd2e224498bb1c68be20e5b3561 (127.6.215.67:43007): ChangeConfig:REMOVE_PEER RPC failed for tablet 19747a1b37df480faebc96d93689cda5: Network error: Client connection negotiation failed: client connection to 127.6.215.67:43007: connect: Connection refused (error 111)
I20260709 13:06:28.687057  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:28.688062  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.688441  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P b6992e613c544a1db779b61d07fa6870: stopping tablet replica
I20260709 13:06:28.862569  7005 master.cc:584] Master@127.6.215.126:41935 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (232105 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:06:28.965726  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:37295
I20260709 13:06:28.966828  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:28.971855 14452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:28.971876 14451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:28.973080 14454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:28.974596  7005 server_base.cc:1061] running on GCE node
I20260709 13:06:28.977547  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:28.977769  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:28.978024  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602388978005 us; error 0 us; skew 500 ppm
I20260709 13:06:28.978549  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:28.981053  7005 webserver.cc:533] Webserver started at http://127.6.215.126:44791/ using document root <none> and password file <none>
I20260709 13:06:28.981564  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:28.981722  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:28.982004  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:28.983189  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "1fd259ba3d9648998b521c980ba1db9d"
format_stamp: "Formatted at 2026-07-09 13:06:28 on dist-test-slave-r31z"
I20260709 13:06:28.987514  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:06:28.990881 14459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:28.991546  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:06:28.991842  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "1fd259ba3d9648998b521c980ba1db9d"
format_stamp: "Formatted at 2026-07-09 13:06:28 on dist-test-slave-r31z"
I20260709 13:06:28.992085  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.011193  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.012383  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.055011  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:37295
I20260709 13:06:29.055131 14510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:37295 every 8 connection(s)
I20260709 13:06:29.059548 14511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.073118 14511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d: Bootstrap starting.
I20260709 13:06:29.078001 14511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.083391 14511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d: No bootstrap required, opened a new log
I20260709 13:06:29.085584 14511 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd259ba3d9648998b521c980ba1db9d" member_type: VOTER }
I20260709 13:06:29.086053 14511 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.086238 14511 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd259ba3d9648998b521c980ba1db9d, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.086737 14511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd259ba3d9648998b521c980ba1db9d" member_type: VOTER }
I20260709 13:06:29.087280 14511 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:29.087482 14511 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:29.087713 14511 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.092170 14511 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd259ba3d9648998b521c980ba1db9d" member_type: VOTER }
I20260709 13:06:29.092635 14511 leader_election.cc:304] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fd259ba3d9648998b521c980ba1db9d; no voters: 
I20260709 13:06:29.093775 14511 leader_election.cc:290] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:29.094496 14514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:29.096204 14514 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 1 LEADER]: Becoming Leader. State: Replica: 1fd259ba3d9648998b521c980ba1db9d, State: Running, Role: LEADER
I20260709 13:06:29.096854 14511 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:29.097113 14514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd259ba3d9648998b521c980ba1db9d" member_type: VOTER }
I20260709 13:06:29.103929 14516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fd259ba3d9648998b521c980ba1db9d. Latest consensus state: current_term: 1 leader_uuid: "1fd259ba3d9648998b521c980ba1db9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd259ba3d9648998b521c980ba1db9d" member_type: VOTER } }
I20260709 13:06:29.104130 14515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fd259ba3d9648998b521c980ba1db9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd259ba3d9648998b521c980ba1db9d" member_type: VOTER } }
I20260709 13:06:29.104776 14515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:29.105537 14516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:29.112663 14523 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:29.119515 14523 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:29.120530  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:29.128679 14523 catalog_manager.cc:1383] Generated new cluster ID: e9037ed0af474b16900d06ab07c0a2c4
I20260709 13:06:29.128966 14523 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:29.149143 14523 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:29.150558 14523 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:29.167124 14523 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d: Generated new TSK 0
I20260709 13:06:29.167718 14523 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:29.187878  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.194010 14532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.194660 14533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.196259 14535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.197549  7005 server_base.cc:1061] running on GCE node
I20260709 13:06:29.199512  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.199702  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.199823  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602389199812 us; error 0 us; skew 500 ppm
I20260709 13:06:29.200325  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.202633  7005 webserver.cc:533] Webserver started at http://127.6.215.65:38251/ using document root <none> and password file <none>
I20260709 13:06:29.203084  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.203259  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.203480  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.204633  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.210089  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:06:29.213584 14540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.214407  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:06:29.214710  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.214962  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.230997  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.232123  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.233582  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.235757  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.235942  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.236163  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.236330  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.281883  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:43631
I20260709 13:06:29.282066 14602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:43631 every 8 connection(s)
I20260709 13:06:29.287557  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.294994 14607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.297081 14608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.299134 14610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.300068  7005 server_base.cc:1061] running on GCE node
I20260709 13:06:29.302677  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.302939  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.303102  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602389303084 us; error 0 us; skew 500 ppm
I20260709 13:06:29.303584 14603 heartbeater.cc:344] Connected to a master server at 127.6.215.126:37295
I20260709 13:06:29.303805  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.304018 14603 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.304940 14603 heartbeater.cc:507] Master 127.6.215.126:37295 requested a full tablet report, sending...
I20260709 13:06:29.306674  7005 webserver.cc:533] Webserver started at http://127.6.215.66:34785/ using document root <none> and password file <none>
I20260709 13:06:29.307236  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.307471  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.307432 14476 ts_manager.cc:194] Registered new tserver with Master: 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:29.307946  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.309140  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "df879bc63e404e889fd4efcdc33281cd"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.309432 14476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57766
I20260709 13:06:29.314702  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:29.318476 14615 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.319330  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:06:29.319595  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "df879bc63e404e889fd4efcdc33281cd"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.319890  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.331099  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.332281  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.333982  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.336265  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.336445  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.336680  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.336822  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.381214  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:38167
I20260709 13:06:29.381407 14677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:38167 every 8 connection(s)
I20260709 13:06:29.386014  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.393303 14681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.394327 14682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.397748  7005 server_base.cc:1061] running on GCE node
W20260709 13:06:29.398053 14684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.399181  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.399415  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.399608  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602389399589 us; error 0 us; skew 500 ppm
I20260709 13:06:29.400283  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.400224 14678 heartbeater.cc:344] Connected to a master server at 127.6.215.126:37295
I20260709 13:06:29.400847 14678 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.401749 14678 heartbeater.cc:507] Master 127.6.215.126:37295 requested a full tablet report, sending...
I20260709 13:06:29.403038  7005 webserver.cc:533] Webserver started at http://127.6.215.67:42311/ using document root <none> and password file <none>
I20260709 13:06:29.403538  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.403757  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.404062  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.404270 14476 ts_manager.cc:194] Registered new tserver with Master: df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:29.405699  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "506ec781022645d4be0fcdf0bb76dd1a"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.406127 14476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57780
I20260709 13:06:29.410836  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:29.414538 14689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.415284  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:06:29.415580  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "506ec781022645d4be0fcdf0bb76dd1a"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.415827  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.452849  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.454100  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.455511  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.457608  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.457815  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.458027  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.458170  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.498277  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:36787
I20260709 13:06:29.498394 14751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:36787 every 8 connection(s)
I20260709 13:06:29.502913  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:29.510035 14755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:29.511567 14756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.514417  7005 server_base.cc:1061] running on GCE node
W20260709 13:06:29.514796 14758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:29.515739 14752 heartbeater.cc:344] Connected to a master server at 127.6.215.126:37295
I20260709 13:06:29.515863  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:29.516129  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:29.516259 14752 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.516294  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602389516278 us; error 0 us; skew 500 ppm
I20260709 13:06:29.517933 14752 heartbeater.cc:507] Master 127.6.215.126:37295 requested a full tablet report, sending...
I20260709 13:06:29.518014  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:29.520282 14476 ts_manager.cc:194] Registered new tserver with Master: 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:29.521534  7005 webserver.cc:533] Webserver started at http://127.6.215.68:41105/ using document root <none> and password file <none>
I20260709 13:06:29.522456  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:29.522818  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:29.522914 14476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57784
I20260709 13:06:29.523391  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:29.524729  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-3-root/instance:
uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.529142  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:29.532840 14763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.533740  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:29.534044  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-3-root
uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:29.534402  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:29.550108  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:29.551327  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:29.552769  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:29.555069  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:29.555281  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.555501  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:29.555649  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:29.600109  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.68:38771
I20260709 13:06:29.600267 14825 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.68:38771 every 8 connection(s)
I20260709 13:06:29.615067 14826 heartbeater.cc:344] Connected to a master server at 127.6.215.126:37295
I20260709 13:06:29.615522 14826 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:29.616328 14826 heartbeater.cc:507] Master 127.6.215.126:37295 requested a full tablet report, sending...
I20260709 13:06:29.618726 14476 ts_manager.cc:194] Registered new tserver with Master: d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:29.618937  7005 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015432845s
I20260709 13:06:29.620596 14476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57796
I20260709 13:06:29.644320 14476 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57804:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:06:29.896641 14568 tablet_service.cc:1511] Processing CreateTablet for tablet 31e27211ed824a3d8fd174e10c30a832 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:29.898211 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e27211ed824a3d8fd174e10c30a832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.901117 14791 tablet_service.cc:1511] Processing CreateTablet for tablet 31e27211ed824a3d8fd174e10c30a832 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:29.902541 14791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e27211ed824a3d8fd174e10c30a832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.913836 14567 tablet_service.cc:1511] Processing CreateTablet for tablet 40422e35fd4d4a068bc2d1ff1a9b70c3 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:29.915310 14567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40422e35fd4d4a068bc2d1ff1a9b70c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.922360 14643 tablet_service.cc:1511] Processing CreateTablet for tablet 40422e35fd4d4a068bc2d1ff1a9b70c3 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:29.922837 14642 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8104dc86ca4c3e84135792a5ac1769 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:29.923659 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40422e35fd4d4a068bc2d1ff1a9b70c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.925045 14790 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8104dc86ca4c3e84135792a5ac1769 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:29.926399 14790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8104dc86ca4c3e84135792a5ac1769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.929443 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 8911b4d6ee99489799d587b29247fe1c (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:29.930280 14566 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8104dc86ca4c3e84135792a5ac1769 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:29.930946 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8911b4d6ee99489799d587b29247fe1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.931327 14566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8104dc86ca4c3e84135792a5ac1769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.932885 14565 tablet_service.cc:1511] Processing CreateTablet for tablet eaa647d819f4427c8f1eecbe00003fa4 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:29.933074 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 8911b4d6ee99489799d587b29247fe1c (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:29.934631 14565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa647d819f4427c8f1eecbe00003fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.936501 14642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8104dc86ca4c3e84135792a5ac1769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.938859 14640 tablet_service.cc:1511] Processing CreateTablet for tablet eaa647d819f4427c8f1eecbe00003fa4 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:29.934566 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8911b4d6ee99489799d587b29247fe1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.941556 14564 tablet_service.cc:1511] Processing CreateTablet for tablet c1bac898ef214078a9abf3e595a27520 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:29.942889 14564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1bac898ef214078a9abf3e595a27520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.940243 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa647d819f4427c8f1eecbe00003fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.944164 14639 tablet_service.cc:1511] Processing CreateTablet for tablet c1bac898ef214078a9abf3e595a27520 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:29.946574 14787 tablet_service.cc:1511] Processing CreateTablet for tablet 23f507402c5f47dab63dc0d6cc423e45 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:29.948045 14787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f507402c5f47dab63dc0d6cc423e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.948714 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1bac898ef214078a9abf3e595a27520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.951104 14563 tablet_service.cc:1511] Processing CreateTablet for tablet 23f507402c5f47dab63dc0d6cc423e45 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:29.952486 14563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f507402c5f47dab63dc0d6cc423e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.954479 14638 tablet_service.cc:1511] Processing CreateTablet for tablet d27a48fa215640848445056cdc9dc61f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:29.957136 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27a48fa215640848445056cdc9dc61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.959223 14637 tablet_service.cc:1511] Processing CreateTablet for tablet 4b65e4261c474c129d623f3ba0ce2600 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:29.959546 14785 tablet_service.cc:1511] Processing CreateTablet for tablet dc4bcd1270a4459b8be8056af170226e (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:29.960554 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b65e4261c474c129d623f3ba0ce2600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.960894 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4bcd1270a4459b8be8056af170226e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.963438 14561 tablet_service.cc:1511] Processing CreateTablet for tablet dc4bcd1270a4459b8be8056af170226e (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:29.964743 14561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4bcd1270a4459b8be8056af170226e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.955760 14562 tablet_service.cc:1511] Processing CreateTablet for tablet 4b65e4261c474c129d623f3ba0ce2600 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:29.955760 14786 tablet_service.cc:1511] Processing CreateTablet for tablet d27a48fa215640848445056cdc9dc61f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:29.968047 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27a48fa215640848445056cdc9dc61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.968429 14560 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8a7d306e3949bbb6b1b8b5e4a53bf0 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:29.969381 14562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b65e4261c474c129d623f3ba0ce2600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.971309 14560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8a7d306e3949bbb6b1b8b5e4a53bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.975543 14784 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8a7d306e3949bbb6b1b8b5e4a53bf0 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:29.977893 14783 tablet_service.cc:1511] Processing CreateTablet for tablet f3a56c1b19f64f2a8eaff792c37d79b0 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:29.981329 14559 tablet_service.cc:1511] Processing CreateTablet for tablet 68f8f129f7da41399b8c4084d2514329 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:29.982749 14559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f8f129f7da41399b8c4084d2514329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.985684 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a56c1b19f64f2a8eaff792c37d79b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.987445 14784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8a7d306e3949bbb6b1b8b5e4a53bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.992570 14782 tablet_service.cc:1511] Processing CreateTablet for tablet 9633676643a14702b9f1cbf070a1e46d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:29.994382 14782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9633676643a14702b9f1cbf070a1e46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:29.940297 14788 tablet_service.cc:1511] Processing CreateTablet for tablet c1bac898ef214078a9abf3e595a27520 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:29.997010 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1bac898ef214078a9abf3e595a27520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.008704 14636 tablet_service.cc:1511] Processing CreateTablet for tablet f3a56c1b19f64f2a8eaff792c37d79b0 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:30.010357 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a56c1b19f64f2a8eaff792c37d79b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.017329 14635 tablet_service.cc:1511] Processing CreateTablet for tablet 68f8f129f7da41399b8c4084d2514329 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:30.018724 14635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f8f129f7da41399b8c4084d2514329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.020004 14714 tablet_service.cc:1511] Processing CreateTablet for tablet eaa647d819f4427c8f1eecbe00003fa4 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:30.020030 14716 tablet_service.cc:1511] Processing CreateTablet for tablet 40422e35fd4d4a068bc2d1ff1a9b70c3 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:30.021915 14715 tablet_service.cc:1511] Processing CreateTablet for tablet 8911b4d6ee99489799d587b29247fe1c (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:30.023578 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa647d819f4427c8f1eecbe00003fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.024207 14713 tablet_service.cc:1511] Processing CreateTablet for tablet 23f507402c5f47dab63dc0d6cc423e45 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:30.026618 14712 tablet_service.cc:1511] Processing CreateTablet for tablet d27a48fa215640848445056cdc9dc61f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:30.029321 14711 tablet_service.cc:1511] Processing CreateTablet for tablet 4b65e4261c474c129d623f3ba0ce2600 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:30.031077 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f507402c5f47dab63dc0d6cc423e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.036314 14640 tablet_service.cc:1511] Processing CreateTablet for tablet dc4bcd1270a4459b8be8056af170226e (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:30.036571 14710 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8a7d306e3949bbb6b1b8b5e4a53bf0 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:30.037792 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4bcd1270a4459b8be8056af170226e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.018846 14717 tablet_service.cc:1511] Processing CreateTablet for tablet 31e27211ed824a3d8fd174e10c30a832 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:30.042222 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27a48fa215640848445056cdc9dc61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.043469 14634 tablet_service.cc:1511] Processing CreateTablet for tablet 9633676643a14702b9f1cbf070a1e46d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:30.044754 14634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9633676643a14702b9f1cbf070a1e46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.053918 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b65e4261c474c129d623f3ba0ce2600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.058003 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8911b4d6ee99489799d587b29247fe1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.060909 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e27211ed824a3d8fd174e10c30a832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.061705 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40422e35fd4d4a068bc2d1ff1a9b70c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.062520 14710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8a7d306e3949bbb6b1b8b5e4a53bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.094971 14709 tablet_service.cc:1511] Processing CreateTablet for tablet f3a56c1b19f64f2a8eaff792c37d79b0 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:30.096421 14709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a56c1b19f64f2a8eaff792c37d79b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.098512 14708 tablet_service.cc:1511] Processing CreateTablet for tablet 68f8f129f7da41399b8c4084d2514329 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:30.101711 14708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f8f129f7da41399b8c4084d2514329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:30.109115 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:30.118975 14640 tablet_service.cc:1511] Processing CreateTablet for tablet 356bbe8ee6554693b1a545b2da7051c8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:30.142552 14568 tablet_service.cc:1511] Processing CreateTablet for tablet 9633676643a14702b9f1cbf070a1e46d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:30.143893 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9633676643a14702b9f1cbf070a1e46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.137256 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356bbe8ee6554693b1a545b2da7051c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.157650 14846 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:30.180281 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 12e17887ea2648f790f2eea586a10f68 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:30.191780 14712 tablet_service.cc:1511] Processing CreateTablet for tablet 12e17887ea2648f790f2eea586a10f68 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:30.196040 14638 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea3984c76074afa8be83ccbfc7d92fd (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:30.202493 14847 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:30.203300 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e17887ea2648f790f2eea586a10f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.206972 14846 tablet_bootstrap.cc:654] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.220880 14847 tablet_bootstrap.cc:654] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.216955 14709 tablet_service.cc:1511] Processing CreateTablet for tablet 963b71519e2643fb8a5312cb09636126 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:30.231007 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea3984c76074afa8be83ccbfc7d92fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.237769 14848 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:30.235301 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e17887ea2648f790f2eea586a10f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.257692 14709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963b71519e2643fb8a5312cb09636126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.254273 14784 tablet_service.cc:1511] Processing CreateTablet for tablet 963b71519e2643fb8a5312cb09636126 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:30.266573 14784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963b71519e2643fb8a5312cb09636126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.270414 14790 tablet_service.cc:1511] Processing CreateTablet for tablet d7a3f00eb3c740b0ad48a7844a8ad8e8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:30.271677 14790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a3f00eb3c740b0ad48a7844a8ad8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.273038 14848 tablet_bootstrap.cc:654] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.279341 14711 tablet_service.cc:1511] Processing CreateTablet for tablet fc9cb0b2e53c4638b38fef94ecff6df7 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:30.280818 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9cb0b2e53c4638b38fef94ecff6df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.234931 14714 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea3984c76074afa8be83ccbfc7d92fd (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:30.299281 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea3984c76074afa8be83ccbfc7d92fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.337941 14786 tablet_service.cc:1511] Processing CreateTablet for tablet 0db6fbac587a4051b87b0763a5cb6546 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:30.339323 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db6fbac587a4051b87b0763a5cb6546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.339880 14848 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:30.340395 14848 ts_tablet_manager.cc:1403] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.005s
I20260709 13:06:30.343483 14848 raft_consensus.cc:359] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:30.344157 14848 raft_consensus.cc:385] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.344447 14848 raft_consensus.cc:740] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.346813 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 356bbe8ee6554693b1a545b2da7051c8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:30.350626 14783 tablet_service.cc:1511] Processing CreateTablet for tablet c65b133e1b7b49e7aa040543173e9286 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:30.354105 14849 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:30.357879 14784 tablet_service.cc:1511] Processing CreateTablet for tablet 51da01c912804ff4ac1b26589077ae40 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:30.356732 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356bbe8ee6554693b1a545b2da7051c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.362903 14846 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:30.659088 14846 ts_tablet_manager.cc:1403] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.522s	user 0.015s	sys 0.009s
I20260709 13:06:30.658597 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b133e1b7b49e7aa040543173e9286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.372702 14849 tablet_bootstrap.cc:654] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.693627 14568 tablet_service.cc:1511] Processing CreateTablet for tablet 01b854989a274b4691e05ab9aa845495 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:30.361613 14847 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:30.408015 14559 tablet_service.cc:1511] Processing CreateTablet for tablet fc9cb0b2e53c4638b38fef94ecff6df7 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:30.454896 14561 tablet_service.cc:1511] Processing CreateTablet for tablet d7a3f00eb3c740b0ad48a7844a8ad8e8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:30.473625 14715 tablet_service.cc:1511] Processing CreateTablet for tablet 356bbe8ee6554693b1a545b2da7051c8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:30.484990 14567 tablet_service.cc:1511] Processing CreateTablet for tablet 0db6fbac587a4051b87b0763a5cb6546 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:30.695429 14847 ts_tablet_manager.cc:1403] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.493s	user 0.018s	sys 0.003s
I20260709 13:06:30.486783 14709 tablet_service.cc:1511] Processing CreateTablet for tablet 51da01c912804ff4ac1b26589077ae40 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:30.696451 14709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51da01c912804ff4ac1b26589077ae40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.243114 14564 tablet_service.cc:1511] Processing CreateTablet for tablet 12e17887ea2648f790f2eea586a10f68 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:30.519342 14785 tablet_service.cc:1511] Processing CreateTablet for tablet 3efb9d1bdbdc46ce96e07db0c6ffcf17 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:30.522029 14566 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea3984c76074afa8be83ccbfc7d92fd (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:30.529865 14562 tablet_service.cc:1511] Processing CreateTablet for tablet c65b133e1b7b49e7aa040543173e9286 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:30.537611 14678 heartbeater.cc:499] Master 127.6.215.126:37295 was elected leader, sending a full tablet report...
I20260709 13:06:30.539016 14848 consensus_queue.cc:260] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:30.702612 14783 tablet_service.cc:1511] Processing CreateTablet for tablet db5fb9d53fa74b5ba11f946ac902a5f2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:30.701165 14847 raft_consensus.cc:359] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.563006 14634 tablet_service.cc:1511] Processing CreateTablet for tablet 963b71519e2643fb8a5312cb09636126 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:30.564321 14635 tablet_service.cc:1511] Processing CreateTablet for tablet fc9cb0b2e53c4638b38fef94ecff6df7 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:30.704562 14847 raft_consensus.cc:385] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.705013 14847 raft_consensus.cc:740] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.564988 14790 tablet_service.cc:1511] Processing CreateTablet for tablet 01b854989a274b4691e05ab9aa845495 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:30.705567 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356bbe8ee6554693b1a545b2da7051c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.566082 14636 tablet_service.cc:1511] Processing CreateTablet for tablet c65b133e1b7b49e7aa040543173e9286 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:30.566392 14642 tablet_service.cc:1511] Processing CreateTablet for tablet d7a3f00eb3c740b0ad48a7844a8ad8e8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:30.567389 14643 tablet_service.cc:1511] Processing CreateTablet for tablet 3efb9d1bdbdc46ce96e07db0c6ffcf17 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:30.705229 14635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9cb0b2e53c4638b38fef94ecff6df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.573745 14603 heartbeater.cc:499] Master 127.6.215.126:37295 was elected leader, sending a full tablet report...
I20260709 13:06:30.706461 14560 tablet_service.cc:1511] Processing CreateTablet for tablet b3c58429a8964ea4bc7fe0ae68093fde (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:30.706014 14847 consensus_queue.cc:260] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.575500 14710 tablet_service.cc:1511] Processing CreateTablet for tablet 3efb9d1bdbdc46ce96e07db0c6ffcf17 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:30.578625 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 902ea702a7c34a36a5c2ab940c67baee (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:30.588701 14786 tablet_service.cc:1511] Processing CreateTablet for tablet b3c58429a8964ea4bc7fe0ae68093fde (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:30.598265 14788 tablet_service.cc:1511] Processing CreateTablet for tablet bd33d2753c08470f9b9b1d7145f75b16 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:30.604750 14712 tablet_service.cc:1511] Processing CreateTablet for tablet 902ea702a7c34a36a5c2ab940c67baee (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:30.608565 14716 tablet_service.cc:1511] Processing CreateTablet for tablet 0db6fbac587a4051b87b0763a5cb6546 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:30.623935 14826 heartbeater.cc:499] Master 127.6.215.126:37295 was elected leader, sending a full tablet report...
I20260709 13:06:30.727317 14710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efb9d1bdbdc46ce96e07db0c6ffcf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.633668 14714 tablet_service.cc:1511] Processing CreateTablet for tablet b3c58429a8964ea4bc7fe0ae68093fde (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:30.728434 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c58429a8964ea4bc7fe0ae68093fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.731009 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902ea702a7c34a36a5c2ab940c67baee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.733675 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db6fbac587a4051b87b0763a5cb6546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.634101 14752 heartbeater.cc:499] Master 127.6.215.126:37295 was elected leader, sending a full tablet report...
I20260709 13:06:30.639153 14640 tablet_service.cc:1511] Processing CreateTablet for tablet 01b854989a274b4691e05ab9aa845495 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:30.640791 14782 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea0a87730ae48b398447afece8bcc4e (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:30.644735 14708 tablet_service.cc:1511] Processing CreateTablet for tablet bd33d2753c08470f9b9b1d7145f75b16 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:30.739616 14708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd33d2753c08470f9b9b1d7145f75b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.645987 14711 tablet_service.cc:1511] Processing CreateTablet for tablet a87d627f14ee4f22a43a3b0d36455e24 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:30.742027 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d627f14ee4f22a43a3b0d36455e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.662539 14784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51da01c912804ff4ac1b26589077ae40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:30.662683 14639 consensus_meta.cc:287] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.005s
I20260709 13:06:30.743716 14790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b854989a274b4691e05ab9aa845495. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:30.664335 14637 consensus_meta.cc:287] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.004s
I20260709 13:06:30.666437 14787 tablet_service.cc:1511] Processing CreateTablet for tablet 7024877fba144524a8e2d1e04cb420d7 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:30.670188 14791 tablet_service.cc:1511] Processing CreateTablet for tablet 5d41095708f541448eba428743f63659 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:30.678742 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 959e66f7e7ea4430b66b08c75d3f8a3d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:30.681027 14717 tablet_service.cc:1511] Processing CreateTablet for tablet 7024877fba144524a8e2d1e04cb420d7 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:30.681612 14846 raft_consensus.cc:359] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.679251 14565 tablet_service.cc:1511] Processing CreateTablet for tablet 902ea702a7c34a36a5c2ab940c67baee (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:30.686515 14713 tablet_service.cc:1511] Processing CreateTablet for tablet 5d41095708f541448eba428743f63659 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:30.745426 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd33d2753c08470f9b9b1d7145f75b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.745306 14639 tablet_service.cc:1511] Processing CreateTablet for tablet bd33d2753c08470f9b9b1d7145f75b16 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:30.751044 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c58429a8964ea4bc7fe0ae68093fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.704349 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b854989a274b4691e05ab9aa845495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.751695 14782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea0a87730ae48b398447afece8bcc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.751883 14565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902ea702a7c34a36a5c2ab940c67baee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.708606 14634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963b71519e2643fb8a5312cb09636126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.752305 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efb9d1bdbdc46ce96e07db0c6ffcf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.556685 14563 tablet_service.cc:1511] Processing CreateTablet for tablet 51da01c912804ff4ac1b26589077ae40 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:30.753837 14561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a3f00eb3c740b0ad48a7844a8ad8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.747280 14637 tablet_service.cc:1511] Processing CreateTablet for tablet a87d627f14ee4f22a43a3b0d36455e24 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:30.754946 14787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7024877fba144524a8e2d1e04cb420d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.749364 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7024877fba144524a8e2d1e04cb420d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.755699 14791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d41095708f541448eba428743f63659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.756528 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d41095708f541448eba428743f63659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.749526 14846 raft_consensus.cc:385] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.757520 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959e66f7e7ea4430b66b08c75d3f8a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.757886 14846 raft_consensus.cc:740] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.754467 14566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea3984c76074afa8be83ccbfc7d92fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.758687 14846 consensus_queue.cc:260] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.759783 14560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c58429a8964ea4bc7fe0ae68093fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.760078 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efb9d1bdbdc46ce96e07db0c6ffcf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.760406 14563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51da01c912804ff4ac1b26589077ae40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.761627 14559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9cb0b2e53c4638b38fef94ecff6df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.762645 14642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a3f00eb3c740b0ad48a7844a8ad8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.763310 14564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e17887ea2648f790f2eea586a10f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.765621 14567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db6fbac587a4051b87b0763a5cb6546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.766860 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902ea702a7c34a36a5c2ab940c67baee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.768604 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b854989a274b4691e05ab9aa845495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.769758 14562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b133e1b7b49e7aa040543173e9286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.770042 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b133e1b7b49e7aa040543173e9286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.774310 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5fb9d53fa74b5ba11f946ac902a5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.776901 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d627f14ee4f22a43a3b0d36455e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.781661 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd33d2753c08470f9b9b1d7145f75b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.836328 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 345f32f81f7a4bd8af4458f831f49e96 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:30.839257 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 5d41095708f541448eba428743f63659 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:30.842818 14783 tablet_service.cc:1511] Processing CreateTablet for tablet 2075e17bd50a4018aca3418b80b18311 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:30.844126 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2075e17bd50a4018aca3418b80b18311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.851949 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345f32f81f7a4bd8af4458f831f49e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.866122 14638 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea0a87730ae48b398447afece8bcc4e (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:30.893644 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d41095708f541448eba428743f63659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.902161 14711 tablet_service.cc:1511] Processing CreateTablet for tablet caaad462138b4b2894c6c92ec9403e0d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:30.903466 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaad462138b4b2894c6c92ec9403e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.903158 14561 tablet_service.cc:1511] Processing CreateTablet for tablet a87d627f14ee4f22a43a3b0d36455e24 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:30.904345 14561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d627f14ee4f22a43a3b0d36455e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.919624 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea0a87730ae48b398447afece8bcc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.922115 14849 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:30.922639 14849 ts_tablet_manager.cc:1403] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.569s	user 0.009s	sys 0.008s
I20260709 13:06:30.930250 14709 tablet_service.cc:1511] Processing CreateTablet for tablet db5fb9d53fa74b5ba11f946ac902a5f2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:30.931640 14709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5fb9d53fa74b5ba11f946ac902a5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.933745 14791 tablet_service.cc:1511] Processing CreateTablet for tablet 7702fc54076c4ee586ef69972a9449b5 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:30.956439 14791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7702fc54076c4ee586ef69972a9449b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.958367 14566 tablet_service.cc:1511] Processing CreateTablet for tablet 7024877fba144524a8e2d1e04cb420d7 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:30.959600 14566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7024877fba144524a8e2d1e04cb420d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.936968 14643 tablet_service.cc:1511] Processing CreateTablet for tablet 959e66f7e7ea4430b66b08c75d3f8a3d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:30.964676 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959e66f7e7ea4430b66b08c75d3f8a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.965909 14854 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.966464 14854 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:30.967221 14849 raft_consensus.cc:359] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.968240 14849 raft_consensus.cc:385] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.968549 14849 raft_consensus.cc:740] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.969303 14849 consensus_queue.cc:260] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.935379 14568 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea0a87730ae48b398447afece8bcc4e (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:30.944041 14785 tablet_service.cc:1511] Processing CreateTablet for tablet ceebbbc7cabf4ee4a60995c283eb7c47 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:30.949793 14856 raft_consensus.cc:493] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.952432 14635 tablet_service.cc:1511] Processing CreateTablet for tablet 345f32f81f7a4bd8af4458f831f49e96 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:30.954370 14717 tablet_service.cc:1511] Processing CreateTablet for tablet 345f32f81f7a4bd8af4458f831f49e96 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:30.931317 14634 tablet_service.cc:1511] Processing CreateTablet for tablet caaad462138b4b2894c6c92ec9403e0d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:30.978400 14634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaad462138b4b2894c6c92ec9403e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.979696 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345f32f81f7a4bd8af4458f831f49e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.976020 14856 raft_consensus.cc:515] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:30.986349 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff5557a61fd4c41885144bd05bc9bb8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:30.987852 14856 leader_election.cc:290] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:31.008255 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff5557a61fd4c41885144bd05bc9bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.020445 14564 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 11) took 1031 ms. Trace:
I20260709 13:06:31.022658 14564 rpcz_store.cc:276] 0709 13:06:29.988012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.241094 (+253082us) service_pool.cc:224] Handling call
0709 13:06:30.730039 (+488945us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:30.730131 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:30.926543 (+196412us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:30.970921 (+ 44378us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.018947 (+ 48026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 13:06:31.023600 14563 tablet_service.cc:1511] Processing CreateTablet for tablet 959e66f7e7ea4430b66b08c75d3f8a3d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:31.024962 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea0a87730ae48b398447afece8bcc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.024672 14564 tablet_service.cc:1511] Processing CreateTablet for tablet db5fb9d53fa74b5ba11f946ac902a5f2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:31.005708 14854 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:30.973564 14708 tablet_service.cc:1511] Processing CreateTablet for tablet 93517bd81c4746cd9280a1658d50fe99 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:30.985217 14636 tablet_service.cc:1511] Processing CreateTablet for tablet 93517bd81c4746cd9280a1658d50fe99 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:31.027441 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceebbbc7cabf4ee4a60995c283eb7c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.028695 14635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345f32f81f7a4bd8af4458f831f49e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.042309 14564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5fb9d53fa74b5ba11f946ac902a5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.047489 14849 ts_tablet_manager.cc:1434] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.125s	user 0.018s	sys 0.012s
I20260709 13:06:31.049132 14848 ts_tablet_manager.cc:1434] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.708s	user 0.023s	sys 0.036s
W20260709 13:06:31.049677 14848 ts_tablet_manager.cc:1467] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: Tablet startup took 708ms
I20260709 13:06:31.050578 14782 tablet_service.cc:1511] Processing CreateTablet for tablet 2666ab9efa994f198f2fb2f02c70df8f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:31.051421 14559 tablet_service.cc:1511] Processing CreateTablet for tablet caaad462138b4b2894c6c92ec9403e0d (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:31.052265 14714 tablet_service.cc:1511] Processing CreateTablet for tablet 7702fc54076c4ee586ef69972a9449b5 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:31.053015 14559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaad462138b4b2894c6c92ec9403e0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.062911 14604 tablet.cc:2406] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:31.063517 14565 tablet_service.cc:1511] Processing CreateTablet for tablet 93517bd81c4746cd9280a1658d50fe99 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:31.068015 14567 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 14) took 1076 ms. Trace:
I20260709 13:06:31.074461 14849 tablet_bootstrap.cc:492] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:31.075591 14562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 16) took 1005 ms. Trace:
I20260709 13:06:31.064080 14782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2666ab9efa994f198f2fb2f02c70df8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.080065 14716 tablet_service.cc:1511] Processing CreateTablet for tablet ceebbbc7cabf4ee4a60995c283eb7c47 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:31.081609 14712 tablet_service.cc:1511] Processing CreateTablet for tablet 6652116aaa1648d2bc0a4cd9b44ade8f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:31.082562 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceebbbc7cabf4ee4a60995c283eb7c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.084167 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93517bd81c4746cd9280a1658d50fe99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.087682 14560 tablet_service.cc:1511] Processing CreateTablet for tablet 2075e17bd50a4018aca3418b80b18311 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:31.088475 14783 tablet_service.cc:1511] Processing CreateTablet for tablet 3789330431ce4e7ea306d15229f2efe2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:31.089006 14560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2075e17bd50a4018aca3418b80b18311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.088759 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6652116aaa1648d2bc0a4cd9b44ade8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.094566 14784 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39692 (request call id 16) took 1019 ms. Trace:
I20260709 13:06:31.094429 14715 tablet_service.cc:1511] Processing CreateTablet for tablet 2666ab9efa994f198f2fb2f02c70df8f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:31.095034 14784 rpcz_store.cc:276] 0709 13:06:30.075340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.356937 (+281597us) service_pool.cc:224] Handling call
0709 13:06:30.654286 (+297349us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:30.654385 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:30.821220 (+166835us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.093888 (+272668us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.094503 (+   615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.064710 14847 ts_tablet_manager.cc:1434] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.369s	user 0.002s	sys 0.016s
I20260709 13:06:31.096408 14634 tablet_service.cc:1511] Processing CreateTablet for tablet 2075e17bd50a4018aca3418b80b18311 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:31.103001 14846 ts_tablet_manager.cc:1434] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.444s	user 0.014s	sys 0.008s
I20260709 13:06:31.115015 14708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93517bd81c4746cd9280a1658d50fe99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.116726 14563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959e66f7e7ea4430b66b08c75d3f8a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.116920 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7702fc54076c4ee586ef69972a9449b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.104017 14710 tablet_service.cc:1511] Processing CreateTablet for tablet 182e9237880d46949460b001423a61ab (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:31.104640 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3789330431ce4e7ea306d15229f2efe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.104950 14642 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45514 (request call id 13) took 1058 ms. Trace:
I20260709 13:06:31.105538 14713 tablet_service.cc:1511] Processing CreateTablet for tablet 01b97cf3540541f984f1edaa8b7e2246 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:31.106243 14639 tablet_service.cc:1511] Processing CreateTablet for tablet ceebbbc7cabf4ee4a60995c283eb7c47 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:31.110450 14787 tablet_service.cc:1511] Processing CreateTablet for tablet 86c1574eeecf47e1b9d43861c4145347 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:31.119074 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2666ab9efa994f198f2fb2f02c70df8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.127089 14634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2075e17bd50a4018aca3418b80b18311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.134727 14847 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:31.136857 14855 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.137619 14855 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.137864 14638 tablet_service.cc:1511] Processing CreateTablet for tablet 6652116aaa1648d2bc0a4cd9b44ade8f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:31.140164 14855 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
W20260709 13:06:31.049986 14848 ts_tablet_manager.cc:1469] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: Trace:
0709 13:06:29.973689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.974442 (+   753us) service_pool.cc:224] Handling call
0709 13:06:29.976509 (+  2067us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:29.976594 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:30.106481 (+129887us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:30.112819 (+  6338us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:30.230185 (+117366us) inbound_call.cc:177] Queueing success response
0709 13:06:30.237164 (+  6979us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:30.340711 (+103547us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:30.341277 (+   566us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:30.341902 (+   625us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":262599,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"tablet-open.queue_time_us":123956,"thread_start_us":303293,"threads_started":2}
I20260709 13:06:31.141561 14849 tablet_bootstrap.cc:654] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:31.156747 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:31.158010 14787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c1574eeecf47e1b9d43861c4145347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.161137 14637 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff5557a61fd4c41885144bd05bc9bb8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:31.163064 14710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182e9237880d46949460b001423a61ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.123793 14642 rpcz_store.cc:276] 0709 13:06:30.046413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.565275 (+518862us) service_pool.cc:224] Handling call
0709 13:06:30.707364 (+142089us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:30.707490 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:30.886462 (+178972us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.104476 (+218014us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.104896 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.168320 14566 tablet_service.cc:1511] Processing CreateTablet for tablet 6652116aaa1648d2bc0a4cd9b44ade8f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:31.068392 14567 rpcz_store.cc:276] 0709 13:06:29.991602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.483910 (+492308us) service_pool.cc:224] Handling call
0709 13:06:30.714130 (+230220us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:30.715059 (+   929us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:30.873192 (+158133us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.067558 (+194366us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.067956 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.169086 14642 tablet_service.cc:1511] Processing CreateTablet for tablet 182e9237880d46949460b001423a61ab (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:31.170504 14567 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff5557a61fd4c41885144bd05bc9bb8 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:31.102249 14788 tablet_service.cc:1511] Processing CreateTablet for tablet 182e9237880d46949460b001423a61ab (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:31.172268 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceebbbc7cabf4ee4a60995c283eb7c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.173633 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:31.175114 14565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93517bd81c4746cd9280a1658d50fe99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.175702 14767 leader_election.cc:343] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.164079 14711 tablet_service.cc:1511] Processing CreateTablet for tablet 86c1574eeecf47e1b9d43861c4145347 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:31.182140 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c1574eeecf47e1b9d43861c4145347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.181981 14784 tablet_service.cc:1511] Processing CreateTablet for tablet 3724176103ea41e8bc3897d78affc140 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:31.139827 14786 tablet_service.cc:1511] Processing CreateTablet for tablet 83dfc715d1a74a2e9398771912873ead (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:31.184450 14640 tablet_service.cc:1511] Processing CreateTablet for tablet 01b97cf3540541f984f1edaa8b7e2246 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:31.075995 14562 rpcz_store.cc:276] 0709 13:06:30.070569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.528954 (+458385us) service_pool.cc:224] Handling call
0709 13:06:30.706503 (+177549us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:30.706594 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:30.966498 (+259904us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.075122 (+108624us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.075533 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.187002 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b97cf3540541f984f1edaa8b7e2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.187445 14562 tablet_service.cc:1511] Processing CreateTablet for tablet 2666ab9efa994f198f2fb2f02c70df8f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:31.193691 14561 tablet_service.cc:1511] Processing CreateTablet for tablet 7702fc54076c4ee586ef69972a9449b5 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:31.195034 14846 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:31.198202 14848 tablet_bootstrap.cc:492] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.203133 14784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3724176103ea41e8bc3897d78affc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.194693 14717 tablet_service.cc:1511] Processing CreateTablet for tablet 3724176103ea41e8bc3897d78affc140 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:31.219871 14641 tablet_service.cc:1511] Processing CreateTablet for tablet 3789330431ce4e7ea306d15229f2efe2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:31.221390 14846 tablet_bootstrap.cc:654] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.189291 14562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2666ab9efa994f198f2fb2f02c70df8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.221235 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3789330431ce4e7ea306d15229f2efe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.230028 14859 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.236022 14859 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.236025 14786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dfc715d1a74a2e9398771912873ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.236065 14847 tablet_bootstrap.cc:654] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.248543 14859 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:31.237609 14791 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6d2fcb98dd448f83c04cf7b41c0d4a (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:31.262575 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182e9237880d46949460b001423a61ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.262635 14717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3724176103ea41e8bc3897d78affc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.263772 14642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182e9237880d46949460b001423a61ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.307307 14638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6652116aaa1648d2bc0a4cd9b44ade8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.307770 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:31.270450 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:31.309299 14619 leader_election.cc:343] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.265105 14567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff5557a61fd4c41885144bd05bc9bb8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.309969 14617 leader_election.cc:343] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.310379 14617 leader_election.cc:304] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:31.311291 14858 raft_consensus.cc:2749] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.276523 14564 tablet_service.cc:1511] Processing CreateTablet for tablet 01b97cf3540541f984f1edaa8b7e2246 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:31.279081 14848 tablet_bootstrap.cc:654] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.309607 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff5557a61fd4c41885144bd05bc9bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.310940 14712 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea40529e58642ecad3ba57398343c6f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:31.333338 14716 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6d2fcb98dd448f83c04cf7b41c0d4a (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:31.334652 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6d2fcb98dd448f83c04cf7b41c0d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.330729 14566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6652116aaa1648d2bc0a4cd9b44ade8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.343026 14791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6d2fcb98dd448f83c04cf7b41c0d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.342585 14640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b97cf3540541f984f1edaa8b7e2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.350696 14712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea40529e58642ecad3ba57398343c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.355028 14636 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea40529e58642ecad3ba57398343c6f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:31.362811 14711 tablet_service.cc:1511] Processing CreateTablet for tablet 6148470389e947ffad07416847abd3ba (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:31.364167 14711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6148470389e947ffad07416847abd3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.365536 14639 tablet_service.cc:1511] Processing CreateTablet for tablet 3724176103ea41e8bc3897d78affc140 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:31.367578 14710 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff0cde640b64fd6b574f51fc2c50a62 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:31.368968 14710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff0cde640b64fd6b574f51fc2c50a62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.375808 14599 debug-util.cc:398] Leaking SignalData structure 0x7b0800084fc0 after lost signal to thread 7008
W20260709 13:06:31.376933 14599 debug-util.cc:398] Leaking SignalData structure 0x7b080013f2e0 after lost signal to thread 14510
I20260709 13:06:31.380072 14559 tablet_service.cc:1511] Processing CreateTablet for tablet 86c1574eeecf47e1b9d43861c4145347 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:31.312762 14783 tablet_service.cc:1511] Processing CreateTablet for tablet 6148470389e947ffad07416847abd3ba (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:31.382823 14783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6148470389e947ffad07416847abd3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.390771 14714 tablet_service.cc:1511] Processing CreateTablet for tablet dbe49d815dee48d3b45b9c3275a9aba5 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:31.392103 14714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe49d815dee48d3b45b9c3275a9aba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.395205 14636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea40529e58642ecad3ba57398343c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.397738 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3724176103ea41e8bc3897d78affc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.399734 14785 tablet_service.cc:1511] Processing CreateTablet for tablet bf7b96dec18f42cd9f7cd905861e7ae2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:31.401003 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf7b96dec18f42cd9f7cd905861e7ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.410005 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:31.413985 14782 tablet_service.cc:1511] Processing CreateTablet for tablet dbe49d815dee48d3b45b9c3275a9aba5 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:31.415589 14782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe49d815dee48d3b45b9c3275a9aba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.428138 14713 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd2e1bed5724ce8ab462353f3f71b46 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:31.433595 14713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd2e1bed5724ce8ab462353f3f71b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.431818 14643 tablet_service.cc:1511] Processing CreateTablet for tablet 83dfc715d1a74a2e9398771912873ead (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:31.434690 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dfc715d1a74a2e9398771912873ead. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.446964 14765 leader_election.cc:343] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.447434 14765 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:31.449695 14854 raft_consensus.cc:2749] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.450534 14789 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd2e1bed5724ce8ab462353f3f71b46 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:31.451761 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd2e1bed5724ce8ab462353f3f71b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.452072 14846 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:31.451949 14788 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef572ce75064396b97d4704e5f93335 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:31.452634 14846 ts_tablet_manager.cc:1403] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.307s	user 0.018s	sys 0.004s
I20260709 13:06:31.453100 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef572ce75064396b97d4704e5f93335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.454613 14790 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39692 (request call id 18) took 1232 ms. Trace:
I20260709 13:06:31.446061 14561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7702fc54076c4ee586ef69972a9449b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.455073 14790 rpcz_store.cc:276] 0709 13:06:30.222234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.564411 (+342177us) service_pool.cc:224] Handling call
0709 13:06:30.705704 (+141293us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:30.705796 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.186130 (+480334us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.411420 (+225290us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.454549 (+ 43129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10497}
I20260709 13:06:31.463832 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:31.464704 14565 tablet_service.cc:1511] Processing CreateTablet for tablet 83dfc715d1a74a2e9398771912873ead (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:31.470350 14790 tablet_service.cc:1511] Processing CreateTablet for tablet fc0aecc60f134c1188c9339ac259486f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:31.471608 14790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0aecc60f134c1188c9339ac259486f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.473814 14846 raft_consensus.cc:359] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.474534 14846 raft_consensus.cc:385] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.474913 14846 raft_consensus.cc:740] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.475754 14846 consensus_queue.cc:260] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.477798 14708 tablet_service.cc:1511] Processing CreateTablet for tablet fc0aecc60f134c1188c9339ac259486f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:31.479029 14708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0aecc60f134c1188c9339ac259486f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.481721 14637 tablet_service.cc:1511] Processing CreateTablet for tablet 6148470389e947ffad07416847abd3ba (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:31.447417 14715 tablet_service.cc:1511] Processing CreateTablet for tablet d147ffb9b1ba41d985cbae2564f1148c (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:06:31.488508 14543 leader_election.cc:343] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.443339 14568 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea40529e58642ecad3ba57398343c6f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:31.488706 14559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c1574eeecf47e1b9d43861c4145347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.490054 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea40529e58642ecad3ba57398343c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.493465 14637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6148470389e947ffad07416847abd3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.497431 14564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b97cf3540541f984f1edaa8b7e2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.499200 14635 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff0cde640b64fd6b574f51fc2c50a62 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:31.500375 14635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff0cde640b64fd6b574f51fc2c50a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.502447 14849 tablet_bootstrap.cc:492] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:31.502969 14849 ts_tablet_manager.cc:1403] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.429s	user 0.013s	sys 0.009s
I20260709 13:06:31.503170 14563 tablet_service.cc:1511] Processing CreateTablet for tablet 3789330431ce4e7ea306d15229f2efe2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:31.504349 14563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3789330431ce4e7ea306d15229f2efe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.477758 14846 ts_tablet_manager.cc:1434] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:06:31.511264 14846 tablet_bootstrap.cc:492] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:31.511677 14641 tablet_service.cc:1511] Processing CreateTablet for tablet bf7b96dec18f42cd9f7cd905861e7ae2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:31.518101 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf7b96dec18f42cd9f7cd905861e7ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.521675 14715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d147ffb9b1ba41d985cbae2564f1148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.476334 14567 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6d2fcb98dd448f83c04cf7b41c0d4a (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:31.526135 14567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6d2fcb98dd448f83c04cf7b41c0d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.535662 14634 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd2e1bed5724ce8ab462353f3f71b46 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:31.539211 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:31.540957 14848 tablet_bootstrap.cc:492] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:31.541496 14848 ts_tablet_manager.cc:1403] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.343s	user 0.055s	sys 0.057s
I20260709 13:06:31.543785 14639 tablet_service.cc:1511] Processing CreateTablet for tablet d147ffb9b1ba41d985cbae2564f1148c (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:31.544456 14848 raft_consensus.cc:359] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.553699 14847 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:31.554288 14847 ts_tablet_manager.cc:1403] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.420s	user 0.013s	sys 0.018s
I20260709 13:06:31.561420 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d147ffb9b1ba41d985cbae2564f1148c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.563433 14544 leader_election.cc:343] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.586249 14544 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:31.587042 14855 raft_consensus.cc:2749] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.545167 14848 raft_consensus.cc:385] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.563550 14565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dfc715d1a74a2e9398771912873ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.587611 14848 raft_consensus.cc:740] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.588547 14848 consensus_queue.cc:260] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.593289 14848 ts_tablet_manager.cc:1434] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:06:31.597442 14848 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.579373 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:31.598927 14690 leader_election.cc:343] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.599781 14562 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff0cde640b64fd6b574f51fc2c50a62 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:31.605321 14562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff0cde640b64fd6b574f51fc2c50a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.581810 14846 tablet_bootstrap.cc:654] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.570819 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:31.593688 14634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd2e1bed5724ce8ab462353f3f71b46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:31.611048 14691 leader_election.cc:343] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.611527 14691 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:31.612222 14859 raft_consensus.cc:2749] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.575811 14642 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef572ce75064396b97d4704e5f93335 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:31.577936 14849 raft_consensus.cc:359] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.613458 14849 raft_consensus.cc:385] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.613816 14849 raft_consensus.cc:740] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.614708 14849 consensus_queue.cc:260] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.617054 14849 ts_tablet_manager.cc:1434] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.114s	user 0.002s	sys 0.005s
I20260709 13:06:31.613926 14642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef572ce75064396b97d4704e5f93335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.620853 14564 tablet_service.cc:1511] Processing CreateTablet for tablet bf7b96dec18f42cd9f7cd905861e7ae2 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:31.622121 14564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf7b96dec18f42cd9f7cd905861e7ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.557201 14847 raft_consensus.cc:359] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.625304 14847 raft_consensus.cc:385] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.620083 14567 tablet_service.cc:1511] Processing CreateTablet for tablet dbe49d815dee48d3b45b9c3275a9aba5 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:31.626459 14567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe49d815dee48d3b45b9c3275a9aba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.635289 14849 tablet_bootstrap.cc:492] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:31.638638 14568 tablet_service.cc:1511] Processing CreateTablet for tablet d147ffb9b1ba41d985cbae2564f1148c (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:31.641160 14560 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 28) took 1016 ms. Trace:
I20260709 13:06:31.643034 14848 tablet_bootstrap.cc:654] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.658114 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d147ffb9b1ba41d985cbae2564f1148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.625689 14847 raft_consensus.cc:740] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.660480 14847 consensus_queue.cc:260] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.662541 14847 ts_tablet_manager.cc:1434] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.000s
I20260709 13:06:31.656679 14560 rpcz_store.cc:276] 0709 13:06:30.625156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.086763 (+461607us) service_pool.cc:224] Handling call
0709 13:06:31.088532 (+  1769us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.088630 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.569516 (+480886us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.640702 (+ 71186us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.641108 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.644771 14849 tablet_bootstrap.cc:654] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.646934 14561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 29) took 1017 ms. Trace:
I20260709 13:06:31.664696 14561 rpcz_store.cc:276] 0709 13:06:30.629404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.164744 (+535340us) service_pool.cc:224] Handling call
0709 13:06:31.194642 (+ 29898us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.194732 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.590953 (+396221us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.646297 (+ 55344us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.646805 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.666392 14847 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:31.647341 14846 tablet_bootstrap.cc:492] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:31.650461 14565 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef572ce75064396b97d4704e5f93335 (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:31.675457 14565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef572ce75064396b97d4704e5f93335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.674876 14847 tablet_bootstrap.cc:654] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.684890 14559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 35) took 1023 ms. Trace:
I20260709 13:06:31.685563 14846 ts_tablet_manager.cc:1403] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.174s	user 0.011s	sys 0.000s
I20260709 13:06:31.687036 14848 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:31.687639 14848 ts_tablet_manager.cc:1403] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.000s
I20260709 13:06:31.691002 14848 raft_consensus.cc:359] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.691686 14848 raft_consensus.cc:385] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.692080 14848 raft_consensus.cc:740] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.685317 14559 rpcz_store.cc:276] 0709 13:06:30.661939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.379193 (+717254us) service_pool.cc:224] Handling call
0709 13:06:31.380895 (+  1702us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.380984 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.590538 (+209554us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.684424 (+ 93886us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.684831 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.691591 14847 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:31.694715 14563 tablet_service.cc:1511] Processing CreateTablet for tablet fc0aecc60f134c1188c9339ac259486f (DEFAULT_TABLE table=test-workload [id=68be0894275b413ea2ca4c5088b65d1b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:31.695323 14847 ts_tablet_manager.cc:1403] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.002s
I20260709 13:06:31.694154 14566 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 30) took 1060 ms. Trace:
I20260709 13:06:31.694341 14846 raft_consensus.cc:359] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.698019 14846 raft_consensus.cc:385] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.698323 14846 raft_consensus.cc:740] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.699215 14846 consensus_queue.cc:260] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.701632 14846 ts_tablet_manager.cc:1434] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:06:31.702952 14847 raft_consensus.cc:359] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.703668 14847 raft_consensus.cc:385] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.703953 14847 raft_consensus.cc:740] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.704650 14847 consensus_queue.cc:260] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.705605 14848 consensus_queue.cc:260] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.706687 14635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45514 (request call id 39) took 1009 ms. Trace:
I20260709 13:06:31.708074 14563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0aecc60f134c1188c9339ac259486f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.708294 14848 ts_tablet_manager.cc:1434] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:06:31.709309 14848 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.707074 14635 rpcz_store.cc:276] 0709 13:06:30.684234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.498280 (+814046us) service_pool.cc:224] Handling call
0709 13:06:31.499952 (+  1672us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.500047 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.621161 (+121114us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.692994 (+ 71833us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.693458 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.716068 14562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 39) took 1031 ms. Trace:
I20260709 13:06:31.716629 14562 rpcz_store.cc:276] 0709 13:06:30.684752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.568747 (+883995us) service_pool.cc:224] Handling call
0709 13:06:31.604878 (+ 36131us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.604987 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.660339 (+ 55352us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.713395 (+ 53056us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.716007 (+  2612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.716064 14848 tablet_bootstrap.cc:654] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.718600 14858 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.719077 14858 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.723222 14858 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:31.724715 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:31.726146 14617 leader_election.cc:343] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.732369 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:31.733973 14618 leader_election.cc:343] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.734431 14618 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:31.735752 14858 raft_consensus.cc:2749] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.735679 14568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51484 (request call id 42) took 1033 ms. Trace:
I20260709 13:06:31.736439 14568 rpcz_store.cc:276] 0709 13:06:30.701967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.637798 (+935831us) service_pool.cc:224] Handling call
0709 13:06:31.657661 (+ 19863us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.657763 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.710986 (+ 53223us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.735165 (+ 24179us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.735618 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.705421 14566 rpcz_store.cc:276] 0709 13:06:30.634092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.167480 (+533388us) service_pool.cc:224] Handling call
0709 13:06:31.169173 (+  1693us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.169273 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.630855 (+461582us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.693667 (+ 62812us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.694099 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.743435 14849 tablet_bootstrap.cc:492] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:31.743943 14849 ts_tablet_manager.cc:1403] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.008s
I20260709 13:06:31.744460 14847 ts_tablet_manager.cc:1434] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:06:31.745604 14847 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:31.746997 14849 raft_consensus.cc:359] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.747352 14639 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45514 (request call id 42) took 1043 ms. Trace:
I20260709 13:06:31.747488 14846 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:31.748253 14848 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:31.747834 14639 rpcz_store.cc:276] 0709 13:06:30.703677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.542931 (+839254us) service_pool.cc:224] Handling call
0709 13:06:31.544624 (+  1693us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:31.544739 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:31.666213 (+121474us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:31.714624 (+ 48411us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:31.747294 (+ 32670us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32200}
I20260709 13:06:31.749364 14848 ts_tablet_manager.cc:1403] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.017s
I20260709 13:06:31.752141 14848 raft_consensus.cc:359] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.752843 14848 raft_consensus.cc:385] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.753123 14848 raft_consensus.cc:740] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.753832 14848 consensus_queue.cc:260] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.756158 14848 ts_tablet_manager.cc:1434] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:31.756255 14847 tablet_bootstrap.cc:654] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.747738 14849 raft_consensus.cc:385] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.757181 14848 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.757337 14849 raft_consensus.cc:740] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.758168 14849 consensus_queue.cc:260] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.760449 14849 ts_tablet_manager.cc:1434] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:06:31.761446 14849 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:31.763427 14846 tablet_bootstrap.cc:654] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.763932 14848 tablet_bootstrap.cc:654] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.775840 14847 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:31.776342 14847 ts_tablet_manager.cc:1403] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 13:06:31.779094 14847 raft_consensus.cc:359] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.779784 14847 raft_consensus.cc:385] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.780074 14847 raft_consensus.cc:740] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.780829 14847 consensus_queue.cc:260] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.782115 14849 tablet_bootstrap.cc:654] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.783125 14847 ts_tablet_manager.cc:1434] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:31.784139 14847 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:31.790661 14847 tablet_bootstrap.cc:654] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.803077 14849 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:31.803586 14849 ts_tablet_manager.cc:1403] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.008s
I20260709 13:06:31.804342 14848 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:31.804427 14846 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:31.804998 14848 ts_tablet_manager.cc:1403] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.016s
I20260709 13:06:31.805074 14846 ts_tablet_manager.cc:1403] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.058s	user 0.000s	sys 0.014s
I20260709 13:06:31.806591 14849 raft_consensus.cc:359] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.807341 14849 raft_consensus.cc:385] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.807636 14849 raft_consensus.cc:740] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.808002 14848 raft_consensus.cc:359] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.808741 14848 raft_consensus.cc:385] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.808384 14846 raft_consensus.cc:359] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.809055 14848 raft_consensus.cc:740] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.809494 14846 raft_consensus.cc:385] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.808458 14849 consensus_queue.cc:260] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.810026 14846 raft_consensus.cc:740] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.810438 14848 consensus_queue.cc:260] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.810874 14846 consensus_queue.cc:260] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.812857 14848 ts_tablet_manager.cc:1434] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:31.813889 14848 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.817618 14849 ts_tablet_manager.cc:1434] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:06:31.818637 14849 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:31.808872 14847 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:31.821452 14847 ts_tablet_manager.cc:1403] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.006s
I20260709 13:06:31.822247 14848 tablet_bootstrap.cc:654] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.824497 14847 raft_consensus.cc:359] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.825204 14847 raft_consensus.cc:385] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.825502 14847 raft_consensus.cc:740] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.830384 14846 ts_tablet_manager.cc:1434] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.006s
I20260709 13:06:31.832140 14849 tablet_bootstrap.cc:654] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.833431 14854 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.833910 14854 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.836159 14854 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:31.836803 14846 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:31.838126 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:31.838743 14578 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:31.839968 14765 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:31.840756 14854 raft_consensus.cc:2804] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:31.841104 14854 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.841468 14854 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:31.847472 14846 tablet_bootstrap.cc:654] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.838825 14847 consensus_queue.cc:260] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.851300 14847 ts_tablet_manager.cc:1434] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:06:31.848739 14854 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.853655 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:31.854106 14847 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:31.854197 14578 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:31.854972 14854 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:31.862864 14578 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:31.866691 14765 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:31.868710 14854 raft_consensus.cc:2804] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:31.870966 14855 raft_consensus.cc:493] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.871691 14855 raft_consensus.cc:515] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.872478 14848 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:31.873088 14848 ts_tablet_manager.cc:1403] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.008s
I20260709 13:06:31.874752 14855 leader_election.cc:290] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:31.875805 14849 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:31.876189 14848 raft_consensus.cc:359] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.877978 14847 tablet_bootstrap.cc:654] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.878417 14848 raft_consensus.cc:385] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.879592 14848 raft_consensus.cc:740] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.879279 14849 ts_tablet_manager.cc:1403] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.004s
I20260709 13:06:31.882344 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:31.883561 14544 leader_election.cc:343] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.886397 14854 raft_consensus.cc:697] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:31.886566 14848 consensus_queue.cc:260] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.888641 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:31.889076 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:31.888844 14854 consensus_queue.cc:237] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.889281 14653 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:31.891170 14849 raft_consensus.cc:359] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.891866 14849 raft_consensus.cc:385] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.892131 14849 raft_consensus.cc:740] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.893980 14849 consensus_queue.cc:260] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.893574 14846 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:31.895969 14848 ts_tablet_manager.cc:1434] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:06:31.897068 14848 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.896987 14846 ts_tablet_manager.cc:1403] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.008s
I20260709 13:06:31.897126 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:31.898761 14541 leader_election.cc:343] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.899194 14541 leader_election.cc:304] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:31.900327 14846 raft_consensus.cc:359] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.901031 14846 raft_consensus.cc:385] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.901314 14846 raft_consensus.cc:740] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.902017 14847 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:31.902561 14847 ts_tablet_manager.cc:1403] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.005s
I20260709 13:06:31.902566 14855 raft_consensus.cc:2749] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.903935 14846 consensus_queue.cc:260] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.904699 14859 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.906122 14846 ts_tablet_manager.cc:1434] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:31.905179 14859 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.909009 14859 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:31.910039 14893 raft_consensus.cc:493] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.910539 14893 raft_consensus.cc:515] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.911895 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:31.912508 14653 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:31.909540 14859 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.913268 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:31.913182 14859 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:31.914948 14765 leader_election.cc:343] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.915207 14859 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:31.903134 14849 ts_tablet_manager.cc:1434] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 13:06:31.915894 14690 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:31.916087 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:31.916934 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:31.917379 14653 raft_consensus.cc:2468] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
W20260709 13:06:31.918541 14690 leader_election.cc:343] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.920634 14764 leader_election.cc:304] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:31.918435 14859 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:31.921471 14849 tablet_bootstrap.cc:492] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:31.921676 14859 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.922044 14859 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:31.912590 14893 leader_election.cc:290] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:31.923524 14893 raft_consensus.cc:2804] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:31.923873 14893 raft_consensus.cc:493] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.924186 14893 raft_consensus.cc:3060] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:31.929201 14859 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.930549 14849 tablet_bootstrap.cc:654] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.931959 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:31.932514 14653 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:31.935052 14893 raft_consensus.cc:515] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.937646 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:31.938594 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:31.938989 14765 leader_election.cc:343] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.939431 14653 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
W20260709 13:06:31.939935 14692 leader_election.cc:343] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.940277 14846 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:31.940824 14848 tablet_bootstrap.cc:654] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.940721 14690 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:31.942233 14859 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:31.942816 14859 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:31.943252 14859 raft_consensus.cc:697] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:31.943230 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:31.944406 14859 consensus_queue.cc:237] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:31.944854 14692 leader_election.cc:343] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.946487 14847 raft_consensus.cc:359] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:31.947180 14847 raft_consensus.cc:385] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.947363 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:31.947641 14893 leader_election.cc:290] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:31.948056 14653 raft_consensus.cc:3060] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:31.947530 14847 raft_consensus.cc:740] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.952383 14846 tablet_bootstrap.cc:654] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:31.952658 14847 consensus_queue.cc:260] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:31.957156 14653 raft_consensus.cc:2468] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:31.961673 14764 leader_election.cc:304] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:31.962481 14854 raft_consensus.cc:2804] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:31.959244 14472 catalog_manager.cc:5697] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.962935 14854 raft_consensus.cc:697] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:31.963986 14854 consensus_queue.cc:237] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:31.967041 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:31.968808 14691 leader_election.cc:343] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:31.969489 14691 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:31.970924 14849 tablet_bootstrap.cc:492] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:31.971135 14859 raft_consensus.cc:2749] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:31.971485 14849 ts_tablet_manager.cc:1403] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.001s
I20260709 13:06:31.971369 14847 ts_tablet_manager.cc:1434] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:06:31.976593 14849 raft_consensus.cc:359] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.977519 14849 raft_consensus.cc:385] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.977823 14849 raft_consensus.cc:740] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:31.978606 14849 consensus_queue.cc:260] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:31.980870 14849 ts_tablet_manager.cc:1434] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:06:31.982551 14847 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:31.983489 14848 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:31.995509 14848 ts_tablet_manager.cc:1403] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.006s
I20260709 13:06:31.996798 14854 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.997303 14854 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:31.998601 14848 raft_consensus.cc:359] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:31.999281 14848 raft_consensus.cc:385] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:31.999390 14854 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:31.999608 14848 raft_consensus.cc:740] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.000587 14848 consensus_queue.cc:260] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.002080 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.002693 14578 raft_consensus.cc:2468] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:32.003001 14848 ts_tablet_manager.cc:1434] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:06:32.003930 14848 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:31.988572 14473 catalog_manager.cc:5697] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.994096 14849 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.004604 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.004022 14765 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
W20260709 13:06:32.006970 14767 leader_election.cc:343] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.007584 14854 raft_consensus.cc:2804] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.008288 14854 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.008689 14854 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.010540 14849 tablet_bootstrap.cc:654] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.010649 14472 catalog_manager.cc:5697] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.012832 14855 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.014230 14855 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.016798 14855 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:32.017760 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.019479 14801 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:32.019567 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.020198 14893 raft_consensus.cc:493] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.020851 14848 tablet_bootstrap.cc:654] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:32.020962 14541 leader_election.cc:343] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:32.022073 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 53326.3us
I20260709 13:06:32.020679 14893 raft_consensus.cc:515] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.024509 14543 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.025750 14855 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.026141 14855 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.026544 14855 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.027523 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:32.029022 14764 leader_election.cc:343] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.026062 14893 leader_election.cc:290] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.034139 14847 tablet_bootstrap.cc:654] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.037108 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.037775 14727 raft_consensus.cc:2468] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:32.038183 14855 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.041201 14767 leader_election.cc:304] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.042513 14893 raft_consensus.cc:2804] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.042907 14893 raft_consensus.cc:493] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.043224 14893 raft_consensus.cc:3060] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.050568 14854 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.054067 14898 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.055660 14855 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:32.056008 14898 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.056852 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
W20260709 13:06:32.058386 14541 leader_election.cc:343] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.054131 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:32.059180 14801 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.061257 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:32.061916 14578 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.083912 14849 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:32.084560 14849 ts_tablet_manager.cc:1403] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.008s
W20260709 13:06:32.090716 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 49607.3us
I20260709 13:06:32.094044 14849 raft_consensus.cc:359] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.094808 14849 raft_consensus.cc:385] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.095077 14849 raft_consensus.cc:740] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.095832 14849 consensus_queue.cc:260] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.098254 14849 ts_tablet_manager.cc:1434] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:06:32.099538 14849 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.103296 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.104337 14848 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.104823 14848 ts_tablet_manager.cc:1403] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.034s
W20260709 13:06:32.104854 14767 leader_election.cc:343] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.107307 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.107672 14848 raft_consensus.cc:359] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.108407 14848 raft_consensus.cc:385] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.108659 14848 raft_consensus.cc:740] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
W20260709 13:06:32.108934 14765 leader_election.cc:343] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.109494 14765 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:32.110337 14846 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.110853 14846 ts_tablet_manager.cc:1403] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.027s
I20260709 13:06:32.111320 14801 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:32.113703 14846 raft_consensus.cc:359] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.114416 14846 raft_consensus.cc:385] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.114686 14846 raft_consensus.cc:740] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.115489 14848 consensus_queue.cc:260] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.122726 14543 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.123485 14854 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.124938 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.126181 14855 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.128189 14727 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.126693 14846 consensus_queue.cc:260] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.130457 14849 tablet_bootstrap.cc:654] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.139166 14846 ts_tablet_manager.cc:1434] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:06:32.141120 14846 tablet_bootstrap.cc:492] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.129055 14898 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
W20260709 13:06:32.159485 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:32.148965 14854 raft_consensus.cc:2749] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.167559 14848 ts_tablet_manager.cc:1434] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.062s	user 0.018s	sys 0.023s
I20260709 13:06:32.165477 14855 raft_consensus.cc:697] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:32.169317 14855 consensus_queue.cc:237] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.170289 14847 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.170768 14847 ts_tablet_manager.cc:1403] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.188s	user 0.029s	sys 0.035s
I20260709 13:06:32.172011 14848 tablet_bootstrap.cc:492] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.176884 14848 tablet_bootstrap.cc:654] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.180910 14578 raft_consensus.cc:2468] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:32.181475 14893 raft_consensus.cc:515] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.182369 14847 raft_consensus.cc:359] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.183123 14847 raft_consensus.cc:385] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.184422 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:32.186185 14846 tablet_bootstrap.cc:654] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:32.186582 14764 leader_election.cc:343] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.186753 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.183454 14847 raft_consensus.cc:740] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.183247 14893 leader_election.cc:290] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.187343 14726 raft_consensus.cc:3060] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.185912 14727 raft_consensus.cc:2468] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:32.189339 14767 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:32.190307 14893 raft_consensus.cc:2804] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.190959 14893 raft_consensus.cc:697] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:32.191715 14893 consensus_queue.cc:237] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.197768 14847 consensus_queue.cc:260] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.199115 14916 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.199658 14916 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.198988 14726 raft_consensus.cc:2468] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:32.201321 14847 ts_tablet_manager.cc:1434] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:06:32.202826 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.202445 14767 leader_election.cc:304] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.204973 14847 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.205530 14914 raft_consensus.cc:2804] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:32.205595 14541 leader_election.cc:343] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.206173 14914 raft_consensus.cc:697] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:32.207916 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.207120 14916 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.210160 14914 consensus_queue.cc:237] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.214500 14848 tablet_bootstrap.cc:492] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.215575 14848 ts_tablet_manager.cc:1403] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:06:32.217062 14473 catalog_manager.cc:5697] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.214694 14849 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:32.218528 14726 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:32.219035 14849 ts_tablet_manager.cc:1403] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.002s
I20260709 13:06:32.217737 14472 catalog_manager.cc:5697] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.220242 14544 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.222055 14849 raft_consensus.cc:359] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.222712 14849 raft_consensus.cc:385] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.222997 14849 raft_consensus.cc:740] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.223646 14849 consensus_queue.cc:260] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.224570 14847 tablet_bootstrap.cc:654] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.218314 14848 raft_consensus.cc:359] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.225809 14848 raft_consensus.cc:385] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.226078 14848 raft_consensus.cc:740] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.226823 14848 consensus_queue.cc:260] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.228981 14848 ts_tablet_manager.cc:1434] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:06:32.229842 14848 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.232569 14849 ts_tablet_manager.cc:1434] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:32.233305 14849 tablet_bootstrap.cc:492] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.241672 14848 tablet_bootstrap.cc:654] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.242355 14916 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.243516 14916 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.243850 14916 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.246793 14849 tablet_bootstrap.cc:654] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.249663 14905 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.250558 14905 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.252976 14905 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.254528 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.255905 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:32.257678 14692 leader_election.cc:343] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:32.258436 14690 leader_election.cc:343] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.258874 14690 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.259994 14905 raft_consensus.cc:2749] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.268060 14846 tablet_bootstrap.cc:492] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.266649 14473 catalog_manager.cc:5697] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.268610 14846 ts_tablet_manager.cc:1403] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.006s
I20260709 13:06:32.270949 14916 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.273440 14916 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.271607 14846 raft_consensus.cc:359] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.274588 14846 raft_consensus.cc:385] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.274879 14846 raft_consensus.cc:740] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.275106 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:32.275684 14846 consensus_queue.cc:260] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:32.276481 14541 leader_election.cc:343] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.277876 14846 ts_tablet_manager.cc:1434] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:06:32.275727 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.280063 14726 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.288239 14726 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:32.289933 14849 tablet_bootstrap.cc:492] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:32.290107 14847 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.291272 14544 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.291429 14847 ts_tablet_manager.cc:1403] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.015s
I20260709 13:06:32.292533 14855 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.293093 14855 raft_consensus.cc:697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:32.293334 14915 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.294008 14915 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.294220 14855 consensus_queue.cc:237] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.295113 14905 raft_consensus.cc:493] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.295863 14849 ts_tablet_manager.cc:1403] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.013s
I20260709 13:06:32.296150 14915 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.297102 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.297811 14726 raft_consensus.cc:2468] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:32.298005 14858 raft_consensus.cc:493] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.298763 14858 raft_consensus.cc:515] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.299242 14544 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:32.300081 14915 raft_consensus.cc:2804] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.300457 14915 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.295570 14905 raft_consensus.cc:515] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.300876 14915 raft_consensus.cc:3060] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.302454 14905 leader_election.cc:290] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:32.302560 14848 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.297691 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.303292 14848 ts_tablet_manager.cc:1403] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.002s
I20260709 13:06:32.304314 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.294814 14847 raft_consensus.cc:359] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.305167 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:32.305655 14691 leader_election.cc:343] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.305779 14653 raft_consensus.cc:2468] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:32.306344 14847 raft_consensus.cc:385] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.306679 14847 raft_consensus.cc:740] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.307271 14690 leader_election.cc:304] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:32.307467 14848 raft_consensus.cc:359] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.308149 14848 raft_consensus.cc:385] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.308596 14848 raft_consensus.cc:740] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.302837 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.309597 14578 raft_consensus.cc:2468] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:32.307353 14847 consensus_queue.cc:260] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.308990 14846 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.310947 14905 raft_consensus.cc:2804] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.311338 14905 raft_consensus.cc:493] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.311806 14905 raft_consensus.cc:3060] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.300885 14858 leader_election.cc:290] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.309831 14848 consensus_queue.cc:260] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.314422 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:32.308689 14541 leader_election.cc:343] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.319020 14617 leader_election.cc:304] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:32.316880 14915 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.317502 14858 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.321362 14726 raft_consensus.cc:2468] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:32.324779 14847 ts_tablet_manager.cc:1434] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:06:32.323233 14846 tablet_bootstrap.cc:654] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.326012 14847 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.324230 14855 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.326920 14855 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.328997 14855 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.329149 14915 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.333766 14858 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.336870 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.337605 14801 raft_consensus.cc:2468] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:32.338505 14858 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.339053 14858 raft_consensus.cc:2804] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.339233 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.340101 14801 raft_consensus.cc:2468] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:32.340456 14848 ts_tablet_manager.cc:1434] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:06:32.341508 14848 tablet_bootstrap.cc:492] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.339522 14858 raft_consensus.cc:493] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.342161 14858 raft_consensus.cc:3060] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.342748 14849 raft_consensus.cc:359] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.343503 14849 raft_consensus.cc:385] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.343770 14849 raft_consensus.cc:740] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.341305 14618 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:32.344496 14849 consensus_queue.cc:260] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.346336 14543 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:32.347186 14855 raft_consensus.cc:2804] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.347540 14855 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.347857 14855 raft_consensus.cc:3060] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.348400 14848 tablet_bootstrap.cc:654] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.348582 14849 ts_tablet_manager.cc:1434] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:06:32.349645 14849 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.339468 14847 tablet_bootstrap.cc:654] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.356242 14846 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.356763 14846 ts_tablet_manager.cc:1403] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.007s
I20260709 13:06:32.326128 14472 catalog_manager.cc:5697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.359109 14855 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.361970 14846 raft_consensus.cc:359] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.362654 14846 raft_consensus.cc:385] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.362919 14846 raft_consensus.cc:740] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.363029 14914 raft_consensus.cc:493] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.363533 14914 raft_consensus.cc:515] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.365577 14914 leader_election.cc:290] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.363626 14846 consensus_queue.cc:260] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.367871 14855 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.373667 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:32.377396 14801 raft_consensus.cc:3060] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.377637 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.377889 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.378243 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.377432 14927 raft_consensus.cc:2804] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.379047 14927 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.379350 14927 raft_consensus.cc:3060] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:32.372480 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 53540.1us
I20260709 13:06:32.378582 14727 raft_consensus.cc:3060] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:32.383841 14767 leader_election.cc:343] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.381364 14905 raft_consensus.cc:515] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:32.386113 14765 leader_election.cc:343] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.386556 14765 leader_election.cc:304] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:32.382433 14858 raft_consensus.cc:515] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.389458 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.391379 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:32.389007 14914 raft_consensus.cc:2749] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:32.392830 14691 leader_election.cc:343] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.392289 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.394591 14577 raft_consensus.cc:2393] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:32.394556 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:32.392076 14905 leader_election.cc:290] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:32.396267 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:32.397405 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:32.399989 14846 ts_tablet_manager.cc:1434] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.002s
I20260709 13:06:32.401394 14846 tablet_bootstrap.cc:492] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.401149 14652 raft_consensus.cc:3060] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.402717 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.403239 14726 raft_consensus.cc:3060] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.405439 14800 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:32.405731 14541 leader_election.cc:343] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.407823 14848 tablet_bootstrap.cc:492] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.408313 14914 consensus_queue.cc:1048] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.410682 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:32.410940 14858 leader_election.cc:290] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.408294 14848 ts_tablet_manager.cc:1403] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.002s
I20260709 13:06:32.414541 14848 raft_consensus.cc:359] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.415141 14848 raft_consensus.cc:385] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.415373 14848 raft_consensus.cc:740] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.416006 14848 consensus_queue.cc:260] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.411849 14577 raft_consensus.cc:3060] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.410841 14726 raft_consensus.cc:2468] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:32.398509 14927 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.417584 14653 raft_consensus.cc:2393] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 1: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:32.417748 14619 leader_election.cc:304] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:32.418601 14858 raft_consensus.cc:2804] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.419072 14858 raft_consensus.cc:697] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:32.419679 14727 raft_consensus.cc:2468] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:32.419831 14858 consensus_queue.cc:237] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.422883 14544 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.424639 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:32.428589 14577 raft_consensus.cc:2468] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:32.429841 14847 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.431257 14927 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.431684 14848 ts_tablet_manager.cc:1434] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:06:32.433653 14848 tablet_bootstrap.cc:492] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.434201 14652 raft_consensus.cc:2468] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:32.435526 14928 raft_consensus.cc:2804] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.440470 14928 raft_consensus.cc:697] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:32.440485 14690 leader_election.cc:304] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:32.441834 14905 raft_consensus.cc:2804] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.441636 14928 consensus_queue.cc:237] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.442345 14905 raft_consensus.cc:697] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:32.443238 14905 consensus_queue.cc:237] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.446162 14473 catalog_manager.cc:5697] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.436388 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:32.432113 14847 ts_tablet_manager.cc:1403] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.006s
I20260709 13:06:32.437635 14846 tablet_bootstrap.cc:654] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.432814 14801 raft_consensus.cc:2468] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:32.437781 14897 consensus_queue.cc:1048] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:32.449966 14577 raft_consensus.cc:2393] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:32.451175 14617 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:32.452206 14847 raft_consensus.cc:359] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.452425 14543 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.452579 14858 raft_consensus.cc:2749] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.453745 14855 raft_consensus.cc:2804] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.454308 14855 raft_consensus.cc:697] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:32.438701 14849 tablet_bootstrap.cc:654] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.455145 14855 consensus_queue.cc:237] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.459507 14847 raft_consensus.cc:385] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.459824 14847 raft_consensus.cc:740] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.461790 14847 consensus_queue.cc:260] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.471485 14847 ts_tablet_manager.cc:1434] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 13:06:32.472462 14847 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.483500 14473 catalog_manager.cc:5697] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.489404 14848 tablet_bootstrap.cc:654] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.492741 14652 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.504532 14849 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:32.505077 14849 ts_tablet_manager.cc:1403] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.156s	user 0.006s	sys 0.004s
I20260709 13:06:32.505450 14475 catalog_manager.cc:5697] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.509881 14849 raft_consensus.cc:359] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.510388 14849 raft_consensus.cc:385] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.510628 14849 raft_consensus.cc:740] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.511509 14858 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.511278 14849 consensus_queue.cc:260] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.511991 14858 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.512279 14897 consensus_queue.cc:1048] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.514008 14858 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.515540 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.516165 14726 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:32.517714 14849 ts_tablet_manager.cc:1434] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:06:32.518750 14849 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.519302 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.519912 14800 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:32.517647 14619 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:32.523918 14927 raft_consensus.cc:2804] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.524263 14927 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.524569 14927 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.525861 14849 tablet_bootstrap.cc:654] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.531152 14475 catalog_manager.cc:5697] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.536043 14927 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.538827 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.538902 14893 consensus_queue.cc:1048] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.539465 14726 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.541033 14846 tablet_bootstrap.cc:492] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.542217 14846 ts_tablet_manager.cc:1403] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.141s	user 0.007s	sys 0.010s
I20260709 13:06:32.544770 14846 raft_consensus.cc:359] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.547569 14846 raft_consensus.cc:385] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.547843 14846 raft_consensus.cc:740] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.549877 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:32.549666 14846 consensus_queue.cc:260] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.550462 14800 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.553241 14846 ts_tablet_manager.cc:1434] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:32.557736 14846 tablet_bootstrap.cc:492] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.558595 14855 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.559082 14855 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:32.563046 14765 consensus_peers.cc:597] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.563261 14847 tablet_bootstrap.cc:654] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.563143 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:32.568975 14544 leader_election.cc:343] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.570578 14855 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.570968 14846 tablet_bootstrap.cc:654] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.572358 14800 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:32.574424 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.575042 14799 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:32.574442 14618 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:32.576723 14858 raft_consensus.cc:2804] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.577175 14858 raft_consensus.cc:697] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:32.577901 14543 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:32.577975 14858 consensus_queue.cc:237] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.547933 14726 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:32.567139 14927 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.581979 14928 consensus_queue.cc:1048] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.583304 14928 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.583623 14928 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.583938 14928 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.585130 14898 consensus_queue.cc:1048] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.589056 14848 tablet_bootstrap.cc:492] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.589860 14848 ts_tablet_manager.cc:1403] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.000s
I20260709 13:06:32.597302 14849 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:32.599064 14849 ts_tablet_manager.cc:1403] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.020s
I20260709 13:06:32.599263 14855 raft_consensus.cc:493] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.601838 14855 raft_consensus.cc:515] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.603399 14848 raft_consensus.cc:359] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.604089 14848 raft_consensus.cc:385] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.604326 14848 raft_consensus.cc:740] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.604612 14855 leader_election.cc:290] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.605697 14848 consensus_queue.cc:260] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.604755 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.608163 14653 raft_consensus.cc:2393] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:32.609525 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.610639 14848 ts_tablet_manager.cc:1434] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:06:32.611428 14848 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.613747 14544 leader_election.cc:304] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.617506 14855 raft_consensus.cc:3060] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.617368 14928 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.620728 14848 tablet_bootstrap.cc:654] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.622581 14846 tablet_bootstrap.cc:492] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.623116 14846 ts_tablet_manager.cc:1403] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.001s
I20260709 13:06:32.622519 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:32.623870 14928 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.624711 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
W20260709 13:06:32.629022 14544 leader_election.cc:343] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.633109 14801 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.626695 14846 raft_consensus.cc:359] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.634183 14846 raft_consensus.cc:385] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.634295 14855 raft_consensus.cc:2749] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.634517 14846 raft_consensus.cc:740] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.635660 14846 consensus_queue.cc:260] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.637902 14846 ts_tablet_manager.cc:1434] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:06:32.638720 14847 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.639187 14847 ts_tablet_manager.cc:1403] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.002s
I20260709 13:06:32.640875 14849 raft_consensus.cc:359] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.641562 14849 raft_consensus.cc:385] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.641817 14849 raft_consensus.cc:740] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.644394 14801 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:32.638747 14846 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.645643 14543 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:32.646894 14915 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.647360 14915 raft_consensus.cc:697] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:32.648144 14915 consensus_queue.cc:237] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.651440 14846 tablet_bootstrap.cc:654] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.653072 14847 raft_consensus.cc:359] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:32.653688 14541 consensus_peers.cc:597] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.653780 14847 raft_consensus.cc:385] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.654369 14847 raft_consensus.cc:740] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.655036 14847 consensus_queue.cc:260] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.656944 14847 ts_tablet_manager.cc:1434] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:06:32.659369 14849 consensus_queue.cc:260] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.661394 14847 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.669516 14848 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.670010 14848 ts_tablet_manager.cc:1403] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.016s
I20260709 13:06:32.669750 14473 catalog_manager.cc:5697] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.670181 14847 tablet_bootstrap.cc:654] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.672943 14848 raft_consensus.cc:359] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.673748 14848 raft_consensus.cc:385] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.674026 14848 raft_consensus.cc:740] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.674679 14848 consensus_queue.cc:260] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.676885 14848 ts_tablet_manager.cc:1434] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:32.677995 14848 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.683444 14849 ts_tablet_manager.cc:1434] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
I20260709 13:06:32.684474 14849 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.687121 14848 tablet_bootstrap.cc:654] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.692162 14847 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.692750 14847 ts_tablet_manager.cc:1403] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.000s
I20260709 13:06:32.695391 14847 raft_consensus.cc:359] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.696024 14847 raft_consensus.cc:385] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.696296 14847 raft_consensus.cc:740] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.697253 14855 raft_consensus.cc:493] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.697788 14855 raft_consensus.cc:515] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.699844 14848 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.700368 14848 ts_tablet_manager.cc:1403] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:06:32.701022 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.702854 14848 raft_consensus.cc:359] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.703553 14848 raft_consensus.cc:385] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.703807 14848 raft_consensus.cc:740] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.699764 14855 leader_election.cc:290] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:32.704139 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.705020 14847 consensus_queue.cc:260] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.706209 14541 leader_election.cc:304] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.707170 14916 raft_consensus.cc:2749] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.707619 14848 consensus_queue.cc:260] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.707300 14847 ts_tablet_manager.cc:1434] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:06:32.713194 14847 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.714622 14848 ts_tablet_manager.cc:1434] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:06:32.715552 14848 tablet_bootstrap.cc:492] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.719543 14847 tablet_bootstrap.cc:654] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.721036 14848 tablet_bootstrap.cc:654] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.720779 14475 catalog_manager.cc:5697] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.729058 14848 tablet_bootstrap.cc:492] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.729550 14848 ts_tablet_manager.cc:1403] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:06:32.730540 14846 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.731019 14846 ts_tablet_manager.cc:1403] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.015s
I20260709 13:06:32.732012 14848 raft_consensus.cc:359] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.732667 14848 raft_consensus.cc:385] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.732925 14848 raft_consensus.cc:740] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.734520 14846 raft_consensus.cc:359] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.735229 14846 raft_consensus.cc:385] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.735481 14846 raft_consensus.cc:740] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.736096 14846 consensus_queue.cc:260] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.736660 14898 consensus_queue.cc:1048] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.738005 14846 ts_tablet_manager.cc:1434] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:32.739248 14846 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.744469 14846 tablet_bootstrap.cc:654] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.746034 14905 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.746533 14905 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.749951 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.750636 14801 raft_consensus.cc:2468] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:32.751989 14692 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:32.752738 14897 raft_consensus.cc:2804] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.753079 14897 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.753422 14897 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.754289 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:32.756194 14690 leader_election.cc:343] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.757004 14898 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.757491 14898 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.760474 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.761337 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:32.761831 14765 leader_election.cc:343] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.761883 14897 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.761128 14898 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.748802 14905 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
W20260709 13:06:32.762764 14767 leader_election.cc:343] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.763281 14767 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:32.764484 14898 raft_consensus.cc:2749] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.733587 14848 consensus_queue.cc:260] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.765102 14847 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.765579 14847 ts_tablet_manager.cc:1403] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.007s
I20260709 13:06:32.766431 14848 ts_tablet_manager.cc:1434] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:06:32.764868 14849 tablet_bootstrap.cc:654] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.768307 14847 raft_consensus.cc:359] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.768793 14652 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.773862 14898 consensus_queue.cc:1048] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.776798 14848 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.779192 14847 raft_consensus.cc:385] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.779455 14847 raft_consensus.cc:740] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.781823 14847 consensus_queue.cc:260] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.783632 14847 ts_tablet_manager.cc:1434] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:06:32.784499 14847 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.785241 14905 raft_consensus.cc:493] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.785754 14905 raft_consensus.cc:515] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.788093 14905 leader_election.cc:290] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.790563 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.791186 14801 raft_consensus.cc:2468] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:32.791311 14847 tablet_bootstrap.cc:654] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.791800 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:32.792429 14692 leader_election.cc:304] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:32.793324 14848 tablet_bootstrap.cc:654] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.798216 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.803393 14905 raft_consensus.cc:2804] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.803771 14905 raft_consensus.cc:493] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.804085 14905 raft_consensus.cc:3060] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:32.798221 14690 leader_election.cc:343] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:32.808549 14691 leader_election.cc:343] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.809497 14956 raft_consensus.cc:493] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.810037 14956 raft_consensus.cc:515] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.821550 14956 leader_election.cc:290] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:32.823174 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.823843 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.823861 14801 raft_consensus.cc:2468] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:32.825714 14915 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.828576 14543 leader_election.cc:304] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
W20260709 13:06:32.829136 14541 leader_election.cc:343] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.829852 14956 raft_consensus.cc:2804] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.830229 14956 raft_consensus.cc:493] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.830559 14956 raft_consensus.cc:3060] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.836222 14854 consensus_queue.cc:1048] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.838132 14905 raft_consensus.cc:515] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.842185 14897 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.852232 14653 raft_consensus.cc:3060] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.854254 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:32.854847 14799 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.846865 14897 consensus_queue.cc:1048] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:32.858882 14854 raft_consensus.cc:493] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.859342 14854 raft_consensus.cc:515] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.852272 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:32.861209 14801 raft_consensus.cc:3060] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.847378 14858 consensus_queue.cc:1048] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:06:32.864223 14915 consensus_queue.cc:1048] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.867821 14858 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.868319 14858 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.877983 14846 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:32.878471 14846 ts_tablet_manager.cc:1403] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.023s
I20260709 13:06:32.878674 14848 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:32.879122 14848 ts_tablet_manager.cc:1403] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.103s	user 0.006s	sys 0.011s
I20260709 13:06:32.868037 14801 raft_consensus.cc:2468] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:32.882575 14849 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:32.883090 14849 ts_tablet_manager.cc:1403] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.199s	user 0.022s	sys 0.029s
I20260709 13:06:32.891463 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:32.893041 14692 leader_election.cc:304] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:32.894564 14854 leader_election.cc:290] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:32.898618 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:32.898741 14897 raft_consensus.cc:2804] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.901932 14799 raft_consensus.cc:2468] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:32.899315 14650 raft_consensus.cc:2468] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
W20260709 13:06:32.899310 14691 leader_election.cc:343] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.901814 14893 consensus_queue.cc:1048] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.902526 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:32.901067 14897 raft_consensus.cc:697] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:32.880880 14905 leader_election.cc:290] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.908324 14848 raft_consensus.cc:359] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.911787 14848 raft_consensus.cc:385] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.914273 14848 raft_consensus.cc:740] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
W20260709 13:06:32.911864 14767 leader_election.cc:343] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.919704 14848 consensus_queue.cc:260] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.910859 14858 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.922540 14847 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:32.921151 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:32.916675 14897 consensus_queue.cc:237] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.923023 14847 ts_tablet_manager.cc:1403] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.014s
I20260709 13:06:32.925711 14847 raft_consensus.cc:359] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.926383 14847 raft_consensus.cc:385] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.926628 14847 raft_consensus.cc:740] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.925587 14764 leader_election.cc:304] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:32.929935 14692 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:32.931137 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.931346 14849 raft_consensus.cc:359] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.931958 14849 raft_consensus.cc:385] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.932224 14849 raft_consensus.cc:740] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.932767 14618 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:32.932843 14849 consensus_queue.cc:260] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.936929 14848 ts_tablet_manager.cc:1434] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.004s
I20260709 13:06:32.911017 14956 raft_consensus.cc:515] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.939157 14914 raft_consensus.cc:2804] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:32.939625 14914 raft_consensus.cc:493] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.939957 14914 raft_consensus.cc:3060] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:32.940793 14849 ts_tablet_manager.cc:1434] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:06:32.942013 14849 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:32.935577 14858 raft_consensus.cc:2749] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:32.927346 14847 consensus_queue.cc:260] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.944299 14846 raft_consensus.cc:359] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.945657 14846 raft_consensus.cc:385] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.945940 14846 raft_consensus.cc:740] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.947283 14976 raft_consensus.cc:2804] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:32.949412 14905 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.949893 14905 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.951980 14905 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:32.943491 14854 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.952714 14846 consensus_queue.cc:260] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:32.958600 14976 raft_consensus.cc:697] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:32.959596 14976 consensus_queue.cc:237] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:32.970243 14847 ts_tablet_manager.cc:1434] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:06:32.961639 14915 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.971109 14847 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:32.973747 14848 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:32.982745 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:32.982983 14915 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:32.983523 14799 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:32.984552 14846 ts_tablet_manager.cc:1434] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.006s
I20260709 13:06:32.985798 14846 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:32.987600 14928 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:32.964651 14854 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:32.990199 14849 tablet_bootstrap.cc:654] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.991447 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:32.993414 14969 log.cc:927] Time spent T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:06:32.993820 14765 leader_election.cc:343] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:32.994869 14932 consensus_queue.cc:1048] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:32.996858 14692 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:32.998809 14915 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:32.999089 14651 raft_consensus.cc:3060] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.000425 14854 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:33.000900 14932 consensus_queue.cc:1048] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:33.006959 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.007582 14799 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.008881 14543 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:33.009745 14855 raft_consensus.cc:2804] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.010092 14855 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.010387 14855 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.013988 14979 raft_consensus.cc:2804] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.014382 14979 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.014700 14979 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.013621 14914 raft_consensus.cc:515] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.021087 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:33.024571 14764 leader_election.cc:343] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.025017 14764 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.026192 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:33.026844 14650 raft_consensus.cc:3060] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.027771 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:33.028478 14846 tablet_bootstrap.cc:654] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.026165 14854 raft_consensus.cc:2749] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.029011 14914 leader_election.cc:290] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.030800 14577 raft_consensus.cc:3060] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.032892 14897 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.033383 14897 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.035449 14897 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:33.035688 14956 leader_election.cc:290] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:33.036283 14979 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.036532 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.037496 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:33.038087 14799 raft_consensus.cc:3060] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:33.038631 14690 leader_election.cc:343] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.039529 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:33.040109 14801 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.038687 14979 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:33.040118 14855 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:33.052205 14767 leader_election.cc:343] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.080191 14650 raft_consensus.cc:2468] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:33.052140 14915 consensus_queue.cc:1048] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:06:33.071657 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:33.081339 14916 consensus_queue.cc:1048] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.074270 14956 consensus_queue.cc:1048] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.076097 14574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:33.084851 14574 raft_consensus.cc:2393] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:33.077142 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.085572 14764 leader_election.cc:304] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.086345 14726 raft_consensus.cc:2393] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:33.086534 14932 consensus_queue.cc:1048] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.087339 14854 raft_consensus.cc:2804] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.087822 14854 raft_consensus.cc:697] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:33.088603 14854 consensus_queue.cc:237] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.092620 14849 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:33.093084 14849 ts_tablet_manager.cc:1403] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.151s	user 0.009s	sys 0.007s
I20260709 13:06:33.052982 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:33.083094 14848 tablet_bootstrap.cc:654] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.059690 14897 consensus_queue.cc:1048] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:33.100390 14847 tablet_bootstrap.cc:654] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.098618 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:33.072090 14801 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:33.105942 14576 raft_consensus.cc:2393] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
W20260709 13:06:33.098230 14691 leader_election.cc:343] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.107611 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:33.098433 14855 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.113745 14797 raft_consensus.cc:2393] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
W20260709 13:06:33.110941 14541 leader_election.cc:343] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.114670 14692 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:33.112919 14849 raft_consensus.cc:359] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.119529 14849 raft_consensus.cc:385] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.119772 14849 raft_consensus.cc:740] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.120486 14849 consensus_queue.cc:260] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.112481 14691 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.121899 14976 raft_consensus.cc:2804] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.132583 14849 ts_tablet_manager.cc:1434] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:06:33.134019 14849 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:33.122605 14799 raft_consensus.cc:2468] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:33.141918 14847 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.146695 14847 ts_tablet_manager.cc:1403] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.176s	user 0.006s	sys 0.014s
I20260709 13:06:33.142854 14846 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:33.131781 14897 raft_consensus.cc:2749] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.147568 14846 ts_tablet_manager.cc:1403] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.010s
I20260709 13:06:33.145042 14976 raft_consensus.cc:697] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:33.159862 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:33.161902 14544 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:33.160003 14846 raft_consensus.cc:359] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.163740 14846 raft_consensus.cc:385] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.164011 14846 raft_consensus.cc:740] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.162997 14956 raft_consensus.cc:2749] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.165360 14846 consensus_queue.cc:260] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.166507 14543 leader_election.cc:304] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.167430 14855 raft_consensus.cc:2804] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.167917 14855 raft_consensus.cc:697] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:33.163002 14847 raft_consensus.cc:359] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.173008 14847 raft_consensus.cc:385] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.173782 14846 ts_tablet_manager.cc:1434] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:06:33.173631 14847 raft_consensus.cc:740] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.154825 14976 consensus_queue.cc:237] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.177789 14847 consensus_queue.cc:260] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.179771 14846 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:33.168699 14855 consensus_queue.cc:237] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:33.166524 14544 consensus_peers.cc:597] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:33.189431 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:33.201031 14848 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:33.201721 14848 ts_tablet_manager.cc:1403] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.228s	user 0.018s	sys 0.002s
I20260709 13:06:33.204741 14848 raft_consensus.cc:359] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.206914 14848 raft_consensus.cc:385] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.207309 14848 raft_consensus.cc:740] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.212493 14847 ts_tablet_manager.cc:1434] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.065s	user 0.000s	sys 0.007s
I20260709 13:06:33.213637 14847 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.195611 14956 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.216353 14973 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.216567 14649 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.218398 14848 consensus_queue.cc:260] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.219944 14973 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.224062 14973 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:33.224989 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.226083 14928 consensus_queue.cc:1048] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.227797 14849 tablet_bootstrap.cc:654] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.227591 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.226329 14690 leader_election.cc:343] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.229733 14475 catalog_manager.cc:5697] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.219192 14956 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.234509 14956 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:33.236254 14691 leader_election.cc:343] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.236661 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.238785 14475 catalog_manager.cc:5697] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.242257 14847 tablet_bootstrap.cc:654] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.237767 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.248805 14848 ts_tablet_manager.cc:1434] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260709 13:06:33.236689 14691 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.252748 14973 raft_consensus.cc:2749] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.250120 14848 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
W20260709 13:06:33.243665 14543 leader_election.cc:343] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:33.269021 14984 log.cc:927] Time spent T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:06:33.272290 14846 tablet_bootstrap.cc:654] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:33.264314 14541 leader_election.cc:343] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.282693 14848 tablet_bootstrap.cc:654] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.290185 14858 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.294763 14858 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.295923 14847 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.296445 14847 ts_tablet_manager.cc:1403] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.001s
I20260709 13:06:33.296628 14858 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.294715 14849 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:33.297453 14849 ts_tablet_manager.cc:1403] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.012s
I20260709 13:06:33.297927 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.298496 14541 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.299335 14928 raft_consensus.cc:2749] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:33.299492 14541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 45156us
W20260709 13:06:33.299844 14619 leader_election.cc:343] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.299923 14849 raft_consensus.cc:359] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.300657 14849 raft_consensus.cc:385] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.300860 14849 raft_consensus.cc:740] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.301378 14849 consensus_queue.cc:260] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.301642 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.303581 14617 leader_election.cc:343] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.304004 14849 ts_tablet_manager.cc:1434] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:33.304001 14617 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.305032 14849 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:33.306173 14847 raft_consensus.cc:359] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.306814 14847 raft_consensus.cc:385] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.307119 14858 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.307155 14847 raft_consensus.cc:740] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.308432 14847 consensus_queue.cc:260] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.310528 14847 ts_tablet_manager.cc:1434] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:33.311501 14847 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.312461 14849 tablet_bootstrap.cc:654] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.321792 14846 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:33.322305 14846 ts_tablet_manager.cc:1403] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.001s
I20260709 13:06:33.324925 14846 raft_consensus.cc:359] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.325611 14846 raft_consensus.cc:385] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.325870 14846 raft_consensus.cc:740] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.326277 14847 tablet_bootstrap.cc:654] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.326642 14846 consensus_queue.cc:260] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.328830 14846 ts_tablet_manager.cc:1434] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:33.329763 14846 tablet_bootstrap.cc:492] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:33.333690 14848 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:33.334285 14848 ts_tablet_manager.cc:1403] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.015s
I20260709 13:06:33.335021 14849 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:33.335489 14849 ts_tablet_manager.cc:1403] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 13:06:33.337078 14848 raft_consensus.cc:359] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.337890 14848 raft_consensus.cc:385] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.338209 14848 raft_consensus.cc:740] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.338138 14849 raft_consensus.cc:359] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.339239 14848 consensus_queue.cc:260] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.339905 14849 raft_consensus.cc:385] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.340207 14849 raft_consensus.cc:740] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.340233 14846 tablet_bootstrap.cc:654] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.341121 14849 consensus_queue.cc:260] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.342080 14848 ts_tablet_manager.cc:1434] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:33.343091 14848 tablet_bootstrap.cc:492] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:33.343315 14849 ts_tablet_manager.cc:1434] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:33.344209 14849 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:33.347512 14847 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.348158 14847 ts_tablet_manager.cc:1403] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:06:33.349659 14915 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.350323 14915 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.351166 14847 raft_consensus.cc:359] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.351800 14847 raft_consensus.cc:385] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.352046 14847 raft_consensus.cc:740] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.352432 14915 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.352896 14848 tablet_bootstrap.cc:654] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.352662 14847 consensus_queue.cc:260] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.354056 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.354658 14725 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.354975 14847 ts_tablet_manager.cc:1434] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:33.356092 14847 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.356495 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.357086 14649 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.359221 14541 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:33.359965 14928 raft_consensus.cc:2804] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.361321 14846 tablet_bootstrap.cc:492] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:33.361368 14849 tablet_bootstrap.cc:654] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.362463 14928 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.362763 14846 ts_tablet_manager.cc:1403] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.006s
I20260709 13:06:33.362960 14928 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.365636 14846 raft_consensus.cc:359] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.366366 14846 raft_consensus.cc:385] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.366626 14846 raft_consensus.cc:740] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.369444 14854 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.369925 14854 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.371847 14854 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:33.371943 14847 tablet_bootstrap.cc:654] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.373279 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:33.375430 14764 leader_election.cc:343] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.381402 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:33.383385 14846 consensus_queue.cc:260] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.386425 14849 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:33.386897 14849 ts_tablet_manager.cc:1403] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.006s
W20260709 13:06:33.387735 14765 leader_election.cc:343] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.388186 14765 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.389545 14849 raft_consensus.cc:359] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.390206 14849 raft_consensus.cc:385] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.390456 14849 raft_consensus.cc:740] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.391054 14849 consensus_queue.cc:260] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.393317 14849 ts_tablet_manager.cc:1434] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:33.393929 14893 raft_consensus.cc:2749] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.394224 14849 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:33.397431 14578 raft_consensus.cc:3060] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.400149 14849 tablet_bootstrap.cc:654] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.405382 14473 catalog_manager.cc:5697] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.407168 14976 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.407717 14976 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.409967 14976 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:33.412175 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.411600 14976 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.412976 14976 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.413372 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.414700 14691 leader_election.cc:343] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.416370 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.416934 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.417958 14690 leader_election.cc:343] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:33.416438 14692 leader_election.cc:343] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:33.419034 14691 leader_election.cc:343] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.419639 14691 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.420460 14897 raft_consensus.cc:2749] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.419034 14692 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:33.422207 14897 raft_consensus.cc:2749] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.422605 14472 catalog_manager.cc:5697] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.424921 14976 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:33.426263 14976 consensus_queue.cc:1048] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.428666 14897 consensus_queue.cc:1048] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.416383 14928 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.431993 14848 tablet_bootstrap.cc:492] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:33.432513 14848 ts_tablet_manager.cc:1403] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.007s
I20260709 13:06:33.433497 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:33.434042 14649 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.435318 14848 raft_consensus.cc:359] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.436101 14848 raft_consensus.cc:385] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.436348 14848 raft_consensus.cc:740] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.437016 14848 consensus_queue.cc:260] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.438899 14848 ts_tablet_manager.cc:1434] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:33.439845 14848 tablet_bootstrap.cc:492] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:33.442574 14976 consensus_queue.cc:1048] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.446429 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:33.446951 14725 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.448030 14848 tablet_bootstrap.cc:654] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.454496 14725 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:33.455778 14544 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:33.456568 14915 raft_consensus.cc:2804] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.457047 14915 raft_consensus.cc:697] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:33.457362 14928 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.457868 14915 consensus_queue.cc:237] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.441102 14649 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:33.460234 14847 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.460708 14847 ts_tablet_manager.cc:1403] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.105s	user 0.060s	sys 0.028s
I20260709 13:06:33.461127 14475 catalog_manager.cc:5697] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.464210 14847 raft_consensus.cc:359] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.464864 14847 raft_consensus.cc:385] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.465117 14847 raft_consensus.cc:740] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.465107 14846 ts_tablet_manager.cc:1434] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 13:06:33.466019 14847 consensus_queue.cc:260] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.466816 14846 tablet_bootstrap.cc:492] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:33.468197 14847 ts_tablet_manager.cc:1434] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:06:33.469110 14847 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.474381 14847 tablet_bootstrap.cc:654] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.486778 14847 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.487394 14847 ts_tablet_manager.cc:1403] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:06:33.491441 14847 raft_consensus.cc:359] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.492231 14847 raft_consensus.cc:385] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.492491 14847 raft_consensus.cc:740] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.493315 14847 consensus_queue.cc:260] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.494293 14649 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.496146 14847 ts_tablet_manager.cc:1434] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:33.497293 14847 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.537712 14847 tablet_bootstrap.cc:654] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.547544 14846 tablet_bootstrap.cc:654] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.550834 14849 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:33.550720 14973 consensus_queue.cc:1048] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.551417 14849 ts_tablet_manager.cc:1403] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.009s
I20260709 13:06:33.561198 14848 tablet_bootstrap.cc:492] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:33.561695 14848 ts_tablet_manager.cc:1403] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.018s
I20260709 13:06:33.562054 14847 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.562526 14847 ts_tablet_manager.cc:1403] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.012s
I20260709 13:06:33.564141 14848 raft_consensus.cc:359] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.564911 14848 raft_consensus.cc:385] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.565156 14848 raft_consensus.cc:740] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.567248 14847 raft_consensus.cc:359] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.567905 14847 raft_consensus.cc:385] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.568154 14847 raft_consensus.cc:740] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.568783 14847 consensus_queue.cc:260] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.574090 14847 ts_tablet_manager.cc:1434] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:33.576350 14848 consensus_queue.cc:260] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.576592 14847 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.579581 14849 raft_consensus.cc:359] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.580071 14849 raft_consensus.cc:385] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.580255 14849 raft_consensus.cc:740] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.585246 14849 consensus_queue.cc:260] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.587044 14848 ts_tablet_manager.cc:1434] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:06:33.592768 14848 tablet_bootstrap.cc:492] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:33.593657 14476 catalog_manager.cc:5697] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.597131 14916 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.598059 14916 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.599993 14916 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.598081 14914 raft_consensus.cc:493] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.604105 14914 raft_consensus.cc:515] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.609015 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.609696 14725 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.606397 14914 leader_election.cc:290] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.610814 14544 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:33.611688 14916 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.612099 14916 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.612462 14916 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.612720 14847 tablet_bootstrap.cc:654] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.615124 14915 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.615643 14915 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.610132 14846 tablet_bootstrap.cc:492] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:33.619158 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.618781 14846 ts_tablet_manager.cc:1403] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.006s
W20260709 13:06:33.620636 14767 leader_election.cc:343] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.622251 14914 consensus_queue.cc:1048] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.623268 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:33.628407 14544 leader_election.cc:343] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.632179 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.621796 14916 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.618752 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.635160 14976 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.635630 14976 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.637521 14846 raft_consensus.cc:359] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:33.638504 14541 leader_election.cc:343] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.638749 14916 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.639675 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:33.639577 14846 raft_consensus.cc:385] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.639889 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:33.640363 14846 raft_consensus.cc:740] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.639536 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.641916 14541 leader_election.cc:343] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.637584 14976 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:33.640906 14724 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.641646 14846 consensus_queue.cc:260] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:33.644357 14764 leader_election.cc:343] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.645944 14846 ts_tablet_manager.cc:1434] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:06:33.633701 14915 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.649796 14849 ts_tablet_manager.cc:1434] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.001s
I20260709 13:06:33.650925 14846 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:33.648694 14847 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.653498 14847 ts_tablet_manager.cc:1403] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.003s
I20260709 13:06:33.648439 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.656292 14847 raft_consensus.cc:359] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.656941 14847 raft_consensus.cc:385] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.657199 14847 raft_consensus.cc:740] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.653580 14849 tablet_bootstrap.cc:492] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:33.657406 14724 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:33.658838 14544 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.650079 14764 leader_election.cc:304] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:33.659981 14916 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.660138 14854 raft_consensus.cc:2749] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.661816 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.662420 14800 raft_consensus.cc:2468] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.660542 14916 raft_consensus.cc:697] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:33.657896 14847 consensus_queue.cc:260] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.666402 14916 consensus_queue.cc:237] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.668450 14847 ts_tablet_manager.cc:1434] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:06:33.669462 14847 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:33.670924 14692 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:33.671801 14976 raft_consensus.cc:2749] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.672456 14543 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.673337 14915 raft_consensus.cc:2804] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.673988 14915 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.674398 14915 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:33.677680 14767 consensus_peers.cc:597] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:33.678685 14976 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.679205 14976 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.680184 14956 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.680639 14956 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.682241 14976 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:33.682364 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.683756 14691 leader_election.cc:343] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.682642 14956 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.684841 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:33.686035 14544 leader_election.cc:343] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.686128 14725 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.686764 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:33.688419 14847 tablet_bootstrap.cc:654] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.689625 14653 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.693815 14541 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.694645 14928 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.695001 14928 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.695315 14928 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.696907 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:33.701975 14692 leader_election.cc:343] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.702404 14692 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:33.703516 14976 raft_consensus.cc:2749] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.705264 14928 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.708330 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
W20260709 13:06:33.709848 14544 leader_election.cc:343] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.709232 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:33.715368 14653 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.711956 14848 tablet_bootstrap.cc:654] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.712872 14928 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:33.721438 14849 tablet_bootstrap.cc:654] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.726115 14914 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.726611 14914 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.729808 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:33.731164 14767 leader_election.cc:343] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.732504 14914 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:33.733731 14976 consensus_queue.cc:1048] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.734210 14473 catalog_manager.cc:5697] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.737733 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:33.739336 14765 leader_election.cc:343] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.739800 14765 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.744735 14914 raft_consensus.cc:2749] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.745702 14846 tablet_bootstrap.cc:654] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.746573 14928 consensus_queue.cc:1048] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.749922 14848 tablet_bootstrap.cc:492] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:33.750415 14848 ts_tablet_manager.cc:1403] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.000s
I20260709 13:06:33.726034 14915 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.751748 14976 consensus_queue.cc:1048] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:33.752944 14848 raft_consensus.cc:359] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.753607 14848 raft_consensus.cc:385] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.753862 14848 raft_consensus.cc:740] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.754479 14848 consensus_queue.cc:260] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.756811 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:33.758915 14848 ts_tablet_manager.cc:1434] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:06:33.765645 14544 leader_election.cc:343] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.770552 14847 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:33.782457 14847 ts_tablet_manager.cc:1403] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.010s
I20260709 13:06:33.785070 14847 raft_consensus.cc:359] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.787052 14847 raft_consensus.cc:385] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.787371 14847 raft_consensus.cc:740] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.788187 14847 consensus_queue.cc:260] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.791567 14847 ts_tablet_manager.cc:1434] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:06:33.792620 14847 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:33.799293 14541 consensus_peers.cc:597] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:33.799623 14848 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:33.726250 14653 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:33.778400 14846 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:33.803771 14846 ts_tablet_manager.cc:1403] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.001s
I20260709 13:06:33.804220 14916 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.804744 14916 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.805457 14915 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.807919 14916 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.803687 14541 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.812103 14915 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.812831 14915 raft_consensus.cc:697] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:33.813678 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:33.814045 14848 tablet_bootstrap.cc:654] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.813835 14915 consensus_queue.cc:237] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.814675 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.814252 14800 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.817636 14725 raft_consensus.cc:2468] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:33.818928 14544 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:33.819785 14916 raft_consensus.cc:2804] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.820132 14916 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.820461 14916 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:33.824982 15034 log.cc:927] Time spent T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:33.825716 14800 raft_consensus.cc:2468] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:33.826761 14543 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.827896 14928 raft_consensus.cc:2804] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.828364 14928 raft_consensus.cc:697] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:33.829180 14928 consensus_queue.cc:237] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.811687 14846 raft_consensus.cc:359] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.815712 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.830240 14858 raft_consensus.cc:493] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.830744 14858 raft_consensus.cc:515] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.831434 14916 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.832139 14846 raft_consensus.cc:385] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.832544 14848 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:33.838140 14846 raft_consensus.cc:740] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.835091 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:33.835793 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:33.839311 14799 raft_consensus.cc:2468] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:33.840543 14618 leader_election.cc:304] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:33.841403 14927 raft_consensus.cc:2804] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:33.841748 14927 raft_consensus.cc:493] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.842058 14927 raft_consensus.cc:3060] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:33.850230 14619 leader_election.cc:343] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.851744 14927 raft_consensus.cc:515] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:33.838362 14848 ts_tablet_manager.cc:1403] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.005s
I20260709 13:06:33.858004 14848 raft_consensus.cc:359] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.858635 14848 raft_consensus.cc:385] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.858868 14848 raft_consensus.cc:740] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.833046 14858 leader_election.cc:290] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
W20260709 13:06:33.853060 14543 leader_election.cc:343] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.860335 14848 consensus_queue.cc:260] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:33.861943 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
W20260709 13:06:33.863569 14543 leader_election.cc:343] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.864908 14848 ts_tablet_manager.cc:1434] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:33.865506 15041 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.866039 14848 tablet_bootstrap.cc:492] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:33.868257 14927 leader_election.cc:290] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.868887 14849 tablet_bootstrap.cc:492] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:33.837304 14847 tablet_bootstrap.cc:654] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.870083 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:33.870680 14798 raft_consensus.cc:3060] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.854106 14916 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.878005 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
W20260709 13:06:33.879410 14619 leader_election.cc:343] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.881222 14849 ts_tablet_manager.cc:1403] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.228s	user 0.009s	sys 0.006s
I20260709 13:06:33.865974 15041 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:33.854630 14846 consensus_queue.cc:260] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:33.886243 15041 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:33.887645 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:33.889086 14543 leader_election.cc:343] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.889150 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:33.890578 14544 leader_election.cc:343] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.891140 14544 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:33.892660 14956 raft_consensus.cc:2749] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:33.881311 14798 raft_consensus.cc:2468] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:33.890574 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:33.887111 14846 ts_tablet_manager.cc:1434] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.001s
I20260709 13:06:33.893918 14725 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.894423 14618 leader_election.cc:304] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:33.894821 14846 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:33.892969 14848 tablet_bootstrap.cc:654] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.908846 14927 raft_consensus.cc:2804] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.913519 14927 raft_consensus.cc:697] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:33.915565 14927 consensus_queue.cc:237] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:33.989764 14544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 99005.5us
I20260709 13:06:34.003433 14725 raft_consensus.cc:2468] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:34.006098 14849 raft_consensus.cc:359] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.011351 14849 raft_consensus.cc:385] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.013010 14849 raft_consensus.cc:740] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.041507 15042 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.042356 15042 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.043098 14928 consensus_queue.cc:1048] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:34.047606 14849 consensus_queue.cc:260] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.051692 14846 tablet_bootstrap.cc:654] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.053197 15042 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.054286 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:34.057554 14541 leader_election.cc:343] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.061904 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.062829 14800 raft_consensus.cc:2468] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:34.064431 14849 ts_tablet_manager.cc:1434] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.183s	user 0.018s	sys 0.025s
I20260709 13:06:34.083274 14973 raft_consensus.cc:493] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.083891 14973 raft_consensus.cc:515] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.084074 14544 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:34.086861 14543 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.088480 14956 raft_consensus.cc:2804] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.089466 14956 raft_consensus.cc:697] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:34.092011 14916 raft_consensus.cc:2804] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.092554 14916 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.093092 14916 raft_consensus.cc:3060] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.092900 15041 consensus_queue.cc:1048] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:34.088378 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.105248 14973 leader_election.cc:290] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.106338 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.105324 14651 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:34.114267 14690 leader_election.cc:343] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:34.116386 14692 leader_election.cc:343] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.116911 14692 leader_election.cc:304] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.118171 14979 raft_consensus.cc:2749] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.125188 14916 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.127942 14847 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:34.128778 14847 ts_tablet_manager.cc:1403] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.336s	user 0.012s	sys 0.028s
I20260709 13:06:34.129765 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:34.130636 14798 raft_consensus.cc:3060] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.131542 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
W20260709 13:06:34.133410 14541 leader_election.cc:343] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.134136 14916 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.135881 14849 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:34.138300 14846 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:34.139183 14846 ts_tablet_manager.cc:1403] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.245s	user 0.017s	sys 0.009s
I20260709 13:06:34.091298 14956 consensus_queue.cc:237] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.145193 14847 raft_consensus.cc:359] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.146265 14847 raft_consensus.cc:385] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.146546 14847 raft_consensus.cc:740] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.147509 14847 consensus_queue.cc:260] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.150367 14858 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.150974 14858 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.154681 14858 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.155655 14848 tablet_bootstrap.cc:492] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:34.156428 14848 ts_tablet_manager.cc:1403] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.291s	user 0.021s	sys 0.008s
I20260709 13:06:34.156183 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.157038 14724 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:34.158474 14619 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:34.160147 14858 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:34.161887 14858 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.162321 14848 raft_consensus.cc:359] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.162979 14916 consensus_queue.cc:1048] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.164202 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.162997 14848 raft_consensus.cc:385] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.167029 14848 raft_consensus.cc:740] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.162227 14858 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.177117 14847 ts_tablet_manager.cc:1434] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.007s
I20260709 13:06:34.166358 14846 raft_consensus.cc:359] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.180253 14846 raft_consensus.cc:385] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.180528 14846 raft_consensus.cc:740] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.181102 14846 consensus_queue.cc:260] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.184590 14847 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:34.186033 14848 consensus_queue.cc:260] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.187690 14848 ts_tablet_manager.cc:1434] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.005s
I20260709 13:06:34.189322 14848 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:34.197504 14476 catalog_manager.cc:5697] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.202071 14847 tablet_bootstrap.cc:654] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.202628 14846 ts_tablet_manager.cc:1434] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.004s
I20260709 13:06:34.204386 14846 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:34.206396 14472 catalog_manager.cc:5697] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.208722 14472 catalog_manager.cc:5697] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.215305 14854 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.216095 14854 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.215276 14798 raft_consensus.cc:2468] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:34.224684 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:34.230985 14767 leader_election.cc:343] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.219784 14854 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.239111 14543 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.240279 14956 raft_consensus.cc:2804] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:34.245474 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 59582.5us
I20260709 13:06:34.246498 14956 raft_consensus.cc:697] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:34.249200 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.252661 14916 consensus_queue.cc:1048] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.255556 14915 consensus_queue.cc:1048] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.257253 14847 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:34.257844 14847 ts_tablet_manager.cc:1403] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.008s
I20260709 13:06:34.248027 14956 consensus_queue.cc:237] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.262655 14847 raft_consensus.cc:359] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.265836 14847 raft_consensus.cc:385] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.266155 14847 raft_consensus.cc:740] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.266652 14849 tablet_bootstrap.cc:654] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.256759 15051 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.269012 14915 consensus_queue.cc:1048] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.269137 15051 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.272384 14848 tablet_bootstrap.cc:654] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.267241 14847 consensus_queue.cc:260] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.291404 14849 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:34.292037 14849 ts_tablet_manager.cc:1403] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.218s	user 0.012s	sys 0.006s
I20260709 13:06:34.295830 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.274557 15051 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:34.300071 14846 tablet_bootstrap.cc:654] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:34.300452 14764 leader_election.cc:343] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.300231 14858 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.300932 14764 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.302201 14847 ts_tablet_manager.cc:1434] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:06:34.302883 14649 raft_consensus.cc:1240] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Rejecting Update request from peer 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:06:34.303457 14847 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:34.306891 14914 raft_consensus.cc:2749] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.294440 14854 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.313926 14854 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.316087 14854 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.317801 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:34.319550 14765 leader_election.cc:343] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.320847 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:34.322464 14764 leader_election.cc:343] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.322911 14764 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.324075 14914 raft_consensus.cc:2749] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.329790 14916 consensus_queue.cc:1059] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.328104 14849 raft_consensus.cc:359] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.330801 14916 raft_consensus.cc:3055] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.331167 14916 raft_consensus.cc:740] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:34.332401 14916 consensus_queue.cc:260] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.333810 14916 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.334240 14847 tablet_bootstrap.cc:654] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.330792 14849 raft_consensus.cc:385] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.335870 14849 raft_consensus.cc:740] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.336793 14849 consensus_queue.cc:260] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.341513 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:34.341653 14858 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.346632 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
W20260709 13:06:34.348500 14544 consensus_peers.cc:597] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.357326 14578 raft_consensus.cc:2410] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:06:34.346830 14849 ts_tablet_manager.cc:1434] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:06:34.377694 14849 tablet_bootstrap.cc:492] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:34.378110 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.379019 14800 raft_consensus.cc:2393] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:34.384507 14849 tablet_bootstrap.cc:654] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.400024 14617 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:34.400941 15053 raft_consensus.cc:2749] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:34.402872 14848 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:34.403355 14848 ts_tablet_manager.cc:1403] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.214s	user 0.001s	sys 0.017s
I20260709 13:06:34.403877 14846 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:34.404341 14846 ts_tablet_manager.cc:1403] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.200s	user 0.020s	sys 0.001s
I20260709 13:06:34.406481 14848 raft_consensus.cc:359] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.407676 14848 raft_consensus.cc:385] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.408125 14848 raft_consensus.cc:740] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.410138 14848 consensus_queue.cc:260] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.385442 14618 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
W20260709 13:06:34.411528 14544 consensus_peers.cc:597] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.412302 14847 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:34.414320 14847 ts_tablet_manager.cc:1403] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.007s
I20260709 13:06:34.415877 14848 ts_tablet_manager.cc:1434] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 13:06:34.416535 15055 raft_consensus.cc:3060] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.417886 14847 raft_consensus.cc:359] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.418628 14847 raft_consensus.cc:385] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.418900 14847 raft_consensus.cc:740] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.424162 14849 tablet_bootstrap.cc:492] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:34.424708 14849 ts_tablet_manager.cc:1403] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.011s
I20260709 13:06:34.428296 14848 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:34.436688 14847 consensus_queue.cc:260] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:34.440232 14619 consensus_peers.cc:597] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.440480 14847 ts_tablet_manager.cc:1434] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:06:34.441074 14979 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.441566 14847 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:34.441586 14979 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.443547 14848 tablet_bootstrap.cc:654] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.445318 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.446168 14578 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:34.447583 14691 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:34.448406 14847 tablet_bootstrap.cc:654] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.448460 14973 raft_consensus.cc:2804] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.448938 14973 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.449255 14973 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.448750 14979 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:34.455070 14846 raft_consensus.cc:359] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.455327 14849 raft_consensus.cc:359] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.456012 14849 raft_consensus.cc:385] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.456292 14849 raft_consensus.cc:740] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.457000 14849 consensus_queue.cc:260] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.459309 14849 ts_tablet_manager.cc:1434] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:06:34.460731 14849 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
W20260709 13:06:34.440685 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:34.455803 14846 raft_consensus.cc:385] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.461822 14846 raft_consensus.cc:740] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.462524 14846 consensus_queue.cc:260] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.465615 14846 ts_tablet_manager.cc:1434] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.002s
I20260709 13:06:34.466344 14849 tablet_bootstrap.cc:654] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.466845 14846 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:34.473886 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.474514 14846 tablet_bootstrap.cc:654] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.476827 14849 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:34.477268 14849 ts_tablet_manager.cc:1403] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
W20260709 13:06:34.479794 14692 leader_election.cc:343] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.480621 14849 raft_consensus.cc:359] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.487810 14849 raft_consensus.cc:385] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.488111 14849 raft_consensus.cc:740] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.487598 14973 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.492659 14973 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:34.493752 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:34.494326 14578 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.493299 14474 catalog_manager.cc:5697] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.497373 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
W20260709 13:06:34.501859 14692 leader_election.cc:343] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.495786 14474 catalog_manager.cc:5697] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.506122 15055 raft_consensus.cc:2749] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.507133 14849 consensus_queue.cc:260] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.511926 14578 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:34.513939 14691 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:34.515079 14973 raft_consensus.cc:2804] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.515545 14973 raft_consensus.cc:697] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:34.516610 14915 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.516486 15053 consensus_queue.cc:1048] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.517154 14915 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.520668 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.521293 14725 raft_consensus.cc:2468] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:34.521871 14848 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:34.522360 14848 ts_tablet_manager.cc:1403] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.024s
I20260709 13:06:34.523099 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.516342 14973 consensus_queue.cc:237] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:34.526335 14541 leader_election.cc:343] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.526957 14544 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.527913 14916 raft_consensus.cc:2804] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.528287 14916 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.528592 14916 raft_consensus.cc:3060] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.526561 14847 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:34.525650 14915 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.536209 14847 ts_tablet_manager.cc:1403] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.016s
I20260709 13:06:34.538676 14849 ts_tablet_manager.cc:1434] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 13:06:34.539651 14849 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:34.541208 14847 raft_consensus.cc:359] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.541885 14847 raft_consensus.cc:385] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.542162 14847 raft_consensus.cc:740] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.532963 14848 raft_consensus.cc:359] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.544925 14848 raft_consensus.cc:385] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.545137 14848 raft_consensus.cc:740] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.546599 14848 consensus_queue.cc:260] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.548586 14848 ts_tablet_manager.cc:1434] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 13:06:34.550129 14848 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:34.551611 14916 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.553257 14914 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.553745 14914 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.554319 14916 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.555526 14847 consensus_queue.cc:260] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.557710 14847 ts_tablet_manager.cc:1434] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:06:34.558233 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:34.558851 14847 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:34.565418 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.565834 14847 tablet_bootstrap.cc:654] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.566634 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:34.567174 14725 raft_consensus.cc:3060] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.570977 14846 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:34.571462 14846 ts_tablet_manager.cc:1403] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.022s
W20260709 13:06:34.572046 14541 leader_election.cc:343] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.555760 14914 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:34.557684 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.583257 14724 raft_consensus.cc:2393] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54b0718d36f4f72ac7cef2358fbe6b6 in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:34.584830 14767 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:34.586269 14846 raft_consensus.cc:359] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.586958 14846 raft_consensus.cc:385] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.587201 14846 raft_consensus.cc:740] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.587867 14846 consensus_queue.cc:260] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.587769 14854 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.589884 14846 ts_tablet_manager.cc:1434] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:34.590824 14846 tablet_bootstrap.cc:492] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:34.592679 14725 raft_consensus.cc:2468] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:34.594384 14544 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.595678 14916 raft_consensus.cc:2804] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.596127 14916 raft_consensus.cc:697] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:34.596892 14916 consensus_queue.cc:237] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.578299 14848 tablet_bootstrap.cc:654] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.580562 14849 tablet_bootstrap.cc:654] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.603147 14893 raft_consensus.cc:493] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.603586 14893 raft_consensus.cc:515] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.606585 14956 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.607182 14956 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.596242 14846 tablet_bootstrap.cc:654] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.610224 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.610926 14956 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.611660 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.612031 14914 raft_consensus.cc:493] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.612406 14724 raft_consensus.cc:2468] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:34.612488 14914 raft_consensus.cc:515] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:34.614157 14765 leader_election.cc:343] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.614638 14914 leader_election.cc:290] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.614823 15051 raft_consensus.cc:493] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.615413 15051 raft_consensus.cc:515] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.616109 14849 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:34.616570 14849 ts_tablet_manager.cc:1403] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.077s	user 0.004s	sys 0.010s
I20260709 13:06:34.617758 14544 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:34.619239 14849 raft_consensus.cc:359] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.619807 14915 raft_consensus.cc:2804] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.619908 14849 raft_consensus.cc:385] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.620434 14849 raft_consensus.cc:740] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.619351 14854 raft_consensus.cc:2749] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.621304 14849 consensus_queue.cc:260] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.623764 14849 ts_tablet_manager.cc:1434] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:34.623560 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.625481 14849 tablet_bootstrap.cc:492] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:34.625629 14915 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.626101 14915 raft_consensus.cc:3060] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.627349 14846 tablet_bootstrap.cc:492] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:34.627794 14846 ts_tablet_manager.cc:1403] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.006s
I20260709 13:06:34.627575 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.628474 14724 raft_consensus.cc:2468] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:34.630451 14767 leader_election.cc:304] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:34.623557 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.631542 15075 raft_consensus.cc:2804] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.631735 14849 tablet_bootstrap.cc:654] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.631929 15075 raft_consensus.cc:493] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.632284 15075 raft_consensus.cc:3060] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.631011 14846 raft_consensus.cc:359] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:34.639611 14764 leader_election.cc:343] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:34.641160 14543 leader_election.cc:343] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.644937 14973 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.645576 14973 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.647768 14973 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:34.649936 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.651216 14849 tablet_bootstrap.cc:492] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:34.651687 14849 ts_tablet_manager.cc:1403] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:06:34.652558 15051 leader_election.cc:290] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.653445 14846 raft_consensus.cc:385] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.653769 14846 raft_consensus.cc:740] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.654191 14893 leader_election.cc:290] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.653262 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.625365 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.654424 14846 consensus_queue.cc:260] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:34.655627 14619 leader_election.cc:343] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.656875 14846 ts_tablet_manager.cc:1434] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
W20260709 13:06:34.657068 14617 leader_election.cc:343] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.657603 14617 leader_election.cc:304] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:34.658041 14846 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:34.658408 15051 raft_consensus.cc:2749] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.661890 14956 consensus_queue.cc:1048] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.669013 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.670275 14916 consensus_queue.cc:1048] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.644819 15075 raft_consensus.cc:515] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.672564 14692 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:34.672559 14849 raft_consensus.cc:359] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.673475 14849 raft_consensus.cc:385] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.673751 14849 raft_consensus.cc:740] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.673872 14973 raft_consensus.cc:2749] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.674417 14849 consensus_queue.cc:260] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.674705 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:34.675300 14727 raft_consensus.cc:3060] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.676424 14849 ts_tablet_manager.cc:1434] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:06:34.676776 14653 raft_consensus.cc:3060] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.677554 14849 tablet_bootstrap.cc:492] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:34.683662 14849 tablet_bootstrap.cc:654] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.684335 14727 raft_consensus.cc:2468] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:34.684890 14916 consensus_queue.cc:1048] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.685639 14767 leader_election.cc:304] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:34.686419 14893 raft_consensus.cc:2804] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.687140 14893 raft_consensus.cc:697] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:34.688226 14893 consensus_queue.cc:237] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.691186 15075 leader_election.cc:290] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:34.695077 14846 tablet_bootstrap.cc:654] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.696653 14915 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.699776 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.702248 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:34.719475 14848 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:34.747116 14848 ts_tablet_manager.cc:1403] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.004s
I20260709 13:06:34.713280 14474 catalog_manager.cc:5697] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.728739 14916 consensus_queue.cc:1048] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:06:34.750461 14848 raft_consensus.cc:359] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.751161 14848 raft_consensus.cc:385] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:34.742302 14764 leader_election.cc:343] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.737046 14651 raft_consensus.cc:3060] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.751571 14848 raft_consensus.cc:740] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.752187 14764 leader_election.cc:304] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.752673 14848 consensus_queue.cc:260] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.753655 14854 raft_consensus.cc:2749] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.754244 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:34.754861 14800 raft_consensus.cc:3060] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.755841 14848 ts_tablet_manager.cc:1434] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:34.756662 15039 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.757119 15039 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.734158 14973 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.758388 14973 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.760082 15039 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.761684 14973 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.763182 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.764523 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.765162 14799 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:34.724048 14846 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:34.740188 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:34.766453 14543 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:34.767246 14846 ts_tablet_manager.cc:1403] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.008s
I20260709 13:06:34.722404 14472 catalog_manager.cc:5697] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.767664 14727 raft_consensus.cc:3060] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.770324 14846 raft_consensus.cc:359] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.771083 14846 raft_consensus.cc:385] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.771356 14846 raft_consensus.cc:740] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.766558 14848 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:34.766477 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:34.775085 14691 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.775871 14973 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.777891 14727 raft_consensus.cc:2468] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:34.778504 15039 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.778940 15039 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.779271 15039 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.763305 14800 raft_consensus.cc:2468] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:34.780391 14543 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:34.780737 14848 tablet_bootstrap.cc:654] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.781241 15042 raft_consensus.cc:2804] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.781730 15042 raft_consensus.cc:697] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:34.782536 15042 consensus_queue.cc:237] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.784658 14846 consensus_queue.cc:260] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.788893 14846 ts_tablet_manager.cc:1434] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:06:34.789992 14846 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:34.742868 14915 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.796290 14651 raft_consensus.cc:2468] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:34.803439 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.804919 14973 raft_consensus.cc:493] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.807005 14973 raft_consensus.cc:515] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.810098 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.810746 15039 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:34.811614 14690 leader_election.cc:343] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.813529 14973 leader_election.cc:290] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.814278 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:34.814419 14541 leader_election.cc:343] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.815342 14798 raft_consensus.cc:2468] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:34.814635 14916 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.816428 14916 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.818318 14973 raft_consensus.cc:493] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.818445 14848 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:34.818830 14973 raft_consensus.cc:515] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.819671 14692 leader_election.cc:304] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.820504 14979 raft_consensus.cc:2804] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.820889 14979 raft_consensus.cc:493] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.821239 14979 raft_consensus.cc:3060] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.821466 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:34.821717 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:34.822927 14544 leader_election.cc:343] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.822666 14973 leader_election.cc:290] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.824793 14848 ts_tablet_manager.cc:1403] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.009s
I20260709 13:06:34.824860 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.826764 14692 leader_election.cc:304] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.828070 14848 raft_consensus.cc:359] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.828720 14848 raft_consensus.cc:385] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.830123 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.828867 14979 raft_consensus.cc:515] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.829089 14916 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.828991 14848 raft_consensus.cc:740] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.830915 14798 raft_consensus.cc:2468] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:34.834138 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:34.834864 14543 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
W20260709 13:06:34.835494 14690 leader_election.cc:343] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.836416 14846 tablet_bootstrap.cc:654] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.836663 14916 raft_consensus.cc:2804] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.837093 14916 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.837555 14916 raft_consensus.cc:3060] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.833755 14848 consensus_queue.cc:260] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.840514 14848 ts_tablet_manager.cc:1434] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:06:34.841600 14848 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:34.842000 14973 raft_consensus.cc:2749] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.844570 15039 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.847013 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:34.845160 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:34.847675 14800 raft_consensus.cc:3060] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.847810 14798 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.842833 14476 catalog_manager.cc:5697] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.846732 14979 leader_election.cc:290] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.855386 14800 raft_consensus.cc:2468] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:34.856652 14692 leader_election.cc:304] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.857813 14848 tablet_bootstrap.cc:654] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.859416 14798 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:34.860486 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:34.863041 14543 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:34.864077 15039 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.864692 14979 raft_consensus.cc:2804] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.864574 15039 raft_consensus.cc:697] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:34.866451 15039 consensus_queue.cc:237] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:34.870179 14541 leader_election.cc:343] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.876688 14849 tablet_bootstrap.cc:492] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:34.877203 14849 ts_tablet_manager.cc:1403] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.200s	user 0.052s	sys 0.050s
I20260709 13:06:34.880020 14849 raft_consensus.cc:359] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.880642 14849 raft_consensus.cc:385] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.880936 14849 raft_consensus.cc:740] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.881671 14849 consensus_queue.cc:260] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.898187 14847 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:34.898821 14847 ts_tablet_manager.cc:1403] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.340s	user 0.026s	sys 0.037s
I20260709 13:06:34.901749 14848 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:34.902258 14848 ts_tablet_manager.cc:1403] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.012s
I20260709 13:06:34.912092 14849 ts_tablet_manager.cc:1434] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.004s
I20260709 13:06:34.914543 14847 raft_consensus.cc:359] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.915290 14847 raft_consensus.cc:385] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.915714 14847 raft_consensus.cc:740] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.916580 14847 consensus_queue.cc:260] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.915349 14846 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:34.923291 14846 ts_tablet_manager.cc:1403] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.005s
I20260709 13:06:34.913184 14849 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:34.926957 14846 raft_consensus.cc:359] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.927639 14846 raft_consensus.cc:385] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.927914 14846 raft_consensus.cc:740] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.928596 14846 consensus_queue.cc:260] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:34.931124 14846 ts_tablet_manager.cc:1434] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:34.932125 14846 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:34.934042 14847 ts_tablet_manager.cc:1434] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 13:06:34.935099 14847 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:34.940972 14847 tablet_bootstrap.cc:654] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.945240 14848 raft_consensus.cc:359] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.946069 14848 raft_consensus.cc:385] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.946336 14848 raft_consensus.cc:740] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.947629 15042 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.948452 15042 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:34.934070 14979 raft_consensus.cc:697] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:34.953428 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:34.932772 14916 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:34.955027 14543 leader_election.cc:343] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.956669 14916 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:34.960475 14849 tablet_bootstrap.cc:654] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.961901 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:34.962515 14800 raft_consensus.cc:3060] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:34.933640 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 50185.6us
I20260709 13:06:34.966776 14727 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.969213 14846 tablet_bootstrap.cc:654] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.954188 14979 consensus_queue.cc:237] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:34.971464 14725 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.947011 14848 consensus_queue.cc:260] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:34.978788 15042 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:34.985663 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:34.985976 14472 catalog_manager.cc:5697] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:34.987556 14541 leader_election.cc:343] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.988039 14541 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:34.989522 15042 raft_consensus.cc:2749] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.999578 14848 ts_tablet_manager.cc:1434] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 13:06:35.000404 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:34.997141 14724 raft_consensus.cc:3060] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.023344 14848 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:35.011536 14800 raft_consensus.cc:2468] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:35.027928 14847 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.028527 14543 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:35.035238 14847 ts_tablet_manager.cc:1403] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.027s
I20260709 13:06:35.035485 14916 raft_consensus.cc:2804] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.036010 14916 raft_consensus.cc:697] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:35.036818 14916 consensus_queue.cc:237] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:35.038892 14544 leader_election.cc:343] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.032938 14848 tablet_bootstrap.cc:654] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.038460 14476 catalog_manager.cc:5697] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.039316 14726 raft_consensus.cc:3060] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.046340 15051 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.046836 15051 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.050637 15051 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:35.050499 14847 raft_consensus.cc:359] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.051919 14847 raft_consensus.cc:385] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.052060 14849 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:35.052469 14847 raft_consensus.cc:740] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.052670 14849 ts_tablet_manager.cc:1403] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.022s
I20260709 13:06:35.053799 14847 consensus_queue.cc:260] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.058398 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:35.059202 14723 raft_consensus.cc:2393] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:35.060134 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.062476 15039 consensus_queue.cc:1048] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.064239 14619 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:35.065657 14847 ts_tablet_manager.cc:1434] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:06:35.066557 15051 raft_consensus.cc:3060] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.066820 14847 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.068572 14849 raft_consensus.cc:359] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.069459 14849 raft_consensus.cc:385] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.069738 14849 raft_consensus.cc:740] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.070673 14979 consensus_queue.cc:1048] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:35.070403 14849 consensus_queue.cc:260] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.078912 14847 tablet_bootstrap.cc:654] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.079190 14846 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.079897 14846 ts_tablet_manager.cc:1403] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.006s
I20260709 13:06:35.078089 15051 raft_consensus.cc:2749] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.086088 14476 catalog_manager.cc:5697] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.085209 14846 raft_consensus.cc:359] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.086006 14849 ts_tablet_manager.cc:1434] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:06:35.087497 14846 raft_consensus.cc:385] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.087859 14846 raft_consensus.cc:740] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.094254 14846 consensus_queue.cc:260] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.106135 14849 tablet_bootstrap.cc:492] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:35.107023 14893 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.107544 14893 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.111749 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.118121 14849 tablet_bootstrap.cc:654] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.119783 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:35.121994 14800 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.123075 14767 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:35.115826 14893 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.129614 14846 ts_tablet_manager.cc:1434] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:06:35.133844 14846 tablet_bootstrap.cc:492] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.136035 15075 consensus_queue.cc:1048] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.145955 15042 consensus_queue.cc:1048] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.147949 14916 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.148155 14854 raft_consensus.cc:2749] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.152921 14916 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.155020 14916 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.157182 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.157850 14798 raft_consensus.cc:2468] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:35.158645 15090 consensus_queue.cc:1048] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.160395 15075 consensus_queue.cc:1048] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.163676 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.164278 14650 raft_consensus.cc:2468] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:35.167594 14543 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:35.168473 14916 raft_consensus.cc:2804] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.168886 14916 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.169409 14916 raft_consensus.cc:3060] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.180657 14847 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.180279 14476 catalog_manager.cc:5697] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.181152 14847 ts_tablet_manager.cc:1403] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.014s
I20260709 13:06:35.187209 14847 raft_consensus.cc:359] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.187713 14847 raft_consensus.cc:385] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.187888 14847 raft_consensus.cc:740] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.188406 14847 consensus_queue.cc:260] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.193813 14847 ts_tablet_manager.cc:1434] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:06:35.194186 14846 tablet_bootstrap.cc:654] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.203006 14916 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.205971 14916 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.209152 14848 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:35.217818 14848 ts_tablet_manager.cc:1403] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.195s	user 0.009s	sys 0.008s
I20260709 13:06:35.220520 14848 raft_consensus.cc:359] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.209189 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:35.221670 14653 raft_consensus.cc:3060] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.210882 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:35.225140 14800 raft_consensus.cc:3060] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.221160 14848 raft_consensus.cc:385] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.229593 14848 raft_consensus.cc:740] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.230335 14848 consensus_queue.cc:260] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.232264 15090 raft_consensus.cc:493] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.233004 15090 raft_consensus.cc:515] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.236522 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.237193 14650 raft_consensus.cc:2468] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:35.238626 14690 leader_election.cc:304] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.239401 14800 raft_consensus.cc:2468] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:35.239877 15093 raft_consensus.cc:2804] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.240257 15093 raft_consensus.cc:493] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.240584 14543 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:35.241058 14893 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.241387 14849 tablet_bootstrap.cc:492] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:35.241477 14915 raft_consensus.cc:2804] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.241858 14849 ts_tablet_manager.cc:1403] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.007s
I20260709 13:06:35.232569 14848 ts_tablet_manager.cc:1434] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:06:35.242022 14915 raft_consensus.cc:697] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:35.243193 14848 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:35.243053 14915 consensus_queue.cc:237] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.244434 14849 raft_consensus.cc:359] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.245060 14849 raft_consensus.cc:385] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.242058 14653 raft_consensus.cc:2468] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:35.240566 15093 raft_consensus.cc:3060] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.249578 15039 consensus_queue.cc:1048] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.245302 14849 raft_consensus.cc:740] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.250638 14849 consensus_queue.cc:260] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.253262 15090 leader_election.cc:290] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.241559 14893 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.253875 14849 ts_tablet_manager.cc:1434] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:35.257468 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:35.258873 14767 leader_election.cc:343] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.261749 14893 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.265642 15093 raft_consensus.cc:515] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.269268 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.269953 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.276933 14578 raft_consensus.cc:2468] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:35.270396 14847 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.278501 15090 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.278980 15090 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:35.280838 14765 leader_election.cc:343] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.280859 14849 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:35.281311 14765 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:35.281800 15090 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.282514 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:35.283697 14690 leader_election.cc:343] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.286294 15093 leader_election.cc:290] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.289469 14893 raft_consensus.cc:2749] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.291085 14847 tablet_bootstrap.cc:654] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.291472 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.292109 14799 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:35.293315 14692 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:35.294039 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:35.294543 15093 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.295152 15093 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.295629 15093 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.296504 14846 tablet_bootstrap.cc:492] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.296955 14846 ts_tablet_manager.cc:1403] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.163s	user 0.010s	sys 0.013s
I20260709 13:06:35.299712 14846 raft_consensus.cc:359] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.300365 14846 raft_consensus.cc:385] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.300616 14846 raft_consensus.cc:740] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.301406 14846 consensus_queue.cc:260] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.294617 14650 raft_consensus.cc:3060] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.303876 14846 ts_tablet_manager.cc:1434] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:35.305240 14846 tablet_bootstrap.cc:492] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.308638 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:35.309374 14578 raft_consensus.cc:3060] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.318753 14846 tablet_bootstrap.cc:654] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.319207 14956 consensus_queue.cc:1048] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.301859 14849 tablet_bootstrap.cc:654] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.325490 15093 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.329448 14578 raft_consensus.cc:2468] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:35.329795 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:35.330340 14474 catalog_manager.cc:5697] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:35.331092 14690 leader_election.cc:343] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.333441 15093 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.333719 14927 raft_consensus.cc:493] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.334194 14927 raft_consensus.cc:515] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.335892 14846 tablet_bootstrap.cc:492] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.336360 14846 ts_tablet_manager.cc:1403] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 13:06:35.336277 14927 leader_election.cc:290] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.331537 14650 raft_consensus.cc:2468] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:35.338164 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:35.339318 14690 leader_election.cc:304] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.339331 14846 raft_consensus.cc:359] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.340175 14846 raft_consensus.cc:385] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.340214 15093 raft_consensus.cc:2804] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.340533 14846 raft_consensus.cc:740] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.334161 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:35.340497 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.341499 14846 consensus_queue.cc:260] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.348773 14847 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.359645 14847 ts_tablet_manager.cc:1403] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.005s
I20260709 13:06:35.362280 14847 raft_consensus.cc:359] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.364109 14847 raft_consensus.cc:385] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.364432 14847 raft_consensus.cc:740] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.365052 14847 consensus_queue.cc:260] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.365779 14800 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.358650 14846 ts_tablet_manager.cc:1434] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:06:35.367429 14846 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.368602 14847 ts_tablet_manager.cc:1434] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:35.341115 15093 raft_consensus.cc:697] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:35.369771 14847 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.371099 14798 raft_consensus.cc:2393] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:35.372191 14618 leader_election.cc:304] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:35.372886 14846 tablet_bootstrap.cc:654] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.374329 14927 raft_consensus.cc:3060] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.378971 14847 tablet_bootstrap.cc:654] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.386751 14849 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:35.392431 14849 ts_tablet_manager.cc:1403] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.002s
W20260709 13:06:35.392588 14541 consensus_peers.cc:597] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.394131 14927 raft_consensus.cc:2749] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.396847 14849 raft_consensus.cc:359] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.399659 14849 raft_consensus.cc:385] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.399968 14849 raft_consensus.cc:740] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.401139 14849 consensus_queue.cc:260] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.370009 15093 consensus_queue.cc:237] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.404709 15090 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.405170 15090 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.405763 14848 tablet_bootstrap.cc:654] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.406417 14849 ts_tablet_manager.cc:1434] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:35.408460 14847 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.409073 14847 ts_tablet_manager.cc:1403] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 13:06:35.412984 14849 tablet_bootstrap.cc:492] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:35.410104 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.416078 14800 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
W20260709 13:06:35.416847 14691 leader_election.cc:343] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.411990 14847 raft_consensus.cc:359] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.418386 14692 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:35.421077 14979 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.421578 14979 raft_consensus.cc:697] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:35.422475 14979 consensus_queue.cc:237] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.410508 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.407262 15090 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.432255 14846 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.432859 14846 ts_tablet_manager.cc:1403] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.016s
I20260709 13:06:35.432919 14847 raft_consensus.cc:385] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.434239 14847 raft_consensus.cc:740] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.437705 14847 consensus_queue.cc:260] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.443841 14847 ts_tablet_manager.cc:1434] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:06:35.451809 14916 consensus_queue.cc:1048] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:35.451804 14927 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.451275 14846 raft_consensus.cc:359] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.454468 14846 raft_consensus.cc:385] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.454401 14927 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.454839 14846 raft_consensus.cc:740] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.459203 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:35.460592 14618 leader_election.cc:343] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.462996 14849 tablet_bootstrap.cc:654] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.465734 14846 consensus_queue.cc:260] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.467782 14848 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:35.468344 14848 ts_tablet_manager.cc:1403] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.226s	user 0.009s	sys 0.029s
I20260709 13:06:35.470227 14846 ts_tablet_manager.cc:1434] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:06:35.472991 14848 raft_consensus.cc:359] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.473687 14848 raft_consensus.cc:385] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.473933 14848 raft_consensus.cc:740] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.476001 14846 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.475885 14927 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.482196 14846 tablet_bootstrap.cc:654] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.473865 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.482959 14578 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:35.474686 14848 consensus_queue.cc:260] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.483752 14893 raft_consensus.cc:493] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.484138 14617 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:35.484157 14893 raft_consensus.cc:515] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.482227 14916 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.485884 14916 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.486510 14893 leader_election.cc:290] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.488485 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:35.488819 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.490051 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.490331 14578 raft_consensus.cc:2468] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:35.490804 14848 ts_tablet_manager.cc:1434] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:06:35.490726 14649 raft_consensus.cc:2468] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:35.491792 14847 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.492030 14541 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.487568 14916 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:35.492901 14915 raft_consensus.cc:2804] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.491914 14848 tablet_bootstrap.cc:492] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:35.493673 14915 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.494052 14915 raft_consensus.cc:3060] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:35.490042 14767 leader_election.cc:343] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:35.498131 14690 leader_election.cc:343] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.498544 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:35.496711 14473 catalog_manager.cc:5697] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.499125 14765 leader_election.cc:304] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
W20260709 13:06:35.499876 14544 leader_election.cc:343] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.500281 14893 raft_consensus.cc:2804] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.500746 14893 raft_consensus.cc:493] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.501086 14893 raft_consensus.cc:3060] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.499925 14848 tablet_bootstrap.cc:654] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.498617 14690 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:35.503254 15051 raft_consensus.cc:493] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.485365 14927 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.503319 15090 raft_consensus.cc:2749] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.504094 15051 raft_consensus.cc:515] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:35.504771 14544 consensus_peers.cc:597] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.506187 15051 leader_election.cc:290] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.508877 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.511523 15042 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.511891 14618 leader_election.cc:343] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.509192 14916 consensus_queue.cc:1048] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.512007 15042 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.509698 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:35.514186 14619 leader_election.cc:343] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.514663 14619 leader_election.cc:304] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:35.517546 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.515722 15051 raft_consensus.cc:2749] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.503870 14927 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.518266 14649 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:35.518740 14927 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.519923 14541 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.520814 14916 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.521152 14916 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.521449 14916 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.514129 15042 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:35.530666 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:35.540401 15090 consensus_queue.cc:1048] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.550187 14916 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.550704 14473 catalog_manager.cc:5697] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.555219 14916 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:35.564342 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:35.566771 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:35.567386 14650 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.574306 14893 raft_consensus.cc:515] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.575861 14846 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.576529 14846 ts_tablet_manager.cc:1403] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.011s
I20260709 13:06:35.577137 14893 leader_election.cc:290] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.580729 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:35.577430 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:35.581624 14578 raft_consensus.cc:3060] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:35.582518 14767 leader_election.cc:343] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.594532 14979 consensus_queue.cc:1048] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.569252 14927 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.602931 14847 tablet_bootstrap.cc:654] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.577780 14915 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.616775 14650 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:06:35.618423 14541 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:35.603056 14578 raft_consensus.cc:2468] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:35.619521 14928 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.625905 14928 raft_consensus.cc:697] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:35.628232 14846 raft_consensus.cc:359] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.628777 14846 raft_consensus.cc:385] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.628975 14846 raft_consensus.cc:740] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.632094 14765 leader_election.cc:304] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:35.633239 15075 raft_consensus.cc:2804] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.633734 15075 raft_consensus.cc:697] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:35.634749 15075 consensus_queue.cc:237] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.637883 14893 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.642060 14893 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.644096 14893 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.645164 14915 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:35.626809 14928 consensus_queue.cc:237] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.646849 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:35.648576 14764 leader_election.cc:343] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.652444 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:35.653136 14849 tablet_bootstrap.cc:492] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:35.653730 14849 ts_tablet_manager.cc:1403] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.008s
W20260709 13:06:35.654552 14544 leader_election.cc:343] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.658043 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:35.658958 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:35.659614 14650 raft_consensus.cc:3060] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.662204 14927 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.657066 14849 raft_consensus.cc:359] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.664925 14849 raft_consensus.cc:385] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.665205 14849 raft_consensus.cc:740] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.665983 14849 consensus_queue.cc:260] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:35.662467 14618 leader_election.cc:343] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.667371 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:35.667953 14577 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.668108 14849 ts_tablet_manager.cc:1434] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:06:35.656562 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.676311 14848 tablet_bootstrap.cc:492] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:35.676895 14848 ts_tablet_manager.cc:1403] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.006s
I20260709 13:06:35.648674 14846 consensus_queue.cc:260] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.679819 14849 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:35.682698 14848 raft_consensus.cc:359] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.683384 14848 raft_consensus.cc:385] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.683633 14848 raft_consensus.cc:740] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.684540 14848 consensus_queue.cc:260] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:35.697443 14765 leader_election.cc:343] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.697958 14765 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:35.698912 14577 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:35.700654 14846 ts_tablet_manager.cc:1434] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260709 13:06:35.701687 14847 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.702214 14847 ts_tablet_manager.cc:1403] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.005s
I20260709 13:06:35.702824 14617 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:35.704792 15051 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.704939 14847 raft_consensus.cc:359] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.705672 14847 raft_consensus.cc:385] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.705936 14847 raft_consensus.cc:740] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.706408 14893 raft_consensus.cc:2749] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.701715 14846 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.706743 14847 consensus_queue.cc:260] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.708182 14848 ts_tablet_manager.cc:1434] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:06:35.711809 14650 raft_consensus.cc:2468] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:35.712747 15051 raft_consensus.cc:697] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:35.712775 14541 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:35.713697 15051 consensus_queue.cc:237] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.716284 14916 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.716714 14916 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.719080 14847 ts_tablet_manager.cc:1434] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:35.720098 14847 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.730499 14916 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.730944 14928 raft_consensus.cc:2804] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:35.743446 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:35.740331 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.738672 14928 raft_consensus.cc:697] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:35.737957 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:35.753479 14543 leader_election.cc:343] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:35.755330 14544 leader_election.cc:343] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.755805 14544 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:35.734201 14848 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:35.757055 14956 raft_consensus.cc:2749] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.741200 14474 catalog_manager.cc:5697] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.738747 14915 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.758244 14915 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.760113 14915 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.761668 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.755553 14928 consensus_queue.cc:237] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.762471 14848 tablet_bootstrap.cc:654] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:35.763051 14541 leader_election.cc:343] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.757717 14846 tablet_bootstrap.cc:654] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.762053 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.765300 14847 tablet_bootstrap.cc:654] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:35.766065 14543 leader_election.cc:343] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:35.767347 14543 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:35.767956 14849 tablet_bootstrap.cc:654] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.767664 14473 catalog_manager.cc:5697] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.774119 15090 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:35.774909 15090 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.778502 15090 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:35.773533 14915 raft_consensus.cc:2749] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:35.786548 14848 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:35.787037 14848 ts_tablet_manager.cc:1403] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.005s
I20260709 13:06:35.788054 14476 catalog_manager.cc:5697] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.789687 14848 raft_consensus.cc:359] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.790377 14848 raft_consensus.cc:385] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.790658 14848 raft_consensus.cc:740] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.793290 14847 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.793447 14846 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.793932 14847 ts_tablet_manager.cc:1403] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.074s	user 0.004s	sys 0.014s
I20260709 13:06:35.794080 14846 ts_tablet_manager.cc:1403] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.007s
I20260709 13:06:35.794584 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.796728 14846 raft_consensus.cc:359] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.797389 14846 raft_consensus.cc:385] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.797649 14846 raft_consensus.cc:740] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.798358 14847 raft_consensus.cc:359] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.800143 14847 raft_consensus.cc:385] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.800539 14847 raft_consensus.cc:740] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.801239 14847 consensus_queue.cc:260] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:35.803514 14847 ts_tablet_manager.cc:1434] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:35.805469 14847 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.803963 14848 consensus_queue.cc:260] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.807574 14846 consensus_queue.cc:260] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.810036 14846 ts_tablet_manager.cc:1434] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:06:35.812994 14847 tablet_bootstrap.cc:654] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.807513 14848 ts_tablet_manager.cc:1434] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 13:06:35.814266 14848 tablet_bootstrap.cc:492] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:35.814863 14846 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.820056 14846 tablet_bootstrap.cc:654] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.820715 14848 tablet_bootstrap.cc:654] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:35.824283 14690 consensus_peers.cc:597] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.826599 15090 raft_consensus.cc:493] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.827250 15090 raft_consensus.cc:515] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.834538 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.835219 14649 raft_consensus.cc:2468] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:35.836475 14690 leader_election.cc:304] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.837301 14973 raft_consensus.cc:2804] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.837726 14973 raft_consensus.cc:493] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.838060 14973 raft_consensus.cc:3060] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.843818 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.844579 14798 raft_consensus.cc:2468] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:35.847553 14973 raft_consensus.cc:515] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.876933 14973 leader_election.cc:290] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.794668 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:35.878350 14650 raft_consensus.cc:2368] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3.
I20260709 13:06:35.880517 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:35.881385 14798 raft_consensus.cc:3060] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:35.884768 15138 log.cc:927] Time spent T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:06:35.889030 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 52638us
I20260709 13:06:35.892531 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:35.893149 14650 raft_consensus.cc:3060] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.895598 14956 consensus_queue.cc:1048] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.900378 14690 leader_election.cc:400] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Vote denied by peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167) with higher term. Message: Invalid argument: T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3.
I20260709 13:06:35.901515 15123 consensus_queue.cc:1048] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.903766 15090 leader_election.cc:290] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:35.904644 14690 leader_election.cc:403] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.905893 15123 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.908166 14849 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:35.908690 14849 ts_tablet_manager.cc:1403] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.240s	user 0.017s	sys 0.006s
I20260709 13:06:35.911679 14849 raft_consensus.cc:359] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:35.912318 14849 raft_consensus.cc:385] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.912604 14849 raft_consensus.cc:740] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.913757 15123 raft_consensus.cc:2749] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167) with higher term. Message: Invalid argument: T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3.
I20260709 13:06:35.912400 14973 consensus_queue.cc:1048] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:35.925540 14847 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:35.926030 14847 ts_tablet_manager.cc:1403] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.121s	user 0.023s	sys 0.025s
I20260709 13:06:35.928331 14846 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:35.928884 14847 raft_consensus.cc:359] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.929653 14847 raft_consensus.cc:385] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.929912 14847 raft_consensus.cc:740] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.928915 14846 ts_tablet_manager.cc:1403] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.023s
I20260709 13:06:35.931964 14650 raft_consensus.cc:2468] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:35.933861 14846 raft_consensus.cc:359] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.934237 14690 leader_election.cc:304] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.934789 14915 consensus_queue.cc:1048] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.934988 14847 consensus_queue.cc:260] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.935359 15090 raft_consensus.cc:2804] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:35.936506 15090 raft_consensus.cc:697] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:35.938028 15090 consensus_queue.cc:237] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.934566 14846 raft_consensus.cc:385] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.939728 14846 raft_consensus.cc:740] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.942150 14846 consensus_queue.cc:260] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:35.934707 14543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 62635.4us
I20260709 13:06:35.946765 14847 ts_tablet_manager.cc:1434] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:35.948319 14847 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:35.950459 14650 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.947309 14846 ts_tablet_manager.cc:1434] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:06:35.952857 14846 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:35.961014 14848 tablet_bootstrap.cc:492] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:35.961526 14848 ts_tablet_manager.cc:1403] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.029s
I20260709 13:06:35.962917 14798 raft_consensus.cc:2468] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:35.966822 14847 tablet_bootstrap.cc:654] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.967643 14846 tablet_bootstrap.cc:654] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:35.971622 14476 catalog_manager.cc:5697] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.982184 15051 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.982769 15051 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:35.983974 14848 raft_consensus.cc:359] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:35.984622 14848 raft_consensus.cc:385] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:35.984870 14848 raft_consensus.cc:740] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:35.986579 15051 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:35.988256 14574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:35.988988 14574 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:35.989974 14617 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:35.990756 15051 raft_consensus.cc:2804] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:35.990931 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:35.991180 15051 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.991546 14797 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:35.991632 15051 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:35.995113 14848 consensus_queue.cc:260] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.000023 15124 consensus_queue.cc:1048] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.997258 14848 ts_tablet_manager.cc:1434] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.001s
I20260709 13:06:36.007143 14846 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:36.007647 14846 ts_tablet_manager.cc:1403] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.008s
I20260709 13:06:36.010540 14848 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:36.013181 14846 raft_consensus.cc:359] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.013821 14846 raft_consensus.cc:385] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.014088 14846 raft_consensus.cc:740] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.021723 14848 tablet_bootstrap.cc:654] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.030128 15051 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.030897 14849 consensus_queue.cc:260] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.048393 14848 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:36.048898 14848 ts_tablet_manager.cc:1403] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.003s
I20260709 13:06:36.049162 14849 ts_tablet_manager.cc:1434] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.000s
I20260709 13:06:36.050160 14849 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:36.014771 14846 consensus_queue.cc:260] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.053573 14846 ts_tablet_manager.cc:1434] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260709 13:06:36.053292 14848 raft_consensus.cc:359] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.053977 14848 raft_consensus.cc:385] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.054250 14848 raft_consensus.cc:740] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.054581 14846 tablet_bootstrap.cc:492] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:36.055008 14848 consensus_queue.cc:260] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.043433 14474 catalog_manager.cc:5697] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.045955 15075 consensus_queue.cc:1048] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.057058 14848 ts_tablet_manager.cc:1434] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:36.058264 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:36.058939 14799 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.060671 15051 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:36.070022 14848 tablet_bootstrap.cc:492] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:36.086687 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:36.087319 14848 tablet_bootstrap.cc:654] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.087461 14576 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.100608 14849 tablet_bootstrap.cc:654] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.101716 14726 raft_consensus.cc:3060] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.107831 14847 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.125588 14847 ts_tablet_manager.cc:1403] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.012s
I20260709 13:06:36.128072 14847 raft_consensus.cc:359] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.128697 14847 raft_consensus.cc:385] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.128950 14847 raft_consensus.cc:740] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.111490 14800 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.129491 14847 consensus_queue.cc:260] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.133976 14847 ts_tablet_manager.cc:1434] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:36.134934 14847 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.137487 15051 raft_consensus.cc:493] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.138010 15051 raft_consensus.cc:515] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.139511 14847 tablet_bootstrap.cc:654] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.140064 15051 leader_election.cc:290] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:36.142068 14928 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.142525 14928 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.145035 14576 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:36.119702 14848 tablet_bootstrap.cc:492] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:36.146701 14848 ts_tablet_manager.cc:1403] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.005s
I20260709 13:06:36.147048 15051 consensus_queue.cc:1048] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.148855 14617 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:36.150012 14650 raft_consensus.cc:1275] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:36.123852 14846 tablet_bootstrap.cc:654] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.146903 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:36.158011 14619 leader_election.cc:343] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.156530 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:36.156697 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:36.156735 14893 consensus_queue.cc:1048] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:36.157060 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:36.162925 14544 leader_election.cc:343] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:36.163594 14541 leader_election.cc:343] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.157613 14956 consensus_queue.cc:1048] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:36.163172 14576 raft_consensus.cc:2468] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:36.153640 15132 raft_consensus.cc:2804] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.167624 15132 raft_consensus.cc:697] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:36.168437 15132 consensus_queue.cc:237] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.171849 14916 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.172346 14916 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.174090 14916 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:36.156368 14928 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:36.178570 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:36.180521 14543 leader_election.cc:343] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.153152 14848 raft_consensus.cc:359] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.155560 14799 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:36.164989 14541 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:36.182539 14848 raft_consensus.cc:385] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.184505 14848 raft_consensus.cc:740] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.184744 14928 raft_consensus.cc:2749] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:36.186633 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:36.187186 14617 leader_election.cc:304] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:36.188035 15132 raft_consensus.cc:2804] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:36.188370 15132 raft_consensus.cc:493] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.188678 15132 raft_consensus.cc:3060] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.198235 14848 consensus_queue.cc:260] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:36.202605 14541 leader_election.cc:343] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.203115 14541 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:36.203814 14916 raft_consensus.cc:2749] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:36.205278 14848 ts_tablet_manager.cc:1434] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:06:36.206336 14848 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:36.208041 15051 consensus_queue.cc:1048] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.203852 14846 tablet_bootstrap.cc:492] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:36.212862 14722 raft_consensus.cc:1275] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:36.214069 14846 ts_tablet_manager.cc:1403] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.160s	user 0.009s	sys 0.003s
I20260709 13:06:36.216807 14846 raft_consensus.cc:359] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.217365 14915 consensus_queue.cc:1048] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.233031 14846 raft_consensus.cc:385] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.233361 14846 raft_consensus.cc:740] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.235556 14846 consensus_queue.cc:260] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.217952 14916 consensus_queue.cc:1048] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:36.220767 15051 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.238722 15051 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.243489 15051 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:36.243958 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:36.223620 15132 raft_consensus.cc:515] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.230111 14849 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:36.270818 14849 ts_tablet_manager.cc:1403] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.221s	user 0.012s	sys 0.001s
I20260709 13:06:36.252904 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:36.272921 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:36.252545 14798 raft_consensus.cc:2468] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
W20260709 13:06:36.274308 14619 leader_election.cc:343] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.274677 14849 raft_consensus.cc:359] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.275379 14849 raft_consensus.cc:385] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.275667 14849 raft_consensus.cc:740] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.276237 15132 leader_election.cc:290] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:36.275782 14618 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
W20260709 13:06:36.279137 14617 leader_election.cc:343] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.276470 14849 consensus_queue.cc:260] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.280129 15132 raft_consensus.cc:2804] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:36.280515 15132 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.280848 15132 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.281446 14849 ts_tablet_manager.cc:1434] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:06:36.282413 14849 tablet_bootstrap.cc:492] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:36.287933 14849 tablet_bootstrap.cc:654] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:36.290130 14544 consensus_peers.cc:597] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.291971 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:36.293072 14578 raft_consensus.cc:3060] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.259194 14476 catalog_manager.cc:5697] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.254417 14847 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.267184 14846 ts_tablet_manager.cc:1434] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:06:36.298470 14847 ts_tablet_manager.cc:1403] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.164s	user 0.009s	sys 0.000s
I20260709 13:06:36.299093 14846 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:36.287940 15132 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.301223 15132 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:36.302090 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:36.301232 14847 raft_consensus.cc:359] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.302655 14847 raft_consensus.cc:385] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.302691 14798 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.303050 14847 raft_consensus.cc:740] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.303495 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:36.303829 14847 consensus_queue.cc:260] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:36.304818 14617 leader_election.cc:343] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.305147 14846 tablet_bootstrap.cc:654] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.269318 14848 tablet_bootstrap.cc:654] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.305919 14847 ts_tablet_manager.cc:1434] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:06:36.311928 14847 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.314543 14578 raft_consensus.cc:2468] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:36.315702 14617 leader_election.cc:304] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:36.317106 15132 raft_consensus.cc:2804] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.319494 15132 raft_consensus.cc:697] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:36.320528 15132 consensus_queue.cc:237] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:36.328008 14798 raft_consensus.cc:2468] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:36.329228 14618 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:36.330441 15051 raft_consensus.cc:2804] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.331085 15051 raft_consensus.cc:697] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:36.331990 15051 consensus_queue.cc:237] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.336545 15132 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.337101 15132 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.340009 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:36.347205 14847 tablet_bootstrap.cc:654] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.350430 14846 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:36.351073 14846 ts_tablet_manager.cc:1403] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:06:36.353506 15132 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:36.355243 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:36.357012 14618 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:36.358335 15132 raft_consensus.cc:2749] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:36.359103 14848 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:36.359599 14848 ts_tablet_manager.cc:1403] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.000s
I20260709 13:06:36.358614 14846 raft_consensus.cc:359] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.360034 14846 raft_consensus.cc:385] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.360317 14846 raft_consensus.cc:740] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.361002 14846 consensus_queue.cc:260] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.362229 14848 raft_consensus.cc:359] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.355369 14472 catalog_manager.cc:5697] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.362887 14848 raft_consensus.cc:385] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.363052 14846 ts_tablet_manager.cc:1434] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:36.365115 14846 tablet_bootstrap.cc:492] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:36.365237 14849 tablet_bootstrap.cc:492] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:36.365690 14849 ts_tablet_manager.cc:1403] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:06:36.368227 14849 raft_consensus.cc:359] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.369452 14849 raft_consensus.cc:385] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.369706 14849 raft_consensus.cc:740] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.370415 14848 raft_consensus.cc:740] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.371141 14846 tablet_bootstrap.cc:654] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.371223 14848 consensus_queue.cc:260] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.375655 14847 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.376112 14847 ts_tablet_manager.cc:1403] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.002s
I20260709 13:06:36.378635 14847 raft_consensus.cc:359] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.379266 14847 raft_consensus.cc:385] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.379511 14847 raft_consensus.cc:740] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.380071 14847 consensus_queue.cc:260] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.385407 14847 ts_tablet_manager.cc:1434] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:36.386520 14847 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.397137 14848 ts_tablet_manager.cc:1434] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:06:36.399215 14473 catalog_manager.cc:5697] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.406868 14847 tablet_bootstrap.cc:654] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.408522 14651 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.421121 14847 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.421659 14847 ts_tablet_manager.cc:1403] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.005s
I20260709 13:06:36.424712 14848 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:36.424472 14847 raft_consensus.cc:359] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.425319 14849 consensus_queue.cc:260] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.434312 14847 raft_consensus.cc:385] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.434857 14847 raft_consensus.cc:740] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.435467 14893 raft_consensus.cc:493] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.435810 14847 consensus_queue.cc:260] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.436134 14893 raft_consensus.cc:515] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.438063 14847 ts_tablet_manager.cc:1434] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:06:36.439098 14847 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.440403 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:36.441200 14722 raft_consensus.cc:2468] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:36.442580 14767 leader_election.cc:304] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:36.443421 14854 raft_consensus.cc:493] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.443843 14854 raft_consensus.cc:515] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.444591 14847 tablet_bootstrap.cc:654] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.446312 15075 raft_consensus.cc:2804] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:36.446774 15075 raft_consensus.cc:493] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.447098 15075 raft_consensus.cc:3060] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.454519 14854 leader_election.cc:290] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:36.460116 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:36.460832 14650 raft_consensus.cc:2468] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:36.465009 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:36.468291 14764 leader_election.cc:304] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:36.469631 14893 leader_election.cc:290] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:36.470342 14893 raft_consensus.cc:2804] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:36.470777 14893 raft_consensus.cc:493] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.471158 14893 raft_consensus.cc:3060] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.484647 14854 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.488245 14847 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.488760 14847 ts_tablet_manager.cc:1403] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.008s
I20260709 13:06:36.488387 14854 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.490906 14854 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
W20260709 13:06:36.485833 14764 leader_election.cc:343] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.492065 14847 raft_consensus.cc:359] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.494415 14847 raft_consensus.cc:385] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.494697 14847 raft_consensus.cc:740] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.495324 14847 consensus_queue.cc:260] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.497449 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:36.571254 14847 ts_tablet_manager.cc:1434] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.082s	user 0.020s	sys 0.027s
I20260709 13:06:36.573197 14847 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.580439 14847 tablet_bootstrap.cc:654] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.589685 14847 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.590142 14847 ts_tablet_manager.cc:1403] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 13:06:36.592998 14847 raft_consensus.cc:359] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.593776 14847 raft_consensus.cc:385] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.594033 14847 raft_consensus.cc:740] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.493405 15075 raft_consensus.cc:515] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.601692 14847 consensus_queue.cc:260] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.603018 15075 leader_election.cc:290] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
W20260709 13:06:36.592896 14764 leader_election.cc:343] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.607329 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:36.603243 14847 ts_tablet_manager.cc:1434] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:06:36.612344 15124 raft_consensus.cc:493] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.612978 15124 raft_consensus.cc:515] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.614621 14847 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.615058 15124 leader_election.cc:290] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:36.620961 14847 tablet_bootstrap.cc:654] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.622488 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:36.626448 14800 raft_consensus.cc:2468] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:36.622754 14849 ts_tablet_manager.cc:1434] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.257s	user 0.005s	sys 0.002s
W20260709 13:06:36.623097 14764 leader_election.cc:343] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.638789 14692 leader_election.cc:304] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:36.639782 15090 consensus_queue.cc:1048] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.641264 15090 raft_consensus.cc:2804] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:36.641634 15090 raft_consensus.cc:493] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.641950 15090 raft_consensus.cc:3060] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.649263 14848 tablet_bootstrap.cc:654] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.653793 14893 raft_consensus.cc:515] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.656437 14893 leader_election.cc:290] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:36.657369 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:36.657975 14649 raft_consensus.cc:3060] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.658960 14574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:36.659616 14574 raft_consensus.cc:3060] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.662179 14916 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.662669 14916 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.663038 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:36.670270 14849 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:36.671880 15042 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.672364 15042 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.673550 14915 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.674294 15042 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:36.674059 14915 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.676621 14915 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:36.678709 14916 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:36.687140 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:36.689167 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:36.690668 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:36.693810 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:36.697178 14543 leader_election.cc:343] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:36.697814 14541 leader_election.cc:343] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.701038 14541 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:36.701614 14916 raft_consensus.cc:2749] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:36.704798 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:36.705638 14799 raft_consensus.cc:2393] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 1: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
W20260709 13:06:36.705753 14691 leader_election.cc:343] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.708072 14543 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:36.710602 15042 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.679672 15090 raft_consensus.cc:515] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.703482 15124 consensus_queue.cc:1048] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:36.717633 14847 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:36.703685 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:36.718137 14847 ts_tablet_manager.cc:1403] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.054s
I20260709 13:06:36.718300 14798 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:36.719977 14849 tablet_bootstrap.cc:654] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.720611 15042 raft_consensus.cc:2749] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:36.722368 14846 tablet_bootstrap.cc:492] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:36.722851 14846 ts_tablet_manager.cc:1403] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.359s	user 0.095s	sys 0.162s
I20260709 13:06:36.723102 14543 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
W20260709 13:06:36.724080 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 281565us
I20260709 13:06:36.724510 14574 raft_consensus.cc:2468] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:36.727794 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:36.731480 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:36.731942 14846 raft_consensus.cc:359] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.732674 14846 raft_consensus.cc:385] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.732971 14846 raft_consensus.cc:740] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.733520 15042 raft_consensus.cc:2804] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:36.733907 15042 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.734063 14765 leader_election.cc:304] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:36.734190 15051 consensus_queue.cc:1048] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.734642 14846 consensus_queue.cc:260] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.736771 14846 ts_tablet_manager.cc:1434] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:36.737736 14846 tablet_bootstrap.cc:492] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:36.732570 14725 raft_consensus.cc:3060] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.734244 15042 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.749552 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:36.750406 14801 raft_consensus.cc:3060] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.743942 14893 raft_consensus.cc:2804] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.753268 14847 raft_consensus.cc:359] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.754046 14847 raft_consensus.cc:385] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.754271 14847 raft_consensus.cc:740] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.754843 14847 consensus_queue.cc:260] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.760593 15133 consensus_queue.cc:1048] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.762638 15090 leader_election.cc:290] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:36.762938 14847 ts_tablet_manager.cc:1434] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:06:36.768213 14849 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:36.768661 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:36.764515 14893 raft_consensus.cc:697] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:36.774158 14893 consensus_queue.cc:237] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.778162 14649 raft_consensus.cc:2468] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
W20260709 13:06:36.785923 14619 consensus_peers.cc:597] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.786669 14846 tablet_bootstrap.cc:654] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:36.789750 15042 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.791857 15042 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:36.796243 14849 ts_tablet_manager.cc:1403] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.004s
I20260709 13:06:36.813584 14848 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:36.814124 14848 ts_tablet_manager.cc:1403] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.390s	user 0.012s	sys 0.022s
I20260709 13:06:36.817173 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:36.817806 14798 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.819882 14848 raft_consensus.cc:359] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.820603 14848 raft_consensus.cc:385] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.820714 15133 consensus_queue.cc:1048] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.824913 14725 raft_consensus.cc:2468] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:36.825512 14848 raft_consensus.cc:740] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
W20260709 13:06:36.800519 14767 leader_election.cc:343] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.826537 14847 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:36.827394 14767 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:36.828413 14801 raft_consensus.cc:2468] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:36.831030 14854 raft_consensus.cc:2749] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:36.832024 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 63878.7us
I20260709 13:06:36.826100 14848 consensus_queue.cc:260] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:36.850495 14692 leader_election.cc:304] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:36.851696 15123 raft_consensus.cc:2804] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.852154 15123 raft_consensus.cc:697] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:36.852905 15123 consensus_queue.cc:237] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.854349 14472 catalog_manager.cc:5697] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.862821 14848 ts_tablet_manager.cc:1434] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.002s
W20260709 13:06:36.871079 15185 log.cc:927] Time spent T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:36.877638 14848 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:36.883322 14846 tablet_bootstrap.cc:492] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:36.895520 14846 ts_tablet_manager.cc:1403] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.158s	user 0.015s	sys 0.000s
I20260709 13:06:36.895944 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:36.885046 15051 consensus_queue.cc:1048] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:06:36.897334 14544 leader_election.cc:343] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.897758 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:36.899259 14576 raft_consensus.cc:3060] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:36.901078 14846 raft_consensus.cc:359] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.901806 14846 raft_consensus.cc:385] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.902125 14846 raft_consensus.cc:740] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.902901 14846 consensus_queue.cc:260] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.909947 14472 catalog_manager.cc:5697] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.913288 14846 ts_tablet_manager.cc:1434] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:36.914369 14846 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:36.880185 14849 raft_consensus.cc:359] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:36.923534 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:36.925431 14849 raft_consensus.cc:385] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:36.925794 14849 raft_consensus.cc:740] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:36.889170 14798 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:36.946074 14543 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:36.946965 14767 leader_election.cc:304] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:36.948781 15042 raft_consensus.cc:2804] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.949332 15042 raft_consensus.cc:697] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:36.950513 14915 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.951083 14854 raft_consensus.cc:2804] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:36.950990 14915 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.951548 14854 raft_consensus.cc:697] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:36.953766 14854 consensus_queue.cc:237] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:36.953889 14915 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:36.950214 15042 consensus_queue.cc:237] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.955981 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:36.957588 14543 leader_election.cc:343] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.960127 14849 consensus_queue.cc:260] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:36.955245 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:36.962044 14722 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:36.963032 14544 leader_election.cc:343] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:36.963510 14544 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:36.966311 14915 raft_consensus.cc:2749] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:36.983969 14722 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:36.986982 15051 consensus_queue.cc:1048] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:36.996373 14847 tablet_bootstrap.cc:654] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.001710 14849 ts_tablet_manager.cc:1434] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.205s	user 0.007s	sys 0.001s
I20260709 13:06:37.002911 14576 raft_consensus.cc:2468] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:37.021015 14849 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:37.021811 14846 tablet_bootstrap.cc:654] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.032192 14848 tablet_bootstrap.cc:654] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.034873 14849 tablet_bootstrap.cc:654] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.040215 14474 catalog_manager.cc:5697] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:37.073827 14692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 95105.6us
I20260709 13:06:37.127271 14848 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:37.127787 14847 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:37.128566 14847 ts_tablet_manager.cc:1403] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.322s	user 0.010s	sys 0.009s
I20260709 13:06:37.127846 14848 ts_tablet_manager.cc:1403] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.258s	user 0.007s	sys 0.014s
I20260709 13:06:37.120234 15051 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.131763 15051 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.135936 15051 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:37.137894 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.138314 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:37.142112 14619 leader_election.cc:343] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.138577 14801 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:37.143620 14846 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:37.144214 14846 ts_tablet_manager.cc:1403] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.004s
I20260709 13:06:37.145799 14618 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:37.152557 15132 raft_consensus.cc:2804] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:37.152917 15132 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.153178 15132 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.163403 15132 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.165944 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:37.166743 14846 raft_consensus.cc:359] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.167879 14846 raft_consensus.cc:385] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.168184 14846 raft_consensus.cc:740] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
W20260709 13:06:37.168756 14619 leader_election.cc:343] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.169148 14846 consensus_queue.cc:260] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.168835 15132 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:37.168049 14847 raft_consensus.cc:359] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.172189 14846 ts_tablet_manager.cc:1434] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:06:37.173615 14846 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:37.174821 14847 raft_consensus.cc:385] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.175132 14847 raft_consensus.cc:740] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.175729 14847 consensus_queue.cc:260] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.184172 14849 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:37.184813 14849 ts_tablet_manager.cc:1403] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.164s	user 0.002s	sys 0.014s
I20260709 13:06:37.187510 14849 raft_consensus.cc:359] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.188431 14849 raft_consensus.cc:385] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.188678 14848 raft_consensus.cc:359] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.189462 14848 raft_consensus.cc:385] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.189745 14848 raft_consensus.cc:740] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.189845 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:37.190385 14798 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.205545 14847 ts_tablet_manager.cc:1434] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.002s
I20260709 13:06:37.230152 14847 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:37.207651 14846 tablet_bootstrap.cc:654] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.212987 14798 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:37.235369 14618 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:37.236153 15051 raft_consensus.cc:2804] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:37.188695 14849 raft_consensus.cc:740] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.204698 14473 catalog_manager.cc:5697] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.236624 15051 raft_consensus.cc:697] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:37.190454 14848 consensus_queue.cc:260] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.237186 14849 consensus_queue.cc:260] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.238086 15051 consensus_queue.cc:237] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.239027 14848 ts_tablet_manager.cc:1434] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.110s	user 0.003s	sys 0.003s
I20260709 13:06:37.240110 14848 tablet_bootstrap.cc:492] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:37.243978 14849 ts_tablet_manager.cc:1434] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.002s
I20260709 13:06:37.245028 14849 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:37.254031 14846 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:37.254547 14846 ts_tablet_manager.cc:1403] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 13:06:37.259322 14846 raft_consensus.cc:359] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.259958 14846 raft_consensus.cc:385] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.260203 14846 raft_consensus.cc:740] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.254417 14847 tablet_bootstrap.cc:654] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.269930 15181 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.270440 15181 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.270416 14472 catalog_manager.cc:5697] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.272665 15181 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.273756 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.273633 14846 consensus_queue.cc:260] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.275202 14848 tablet_bootstrap.cc:654] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.276458 14846 ts_tablet_manager.cc:1434] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:06:37.277508 14846 tablet_bootstrap.cc:492] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
W20260709 13:06:37.280417 14764 leader_election.cc:343] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.281271 14847 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:37.284444 14847 ts_tablet_manager.cc:1403] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:06:37.287068 14847 raft_consensus.cc:359] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.287669 14847 raft_consensus.cc:385] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.287923 14847 raft_consensus.cc:740] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.288504 14847 consensus_queue.cc:260] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.283178 14846 tablet_bootstrap.cc:654] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.282984 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:37.283324 14849 tablet_bootstrap.cc:654] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.289746 14577 raft_consensus.cc:2468] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:37.291586 14765 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:37.293166 15181 raft_consensus.cc:2804] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:37.293815 15181 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.294180 15181 raft_consensus.cc:3060] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.302194 15181 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.306605 14847 ts_tablet_manager.cc:1434] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:06:37.307837 14848 tablet_bootstrap.cc:492] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:37.308313 14848 ts_tablet_manager.cc:1403] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.002s
I20260709 13:06:37.312386 14847 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:37.312822 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:37.313414 14577 raft_consensus.cc:3060] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.311363 15181 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.318024 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:37.320411 14847 tablet_bootstrap.cc:654] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:37.321539 14764 leader_election.cc:343] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.322360 14846 tablet_bootstrap.cc:492] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:37.322391 15181 consensus_queue.cc:1048] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:37.322956 14846 ts_tablet_manager.cc:1403] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:06:37.325676 14846 raft_consensus.cc:359] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.326284 14846 raft_consensus.cc:385] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.326537 14846 raft_consensus.cc:740] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.327216 14846 consensus_queue.cc:260] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.329313 14846 ts_tablet_manager.cc:1434] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:37.329574 14577 raft_consensus.cc:2468] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:37.330296 14846 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:37.330626 14765 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:37.331233 14848 raft_consensus.cc:359] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.331910 14848 raft_consensus.cc:385] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.332158 14848 raft_consensus.cc:740] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.333609 15181 raft_consensus.cc:2804] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:37.334152 15181 raft_consensus.cc:697] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:37.334995 15181 consensus_queue.cc:237] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.336408 15051 raft_consensus.cc:493] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.336866 15051 raft_consensus.cc:515] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.338855 15051 leader_election.cc:290] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:37.340991 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.341380 14849 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:37.341861 14849 ts_tablet_manager.cc:1403] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.004s
I20260709 13:06:37.341770 14727 raft_consensus.cc:2393] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:37.343194 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.332779 14848 consensus_queue.cc:260] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.344645 14849 raft_consensus.cc:359] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.344859 14618 leader_election.cc:304] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:37.346108 15132 raft_consensus.cc:3060] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.347337 15042 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.347790 15042 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.345304 14849 raft_consensus.cc:385] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.350085 14849 raft_consensus.cc:740] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.350759 14849 consensus_queue.cc:260] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.352084 14846 tablet_bootstrap.cc:654] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.352670 14849 ts_tablet_manager.cc:1434] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:06:37.355583 15132 raft_consensus.cc:2749] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:37.356757 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.358198 14651 raft_consensus.cc:2468] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:37.359768 14541 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:37.360602 14915 raft_consensus.cc:2804] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:37.360978 14915 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.361255 14915 raft_consensus.cc:3060] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.349731 15042 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:37.365167 14847 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:37.365619 14847 ts_tablet_manager.cc:1403] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:06:37.366426 14916 consensus_queue.cc:1048] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.367090 14849 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:37.366420 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.370270 14727 raft_consensus.cc:2468] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:37.370052 14847 raft_consensus.cc:359] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.371040 14847 raft_consensus.cc:385] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.371367 14847 raft_consensus.cc:740] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.370769 14472 catalog_manager.cc:5697] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.374267 14846 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:37.374727 14846 ts_tablet_manager.cc:1403] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:06:37.377218 14846 raft_consensus.cc:359] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.377830 14846 raft_consensus.cc:385] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.378084 14846 raft_consensus.cc:740] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.378659 14846 consensus_queue.cc:260] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.371956 14847 consensus_queue.cc:260] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.384766 14847 ts_tablet_manager.cc:1434] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:06:37.385710 14847 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:37.387776 14849 tablet_bootstrap.cc:654] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.392611 14847 tablet_bootstrap.cc:654] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.393726 14916 consensus_queue.cc:1048] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.397050 15201 consensus_queue.cc:1048] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.398042 14916 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.398540 14916 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.400332 14916 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.406705 15181 consensus_queue.cc:1048] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:37.407915 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.408641 15181 consensus_queue.cc:1048] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.408578 14800 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:37.416064 14847 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:37.416643 14847 ts_tablet_manager.cc:1403] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260709 13:06:37.423904 14543 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:37.425287 14956 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:37.425660 14956 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.425964 14956 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.429286 15075 consensus_queue.cc:1048] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.433589 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.420079 14847 raft_consensus.cc:359] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.437245 14847 raft_consensus.cc:385] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.437557 14847 raft_consensus.cc:740] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.438162 14847 consensus_queue.cc:260] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:37.439250 14541 leader_election.cc:343] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.439657 14979 consensus_queue.cc:1048] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.450867 14915 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.452829 15201 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.461642 15201 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.463919 15201 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.467572 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:37.468299 14650 raft_consensus.cc:3060] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.470968 14849 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:37.471472 14849 ts_tablet_manager.cc:1403] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 13:06:37.474157 14849 raft_consensus.cc:359] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.474761 14849 raft_consensus.cc:385] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.475102 14849 raft_consensus.cc:740] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.475899 14849 consensus_queue.cc:260] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.478133 14849 ts_tablet_manager.cc:1434] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:06:37.479157 14849 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:37.485188 14849 tablet_bootstrap.cc:654] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:37.506340 14543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 53492.5us
I20260709 13:06:37.344859 14848 ts_tablet_manager.cc:1434] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:06:37.513270 14893 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.513835 14893 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.514590 14846 ts_tablet_manager.cc:1434] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.000s
I20260709 13:06:37.519238 14915 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:37.520684 15051 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.521164 15051 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:37.523156 15051 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:37.525516 14916 raft_consensus.cc:493] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.525942 14916 raft_consensus.cc:515] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.528017 14848 tablet_bootstrap.cc:492] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:37.546684 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.543979 14893 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:37.527690 15227 raft_consensus.cc:493] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.548060 15227 raft_consensus.cc:515] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:37.548547 14767 leader_election.cc:343] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.518980 15132 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.557143 15132 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.557693 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:37.557971 15227 leader_election.cc:290] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:37.558355 14577 raft_consensus.cc:2468] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:37.559998 14846 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:37.562918 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:37.563481 14578 raft_consensus.cc:2393] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:37.566076 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.566531 14691 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:37.567361 15123 raft_consensus.cc:2804] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:37.567793 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.571229 14916 leader_election.cc:290] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:37.559495 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.574040 14956 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.571557 15123 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.560305 15132 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
W20260709 13:06:37.577948 14543 leader_election.cc:343] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.587559 14847 ts_tablet_manager.cc:1434] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.171s	user 0.051s	sys 0.048s
I20260709 13:06:37.588470 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.589756 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:37.591804 14541 leader_election.cc:343] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:37.599370 14764 leader_election.cc:343] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.605506 14764 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:37.607236 14849 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:37.607844 14849 ts_tablet_manager.cc:1403] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.129s	user 0.018s	sys 0.040s
I20260709 13:06:37.613044 14956 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.581483 15123 raft_consensus.cc:3060] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.626953 14847 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:37.627264 14893 raft_consensus.cc:2749] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:37.631951 14619 leader_election.cc:343] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.634016 14979 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.634588 14979 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.636942 14979 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.643317 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:37.621498 14849 raft_consensus.cc:359] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.644193 14849 raft_consensus.cc:385] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.644894 14849 raft_consensus.cc:740] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.645740 14849 consensus_queue.cc:260] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.649905 14849 ts_tablet_manager.cc:1434] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 13:06:37.650910 14849 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
W20260709 13:06:37.654420 14541 leader_election.cc:343] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.665761 14849 tablet_bootstrap.cc:654] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.682399 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.683383 15051 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.684423 15051 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.684827 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.686493 15051 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:37.688210 14574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:37.688506 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.688898 14574 raft_consensus.cc:2468] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:37.689841 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:37.690325 14617 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:37.707250 15123 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.714545 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:37.715270 14800 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.717780 14727 raft_consensus.cc:2393] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:37.726835 15201 raft_consensus.cc:493] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.727386 15201 raft_consensus.cc:515] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.729737 15201 leader_election.cc:290] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.690575 14653 raft_consensus.cc:2468] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:37.734014 15051 raft_consensus.cc:2804] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:37.735749 15051 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.736109 15051 raft_consensus.cc:3060] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.748092 14800 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:37.752346 14848 tablet_bootstrap.cc:654] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.749814 15123 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:37.763963 14915 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.764439 14915 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.757037 14650 raft_consensus.cc:2468] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:37.766899 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:37.767890 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
W20260709 13:06:37.760195 14618 leader_election.cc:343] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.765590 14543 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
W20260709 13:06:37.759708 14544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 239973us
I20260709 13:06:37.776086 14575 raft_consensus.cc:3060] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.782416 14915 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:37.768425 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:37.779067 15039 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:37.787871 14541 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:37.794528 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.805091 15229 raft_consensus.cc:2804] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:37.805699 15039 raft_consensus.cc:697] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:37.813097 14727 raft_consensus.cc:3060] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.815769 14650 raft_consensus.cc:3060] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.818243 15229 raft_consensus.cc:697] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:37.806602 15039 consensus_queue.cc:237] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.819192 15229 consensus_queue.cc:237] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.820189 14846 tablet_bootstrap.cc:654] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.822036 14691 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:37.823035 15051 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.824805 15201 raft_consensus.cc:2749] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:37.825064 15051 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:37.826223 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:37.805091 14575 raft_consensus.cc:2468] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:37.781067 14618 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:37.835882 14847 tablet_bootstrap.cc:654] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.838258 14849 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:37.841151 14849 ts_tablet_manager.cc:1403] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.005s
I20260709 13:06:37.847257 14722 raft_consensus.cc:2393] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:37.853549 15231 raft_consensus.cc:2749] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:37.845755 14543 leader_election.cc:343] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:37.862691 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 103379us
I20260709 13:06:37.863807 14618 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:37.880505 14849 raft_consensus.cc:359] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.881199 14849 raft_consensus.cc:385] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.881594 14849 raft_consensus.cc:740] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.883857 14849 consensus_queue.cc:260] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:37.882915 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 60126.3us
I20260709 13:06:37.885100 14847 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: No bootstrap required, opened a new log
I20260709 13:06:37.885797 14847 ts_tablet_manager.cc:1403] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.259s	user 0.003s	sys 0.011s
I20260709 13:06:37.889381 14849 ts_tablet_manager.cc:1434] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:06:37.886166 14979 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.892735 14979 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.893479 14849 tablet_bootstrap.cc:492] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:37.895567 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.894172 14847 raft_consensus.cc:359] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:37.897063 14692 leader_election.cc:343] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:37.900662 14979 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:37.897228 14847 raft_consensus.cc:385] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.901548 14847 raft_consensus.cc:740] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.902803 14847 consensus_queue.cc:260] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:37.905660 14847 ts_tablet_manager.cc:1434] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:06:37.911657 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:37.912339 14722 raft_consensus.cc:3060] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.913439 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.915068 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.929373 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:37.930409 14723 raft_consensus.cc:2468] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 0.
I20260709 13:06:37.937666 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:37.943506 14577 raft_consensus.cc:2393] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:37.946954 14472 catalog_manager.cc:5697] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.947618 14617 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:37.948840 14979 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.951010 14979 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:37.950235 14472 catalog_manager.cc:5697] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.952100 15181 consensus_queue.cc:1048] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.954075 14979 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:37.954651 15051 raft_consensus.cc:2749] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:37.955708 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:37.960633 14849 tablet_bootstrap.cc:654] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:37.961504 14724 raft_consensus.cc:3060] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:37.962779 14846 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:37.963246 14846 ts_tablet_manager.cc:1403] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.406s	user 0.014s	sys 0.002s
I20260709 13:06:37.965843 14846 raft_consensus.cc:359] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.966468 14846 raft_consensus.cc:385] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:37.966723 14846 raft_consensus.cc:740] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:37.967918 14846 consensus_queue.cc:260] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:37.973984 14846 ts_tablet_manager.cc:1434] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:06:37.954809 14722 raft_consensus.cc:2468] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:37.979202 15231 raft_consensus.cc:2749] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:37.979542 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:37.980507 14648 raft_consensus.cc:2393] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 1: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:37.989833 14848 tablet_bootstrap.cc:492] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
W20260709 13:06:37.990703 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:37.990628 14848 ts_tablet_manager.cc:1403] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.475s	user 0.006s	sys 0.008s
I20260709 13:06:37.993932 14893 consensus_queue.cc:1048] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:37.999270 14691 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:38.000720 15240 raft_consensus.cc:2804] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:38.001220 15240 raft_consensus.cc:697] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:38.002007 15240 consensus_queue.cc:237] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:38.003459 14544 leader_election.cc:343] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.003950 14544 leader_election.cc:304] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.005869 14726 raft_consensus.cc:3060] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.024952 14846 tablet_bootstrap.cc:492] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:38.026309 14574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:38.008384 15042 raft_consensus.cc:2749] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:38.015004 14544 leader_election.cc:343] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.038043 14544 leader_election.cc:304] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:38.038982 14846 tablet_bootstrap.cc:654] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.039371 15039 raft_consensus.cc:2749] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:38.040297 14544 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.020493 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:38.041160 15234 raft_consensus.cc:2804] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:38.041867 15234 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.042193 15234 raft_consensus.cc:3060] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.045972 15237 consensus_queue.cc:1048] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:38.047971 14619 consensus_peers.cc:597] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:38.022673 15231 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.022912 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:38.049714 15231 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.051671 14848 raft_consensus.cc:359] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.052325 14848 raft_consensus.cc:385] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.052610 14848 raft_consensus.cc:740] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
W20260709 13:06:38.052964 15243 log.cc:927] Time spent T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:38.053226 14848 consensus_queue.cc:260] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.055577 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:38.051671 15231 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:38.056262 14575 raft_consensus.cc:2468] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:38.057543 14617 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:38.058364 15051 raft_consensus.cc:2804] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:38.058522 14848 ts_tablet_manager.cc:1434] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:06:38.060014 14848 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:38.064762 14691 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.058729 15051 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.068521 15051 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.076185 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:38.080084 14618 leader_election.cc:343] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.086527 14690 leader_election.cc:304] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:38.116571 14849 tablet_bootstrap.cc:492] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:38.117317 14849 ts_tablet_manager.cc:1403] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.224s	user 0.018s	sys 0.013s
I20260709 13:06:38.118588 15234 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.119928 14849 raft_consensus.cc:359] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.120628 14849 raft_consensus.cc:385] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.120891 14849 raft_consensus.cc:740] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.127250 14848 tablet_bootstrap.cc:654] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.130304 14849 consensus_queue.cc:260] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.127354 15051 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.170776 14849 ts_tablet_manager.cc:1434] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 13:06:38.177923 14577 raft_consensus.cc:2393] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:38.187323 14849 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
W20260709 13:06:38.188542 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 99327.9us
I20260709 13:06:38.179018 15201 raft_consensus.cc:2749] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:38.210394 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 123938us
I20260709 13:06:38.225495 14846 tablet_bootstrap.cc:492] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:38.226050 14846 ts_tablet_manager.cc:1403] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.201s	user 0.016s	sys 0.006s
I20260709 13:06:38.239140 15234 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:38.261292 15051 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:38.264583 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:38.267153 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:38.268136 15123 raft_consensus.cc:2749] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:38.272228 14846 raft_consensus.cc:359] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.273061 14846 raft_consensus.cc:385] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.279090 14846 raft_consensus.cc:740] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
W20260709 13:06:38.277827 15250 log.cc:927] Time spent T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:06:38.276613 14618 leader_election.cc:343] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.287492 14846 consensus_queue.cc:260] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:38.290217 14543 leader_election.cc:343] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:38.298657 14541 consensus_peers.cc:597] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:38.305431 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 104088us
I20260709 13:06:38.306572 14846 ts_tablet_manager.cc:1434] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 13:06:38.306553 14691 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.311065 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:38.311672 14577 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.312127 14915 consensus_queue.cc:1048] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:38.303030 14854 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.315464 14854 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:38.320786 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 109142us
I20260709 13:06:38.320117 15240 raft_consensus.cc:3060] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.333115 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:38.335026 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:38.335774 14648 raft_consensus.cc:2468] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:38.342453 14848 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:38.343032 14848 ts_tablet_manager.cc:1403] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.283s	user 0.018s	sys 0.006s
I20260709 13:06:38.345830 14848 raft_consensus.cc:359] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.346547 14848 raft_consensus.cc:385] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.346781 14848 raft_consensus.cc:740] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.347354 14848 consensus_queue.cc:260] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.349879 14848 ts_tablet_manager.cc:1434] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:06:38.350857 14848 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:38.362339 14854 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:38.367266 14849 tablet_bootstrap.cc:654] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.367673 14915 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.368155 14915 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:38.377583 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 44466.3us
I20260709 13:06:38.369849 14764 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:38.380591 14893 raft_consensus.cc:2804] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:38.380952 14893 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.381235 14893 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.381855 14915 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
W20260709 13:06:38.369475 15249 log.cc:927] Time spent T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:06:38.387408 14846 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:38.392102 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:38.398267 14541 leader_election.cc:343] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.413169 14721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:38.419029 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:38.424016 15234 consensus_queue.cc:1048] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:38.427621 14577 raft_consensus.cc:2468] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:38.446530 14893 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.446296 14617 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.415123 15240 raft_consensus.cc:2749] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:38.451982 14893 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:38.453663 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:38.454319 14653 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.451696 15132 raft_consensus.cc:2804] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:38.474805 14767 leader_election.cc:343] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.480486 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:38.481401 15132 raft_consensus.cc:697] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:38.482336 15132 consensus_queue.cc:237] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:38.454866 14692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 127734us
W20260709 13:06:38.489789 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 71397.3us
W20260709 13:06:38.457314 14544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 50304us
I20260709 13:06:38.514475 14846 tablet_bootstrap.cc:654] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.515132 14725 raft_consensus.cc:2468] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:38.505609 14653 raft_consensus.cc:2468] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:38.522262 14764 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:38.523469 15268 raft_consensus.cc:2804] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:38.523932 15268 raft_consensus.cc:697] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:38.524737 15268 consensus_queue.cc:237] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.525774 14848 tablet_bootstrap.cc:654] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:38.530232 14767 leader_election.cc:343] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.531774 15123 consensus_queue.cc:1048] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:38.522168 14725 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.564823 14849 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:38.565261 14849 ts_tablet_manager.cc:1403] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.386s	user 0.019s	sys 0.023s
I20260709 13:06:38.569599 14915 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.570154 14915 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.562954 15232 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.577189 15272 consensus_queue.cc:1048] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:38.577864 15232 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.579754 14915 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:38.575541 15075 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.581446 15075 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.582579 15232 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:38.583606 15075 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:38.585465 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:38.585623 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:38.587031 15039 consensus_queue.cc:1048] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:38.587249 14543 leader_election.cc:343] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.586568 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:38.588953 14722 raft_consensus.cc:2393] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54b0718d36f4f72ac7cef2358fbe6b6 in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
W20260709 13:06:38.591322 14544 leader_election.cc:343] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.591863 14544 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:38.592341 14846 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:38.592684 15228 raft_consensus.cc:2749] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:38.593608 14619 leader_election.cc:343] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.592808 14846 ts_tablet_manager.cc:1403] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.206s	user 0.009s	sys 0.005s
I20260709 13:06:38.599965 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:38.600752 14576 raft_consensus.cc:2393] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54b0718d36f4f72ac7cef2358fbe6b6 in current term 1: Already voted for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in this term.
I20260709 13:06:38.600961 14846 raft_consensus.cc:359] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.601644 14846 raft_consensus.cc:385] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.601887 14846 raft_consensus.cc:740] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.602072 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:38.602627 14846 consensus_queue.cc:260] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.602638 14800 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:38.604569 14618 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:38.605222 14472 catalog_manager.cc:5697] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.612522 14765 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:38.608862 15132 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:38.614116 15132 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.614445 15132 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.609714 14544 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.620316 15271 raft_consensus.cc:2804] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:38.620769 15271 raft_consensus.cc:697] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:38.621552 15271 consensus_queue.cc:237] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.624135 14854 raft_consensus.cc:3060] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.623798 14476 catalog_manager.cc:5697] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.633221 14848 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:38.633895 14848 ts_tablet_manager.cc:1403] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.283s	user 0.016s	sys 0.008s
I20260709 13:06:38.637086 14848 raft_consensus.cc:359] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.637768 14848 raft_consensus.cc:385] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.638031 14848 raft_consensus.cc:740] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.639043 14848 consensus_queue.cc:260] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:38.648093 14846 ts_tablet_manager.cc:1434] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:06:38.649179 14848 ts_tablet_manager.cc:1434] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 13:06:38.650676 15273 log.cc:927] Time spent T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:38.653540 14849 raft_consensus.cc:359] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:38.654199 14849 raft_consensus.cc:385] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.654446 14849 raft_consensus.cc:740] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.655071 14849 consensus_queue.cc:260] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:38.655422 14854 raft_consensus.cc:2749] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:38.662664 14846 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:38.669435 14476 catalog_manager.cc:5697] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } }
I20260709 13:06:38.669275 15132 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.673101 14849 ts_tablet_manager.cc:1434] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 13:06:38.674263 14848 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:38.695123 14848 tablet_bootstrap.cc:654] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.698928 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
W20260709 13:06:38.700711 14619 leader_election.cc:343] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.705622 15132 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:38.706976 15257 raft_consensus.cc:493] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.707670 15257 raft_consensus.cc:515] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:38.732758 14849 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:38.741716 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:38.729408 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:38.749881 14799 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.749691 14473 catalog_manager.cc:5697] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 1 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:38.769641 14544 leader_election.cc:343] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.770115 14544 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:38.784456 15039 raft_consensus.cc:2749] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:38.794152 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
W20260709 13:06:38.796234 14690 leader_election.cc:343] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:38.798686 14846 tablet_bootstrap.cc:654] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.792879 15257 leader_election.cc:290] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:38.806988 14848 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:38.807950 14848 ts_tablet_manager.cc:1403] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.143s	user 0.025s	sys 0.045s
I20260709 13:06:38.810637 14848 raft_consensus.cc:359] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.811285 14848 raft_consensus.cc:385] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.811530 14848 raft_consensus.cc:740] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.812132 14848 consensus_queue.cc:260] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.814121 14848 ts_tablet_manager.cc:1434] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:38.828112 14848 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: Bootstrap starting.
I20260709 13:06:38.837284 14799 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:38.841921 14618 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:38.843284 15051 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:38.843719 15051 raft_consensus.cc:697] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:38.844425 15051 consensus_queue.cc:237] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:38.838318 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:38.848260 14575 raft_consensus.cc:2468] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:38.854763 14647 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.858273 14849 tablet_bootstrap.cc:654] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.858510 14691 leader_election.cc:304] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:38.871312 15257 raft_consensus.cc:2804] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:38.871708 15257 raft_consensus.cc:493] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.872027 15257 raft_consensus.cc:3060] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.880949 14848 tablet_bootstrap.cc:654] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.896631 15257 raft_consensus.cc:515] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:38.902388 14474 catalog_manager.cc:5697] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 0 to 1, leader changed from <none> to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 1 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.934015 14575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:38.935010 14854 consensus_queue.cc:1048] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:38.933791 15257 leader_election.cc:290] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:38.938398 14575 raft_consensus.cc:3060] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.957230 14849 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:38.957839 14849 ts_tablet_manager.cc:1403] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.235s	user 0.004s	sys 0.009s
I20260709 13:06:38.967859 14846 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:38.968387 14846 ts_tablet_manager.cc:1403] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.310s	user 0.032s	sys 0.000s
I20260709 13:06:38.948784 15133 consensus_queue.cc:1048] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:38.972397 14849 raft_consensus.cc:359] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:38.972898 14849 raft_consensus.cc:385] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.973093 14849 raft_consensus.cc:740] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.968786 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:38.973485 15132 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:38.977864 14849 consensus_queue.cc:260] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:38.980687 14849 ts_tablet_manager.cc:1434] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:06:38.988094 14849 tablet_bootstrap.cc:492] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:38.977264 15132 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:38.996788 14849 tablet_bootstrap.cc:654] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.001201 15132 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:39.002297 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:39.016402 14577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:39.019490 14690 leader_election.cc:343] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.023170 14846 raft_consensus.cc:359] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.024451 14846 raft_consensus.cc:385] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.024657 14846 raft_consensus.cc:740] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.025969 14846 consensus_queue.cc:260] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.029821 14617 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:39.041960 14854 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.042483 14854 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:39.043928 14848 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: No bootstrap required, opened a new log
I20260709 13:06:39.044145 14854 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:39.044400 14848 ts_tablet_manager.cc:1403] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent bootstrapping tablet: real 0.229s	user 0.013s	sys 0.027s
I20260709 13:06:39.048964 14846 ts_tablet_manager.cc:1434] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 13:06:39.049467 15268 raft_consensus.cc:493] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.050104 14846 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: Bootstrap starting.
I20260709 13:06:39.049945 15268 raft_consensus.cc:515] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.051889 15268 leader_election.cc:290] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:39.054195 15132 raft_consensus.cc:2749] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.055929 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:39.056380 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:39.058239 14767 leader_election.cc:343] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.061059 14848 raft_consensus.cc:359] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.062219 14848 raft_consensus.cc:385] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.062577 14848 raft_consensus.cc:740] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.063097 14799 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.063216 14848 consensus_queue.cc:260] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.067858 14846 tablet_bootstrap.cc:654] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.077559 14848 ts_tablet_manager.cc:1434] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:06:39.062160 14575 raft_consensus.cc:2468] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:39.102669 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:39.092289 14574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:39.115155 14765 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:39.109835 14691 leader_election.cc:304] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:39.117591 15123 raft_consensus.cc:2804] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.118078 15123 raft_consensus.cc:697] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:39.103286 14578 raft_consensus.cc:2468] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
I20260709 13:06:39.118861 15123 consensus_queue.cc:237] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.127911 14849 tablet_bootstrap.cc:492] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:39.128378 14849 ts_tablet_manager.cc:1403] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.141s	user 0.024s	sys 0.073s
I20260709 13:06:39.128970 15268 raft_consensus.cc:2749] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:39.130887 14849 raft_consensus.cc:359] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:39.131543 14849 raft_consensus.cc:385] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.131788 14849 raft_consensus.cc:740] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.135239 14849 consensus_queue.cc:260] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:39.137995 14767 consensus_peers.cc:597] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:39.138382 14765 leader_election.cc:304] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:39.138407 14915 consensus_queue.cc:1048] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:39.140889 15268 raft_consensus.cc:2804] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.139724 14849 ts_tablet_manager.cc:1434] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:06:39.141301 15268 raft_consensus.cc:493] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.142311 15268 raft_consensus.cc:3060] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.139671 15132 consensus_queue.cc:1048] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:39.142313 14849 tablet_bootstrap.cc:492] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
W20260709 13:06:39.143570 14524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:39.149130 14849 tablet_bootstrap.cc:654] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.183959 14849 tablet_bootstrap.cc:492] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:39.184402 14849 ts_tablet_manager.cc:1403] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.006s
I20260709 13:06:39.189271 14849 raft_consensus.cc:359] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:39.189930 14849 raft_consensus.cc:385] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.190187 14849 raft_consensus.cc:740] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.191653 14915 consensus_queue.cc:1048] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.198035 14849 consensus_queue.cc:260] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:39.200834 14849 ts_tablet_manager.cc:1434] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:39.207923 14849 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:39.233044 14846 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: No bootstrap required, opened a new log
I20260709 13:06:39.245553 14846 ts_tablet_manager.cc:1403] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.033s
I20260709 13:06:39.245944 14849 tablet_bootstrap.cc:654] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.248183 14846 raft_consensus.cc:359] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.248869 14846 raft_consensus.cc:385] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.249130 14846 raft_consensus.cc:740] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.250141 14846 consensus_queue.cc:260] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.251567 14846 ts_tablet_manager.cc:1434] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:39.235630 14476 catalog_manager.cc:5697] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.258672 15132 consensus_queue.cc:1048] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.269420 15132 raft_consensus.cc:493] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.269901 15132 raft_consensus.cc:515] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.271847 15132 leader_election.cc:290] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:39.272861 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:39.273180 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:39.273866 14578 raft_consensus.cc:2393] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:39.274943 14617 leader_election.cc:304] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:39.222172 15268 raft_consensus.cc:515] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.276716 15132 raft_consensus.cc:3060] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.288373 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
W20260709 13:06:39.289630 14767 leader_election.cc:343] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.299734 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:39.300328 14578 raft_consensus.cc:3060] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.301174 15268 leader_election.cc:290] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:39.303133 15132 raft_consensus.cc:2749] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:39.306486 14578 raft_consensus.cc:2468] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:39.307535 14765 leader_election.cc:304] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:39.309973 15293 raft_consensus.cc:2804] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.310568 15181 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.310964 15181 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.312928 15181 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:39.315641 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:39.315896 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:39.316498 14578 raft_consensus.cc:2468] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 0.
W20260709 13:06:39.317022 14767 leader_election.cc:343] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.318080 14765 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:39.319211 14854 raft_consensus.cc:2804] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.319530 14854 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.319804 14854 raft_consensus.cc:3060] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.320348 15293 raft_consensus.cc:697] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:39.322300 15293 consensus_queue.cc:237] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.327205 14849 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:39.327726 14849 ts_tablet_manager.cc:1403] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.126s	user 0.032s	sys 0.041s
I20260709 13:06:39.330281 14849 raft_consensus.cc:359] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.330938 14849 raft_consensus.cc:385] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.331197 14849 raft_consensus.cc:740] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.331800 14849 consensus_queue.cc:260] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.345760 14719 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.362376 14849 ts_tablet_manager.cc:1434] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:06:39.363498 14849 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a: Bootstrap starting.
I20260709 13:06:39.366562 14854 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.376598 14854 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:39.377084 15123 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.378414 14578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:39.378973 14578 raft_consensus.cc:3060] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.377700 15123 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:39.383325 15123 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:39.384164 15123 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.384392 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:39.384570 15123 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.385695 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:39.386686 15132 consensus_queue.cc:1048] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.387156 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:39.388096 14576 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:39.390022 14691 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:39.390786 15257 raft_consensus.cc:2804] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.391211 15257 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.391543 15257 raft_consensus.cc:3060] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.389163 14692 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:39.395138 15272 raft_consensus.cc:2749] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:39.368870 14849 tablet_bootstrap.cc:654] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.394901 14578 raft_consensus.cc:2468] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:39.396497 14765 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:39.395516 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:39.397544 14719 raft_consensus.cc:3060] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.403576 15268 raft_consensus.cc:2804] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.405180 15268 raft_consensus.cc:697] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:39.405090 14719 raft_consensus.cc:2468] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:39.406095 15268 consensus_queue.cc:237] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.411693 15133 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.412215 15133 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.421458 15123 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:39.421331 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:39.420570 15257 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.422101 14651 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 0.
I20260709 13:06:39.425212 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:39.426067 14725 raft_consensus.cc:2393] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:39.426127 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:39.426855 14576 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 0.
I20260709 13:06:39.399044 14473 catalog_manager.cc:5697] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.428726 14617 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:39.422684 15133 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:39.431474 15133 raft_consensus.cc:2804] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.431831 15133 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.432144 15133 raft_consensus.cc:3060] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.448318 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:39.448982 14576 raft_consensus.cc:3060] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.464746 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:39.470692 15257 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:39.474623 14576 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:39.472839 15133 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.475750 14691 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:39.475988 14651 raft_consensus.cc:2393] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 1: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:39.478042 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:39.478806 14722 raft_consensus.cc:2393] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:39.479480 15257 raft_consensus.cc:2804] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.480551 15257 raft_consensus.cc:697] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:39.481208 15257 consensus_queue.cc:237] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:39.484139 14576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:39.485194 15133 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:39.485740 14576 raft_consensus.cc:2393] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 1: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:39.486763 14617 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:39.490197 14849 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a: No bootstrap required, opened a new log
I20260709 13:06:39.490594 14849 ts_tablet_manager.cc:1403] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent bootstrapping tablet: real 0.127s	user 0.023s	sys 0.014s
I20260709 13:06:39.491269 14473 catalog_manager.cc:5697] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 1 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.492396 14849 raft_consensus.cc:359] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.492883 14849 raft_consensus.cc:385] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.493084 14849 raft_consensus.cc:740] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.493510 15133 raft_consensus.cc:2749] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:39.493727 14849 consensus_queue.cc:260] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:39.496016 14849 ts_tablet_manager.cc:1434] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:39.504120 14472 catalog_manager.cc:5697] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 1 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.526743 14722 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.620622 15257 consensus_queue.cc:1048] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.637509 15123 consensus_queue.cc:1048] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.721006 14722 raft_consensus.cc:3060] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.727910 15268 consensus_queue.cc:1048] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:39.747583 15075 consensus_queue.cc:1048] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.883026 15257 consensus_queue.cc:1048] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.886291 15075 consensus_queue.cc:1048] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.910907 15123 consensus_queue.cc:1048] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:39.921697 15075 consensus_queue.cc:1048] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.777911  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
W20260709 13:06:40.782757 14691 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:40.787665 14691 consensus_peers.cc:597] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.828853  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:40.830127  7005 tablet_replica.cc:333] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.831167  7005 raft_consensus.cc:2243] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.832266  7005 raft_consensus.cc:2272] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.834784  7005 tablet_replica.cc:333] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.835906  7005 raft_consensus.cc:2243] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.836517  7005 raft_consensus.cc:2272] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.839475  7005 tablet_replica.cc:333] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.840296  7005 raft_consensus.cc:2243] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.840834  7005 raft_consensus.cc:2272] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.844481  7005 tablet_replica.cc:333] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.845242  7005 raft_consensus.cc:2243] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.846150  7005 raft_consensus.cc:2272] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.848618  7005 tablet_replica.cc:333] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.849404  7005 raft_consensus.cc:2243] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.850333  7005 raft_consensus.cc:2272] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.852658  7005 tablet_replica.cc:333] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.853397  7005 raft_consensus.cc:2243] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:40.853392 14765 consensus_peers.cc:597] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.853940  7005 raft_consensus.cc:2272] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.856534  7005 tablet_replica.cc:333] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.857285  7005 raft_consensus.cc:2243] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.857803  7005 raft_consensus.cc:2272] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.860065  7005 tablet_replica.cc:333] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.860793  7005 raft_consensus.cc:2243] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.861739  7005 raft_consensus.cc:2272] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.863963  7005 tablet_replica.cc:333] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.864804  7005 raft_consensus.cc:2243] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.865736  7005 raft_consensus.cc:2272] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.867862  7005 tablet_replica.cc:333] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.868800  7005 raft_consensus.cc:2243] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.869721  7005 raft_consensus.cc:2272] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.871812  7005 tablet_replica.cc:333] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.872529  7005 raft_consensus.cc:2243] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.873003  7005 raft_consensus.cc:2272] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.875855  7005 tablet_replica.cc:333] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.876627  7005 raft_consensus.cc:2243] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.877087  7005 raft_consensus.cc:2272] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.879149  7005 tablet_replica.cc:333] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.879868  7005 raft_consensus.cc:2243] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.880326  7005 raft_consensus.cc:2272] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.882571  7005 tablet_replica.cc:333] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.883327  7005 raft_consensus.cc:2243] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.883795  7005 raft_consensus.cc:2272] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.885895  7005 tablet_replica.cc:333] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.886561  7005 raft_consensus.cc:2243] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.887425  7005 raft_consensus.cc:2272] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:40.888935 14617 consensus_peers.cc:597] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.889904  7005 tablet_replica.cc:333] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
W20260709 13:06:40.889998 14691 consensus_peers.cc:597] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.890688  7005 raft_consensus.cc:2243] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.891103  7005 raft_consensus.cc:2272] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.893661  7005 tablet_replica.cc:333] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.894511  7005 raft_consensus.cc:2243] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.894999  7005 raft_consensus.cc:2272] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.897727  7005 tablet_replica.cc:333] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.898470  7005 raft_consensus.cc:2243] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.900987  7005 raft_consensus.cc:2272] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.902870  7005 tablet_replica.cc:333] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.903403  7005 raft_consensus.cc:2243] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.903800  7005 raft_consensus.cc:2272] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.905697  7005 tablet_replica.cc:333] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.906174  7005 raft_consensus.cc:2243] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.906548  7005 raft_consensus.cc:2272] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.909314  7005 tablet_replica.cc:333] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.909901  7005 raft_consensus.cc:2243] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.911093  7005 raft_consensus.cc:2272] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.913132  7005 tablet_replica.cc:333] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.913944  7005 raft_consensus.cc:2243] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.914815  7005 raft_consensus.cc:2272] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.917541  7005 tablet_replica.cc:333] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.918246  7005 raft_consensus.cc:2243] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:06:40.918910 14617 consensus_peers.cc:597] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.919147  7005 raft_consensus.cc:2272] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.921533  7005 tablet_replica.cc:333] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.922300  7005 raft_consensus.cc:2243] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.922793  7005 raft_consensus.cc:2272] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.925334  7005 tablet_replica.cc:333] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.926604  7005 raft_consensus.cc:2243] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.927492  7005 raft_consensus.cc:2272] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:40.927670 14765 consensus_peers.cc:597] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.930625  7005 tablet_replica.cc:333] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.931402  7005 raft_consensus.cc:2243] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.932257  7005 raft_consensus.cc:2272] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:40.933560 14691 consensus_peers.cc:597] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.934609  7005 tablet_replica.cc:333] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.935380  7005 raft_consensus.cc:2243] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.935854  7005 raft_consensus.cc:2272] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.938452  7005 tablet_replica.cc:333] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.939213  7005 raft_consensus.cc:2243] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.939704  7005 raft_consensus.cc:2272] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:40.940191 14765 consensus_peers.cc:597] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.942348  7005 tablet_replica.cc:333] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.943145  7005 raft_consensus.cc:2243] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.944154  7005 raft_consensus.cc:2272] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.946811  7005 tablet_replica.cc:333] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.947885  7005 raft_consensus.cc:2243] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.948364  7005 raft_consensus.cc:2272] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.950778  7005 tablet_replica.cc:333] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
W20260709 13:06:40.951382 14617 consensus_peers.cc:597] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.951555  7005 raft_consensus.cc:2243] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.952615  7005 raft_consensus.cc:2272] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.956068  7005 tablet_replica.cc:333] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.956768  7005 raft_consensus.cc:2243] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.957676  7005 raft_consensus.cc:2272] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.959631  7005 tablet_replica.cc:333] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.960131  7005 raft_consensus.cc:2243] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.960772  7005 raft_consensus.cc:2272] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.962407  7005 tablet_replica.cc:333] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.962903  7005 raft_consensus.cc:2243] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.963553  7005 raft_consensus.cc:2272] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.965727  7005 tablet_replica.cc:333] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.966395  7005 raft_consensus.cc:2243] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.967293  7005 raft_consensus.cc:2272] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.969435  7005 tablet_replica.cc:333] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.969906  7005 raft_consensus.cc:2243] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.970563  7005 raft_consensus.cc:2272] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.972355  7005 tablet_replica.cc:333] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.972932  7005 raft_consensus.cc:2243] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.973405  7005 raft_consensus.cc:2272] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.975509  7005 tablet_replica.cc:333] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.976212  7005 raft_consensus.cc:2243] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:06:40.976948 14617 consensus_peers.cc:597] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.977105  7005 raft_consensus.cc:2272] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.980260  7005 tablet_replica.cc:333] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.980989  7005 raft_consensus.cc:2243] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.981763  7005 raft_consensus.cc:2272] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.983572  7005 tablet_replica.cc:333] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.984041  7005 raft_consensus.cc:2243] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.984385  7005 raft_consensus.cc:2272] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.986274  7005 tablet_replica.cc:333] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.986749  7005 raft_consensus.cc:2243] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:40.987495  7005 raft_consensus.cc:2272] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.989527  7005 tablet_replica.cc:333] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.990105  7005 raft_consensus.cc:2243] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.990470  7005 raft_consensus.cc:2272] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.992029  7005 tablet_replica.cc:333] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.992460  7005 raft_consensus.cc:2243] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.992820  7005 raft_consensus.cc:2272] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.994838  7005 tablet_replica.cc:333] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.995281  7005 raft_consensus.cc:2243] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.995643  7005 raft_consensus.cc:2272] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.997735  7005 tablet_replica.cc:333] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: stopping tablet replica
I20260709 13:06:40.998217  7005 raft_consensus.cc:2243] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.998636  7005 raft_consensus.cc:2272] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:41.013979 14765 consensus_peers.cc:597] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.057941 14691 consensus_peers.cc:597] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.064373 14691 consensus_peers.cc:597] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.138278 14617 consensus_peers.cc:597] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.171514 14765 consensus_peers.cc:597] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.173419 14765 consensus_peers.cc:597] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.187914 14765 consensus_peers.cc:597] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.221535 14765 consensus_peers.cc:597] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.242542 14691 consensus_peers.cc:597] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.247977 14617 consensus_peers.cc:597] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.273702 14691 consensus_peers.cc:597] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.300943 14691 consensus_peers.cc:597] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.346035 14691 consensus_peers.cc:597] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:41.874657 15324 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.875263 15324 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:41.877967 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:41.877456 15324 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:41.880012 15324 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.880517 15324 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:41.881883 14691 leader_election.cc:336] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.882261 14691 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:41.882824 15272 raft_consensus.cc:2749] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.883708 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:41.882516 15324 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:41.887756 14691 leader_election.cc:336] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.888159 14691 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:41.888960 15272 raft_consensus.cc:2749] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.896327 15272 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.896345 15317 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.896903 15272 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:41.897094 15317 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:41.899168 15272 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:41.900758 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:41.902403 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:41.906008 15329 raft_consensus.cc:493] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
W20260709 13:06:41.906175 14691 leader_election.cc:336] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.906528 15329 raft_consensus.cc:515] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:41.906592 15272 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.907786 15272 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:41.909123 15329 leader_election.cc:290] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:41.907128 14691 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:41.912381 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:41.899273 15317 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:41.914644 15324 raft_consensus.cc:2749] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.902323 15075 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.915643 15075 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:41.918413 14691 leader_election.cc:336] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.919368 14691 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:41.920015 15257 raft_consensus.cc:2749] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.912407 15272 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
W20260709 13:06:41.923616 14617 leader_election.cc:336] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.924091 14617 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:41.914885 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:41.926501 15317 raft_consensus.cc:2749] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.930311 15075 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:41.933884 14765 leader_election.cc:336] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:41.935045 14617 leader_election.cc:336] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.935489 14617 leader_election.cc:304] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:41.936142 15329 raft_consensus.cc:2749] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.944401 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:41.948186 14764 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:41.949255 14854 raft_consensus.cc:2749] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.951273 15317 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.951817 15317 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:41.953788 15317 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:41.955574 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:41.956259 14722 raft_consensus.cc:2468] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:41.957376 14619 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:41.958020 15317 raft_consensus.cc:2804] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.958321 15317 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
W20260709 13:06:41.958447 14617 leader_election.cc:336] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.958685 15317 raft_consensus.cc:3060] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.963954 15317 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:41.965545 15317 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:41.966849 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:41.967422 14722 raft_consensus.cc:3060] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.969775 14854 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.970147 14854 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:41.971992 14854 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:41.973039 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:41.973707 14725 raft_consensus.cc:2468] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:41.977023 15329 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
W20260709 13:06:41.977751 14617 leader_election.cc:336] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.977627 15329 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:41.979676 15317 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.979983 14767 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:41.980188 15317 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:41.981160 15330 raft_consensus.cc:2804] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.981554 15330 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:41.981892 15330 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.982477 15317 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:41.985795 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:41.986852 15329 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:41.987088 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:41.991819 14617 leader_election.cc:336] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.993007 14722 raft_consensus.cc:2468] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:41.994020 15330 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:41.994890 14619 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
W20260709 13:06:41.996212 14765 leader_election.cc:336] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.997807 15330 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:41.996999 15329 raft_consensus.cc:2804] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.998677 15329 raft_consensus.cc:697] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:41.998977 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:41.999529 14722 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.992558 14617 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
W20260709 13:06:42.003870 14765 leader_election.cc:336] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:41.999475 15329 consensus_queue.cc:237] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.005460 15317 raft_consensus.cc:2749] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.006533 14617 leader_election.cc:336] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.006829 14722 raft_consensus.cc:2468] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.007010 14617 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:42.007941 14767 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.007822 15317 raft_consensus.cc:2749] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.008642 14854 raft_consensus.cc:2804] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.009424 14854 raft_consensus.cc:697] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.007893 15324 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.010746 15324 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.012583 15317 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.010881 14854 consensus_queue.cc:237] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.013324 15317 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.014145 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.015743 15075 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.016347 15317 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.016371 15075 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.019517 15075 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:42.021162 14617 leader_election.cc:336] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.024540 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.025209 14725 raft_consensus.cc:2468] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.026422 14619 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.026796 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.027400 14651 raft_consensus.cc:2468] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.029840 14764 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
W20260709 13:06:42.031090 14765 leader_election.cc:336] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.032114 15075 raft_consensus.cc:2804] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.032512 15075 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.032819 15075 raft_consensus.cc:3060] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.034162 14691 leader_election.cc:336] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.034646 14691 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:42.035681 15272 raft_consensus.cc:2749] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.036860 15324 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.037364 15237 raft_consensus.cc:2804] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.038002 15237 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.038517 15237 raft_consensus.cc:3060] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.039026 14854 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.039981 14854 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.042164 15328 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.042666 15328 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.044205 14854 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.044585 15328 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.045514 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.046207 14725 raft_consensus.cc:2468] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.047600 14767 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:42.045495 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.050123 15330 raft_consensus.cc:2804] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.050486 15330 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.053450 14854 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.053918 14854 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.054301 14474 catalog_manager.cc:5697] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:42.057861 14765 leader_election.cc:336] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.058324 14765 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:42.060195 15328 raft_consensus.cc:2749] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.050855 15330 raft_consensus.cc:3060] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.062150  7005 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14599)
I20260709 13:06:42.065169 14854 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.063347 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.073490 14472 catalog_manager.cc:5697] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.052353 15075 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.079186 15075 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.079938 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.080585 14651 raft_consensus.cc:3060] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.086881 15237 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:42.093461 14617 leader_election.cc:336] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.093514 14651 raft_consensus.cc:2468] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.094971 14764 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.095820 15075 raft_consensus.cc:2804] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.096256 15075 raft_consensus.cc:697] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.096982 15075 consensus_queue.cc:237] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.105950 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.106668 14725 raft_consensus.cc:3060] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.106895 15237 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.085124 15330 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.108824 15324 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.109486 15324 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.110280 15330 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.111019 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.111703 14722 raft_consensus.cc:3060] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.113289 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.124010 15272 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.124526 15272 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.126437 15272 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.127090 15330 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.127653 15330 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.131242 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.131825 14727 raft_consensus.cc:2468] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.129637 15330 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.133523 14725 raft_consensus.cc:2468] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:42.135808 14722 raft_consensus.cc:2468] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.139230 14619 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.140617 15237 raft_consensus.cc:2804] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.141165 15237 raft_consensus.cc:697] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.141963 15237 consensus_queue.cc:237] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.143739 14767 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
W20260709 13:06:42.143994 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 86160.2us
I20260709 13:06:42.151548 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.153048 14472 catalog_manager.cc:5697] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:42.155413 14691 leader_election.cc:336] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.111940 15324 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.156251 14691 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:42.156999 15324 raft_consensus.cc:2749] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.158535 15330 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.158937 14767 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:42.159051 15330 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.159641 15336 raft_consensus.cc:2804] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.160048 15336 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.160360 15336 raft_consensus.cc:3060] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.161676 15335 raft_consensus.cc:2804] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.162202 15335 raft_consensus.cc:697] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.162976 15335 consensus_queue.cc:237] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:42.171133 14765 leader_election.cc:336] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.172991 15330 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.174047 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.175685 15336 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.178711 15336 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
W20260709 13:06:42.181035 14765 leader_election.cc:336] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.181480 14765 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:42.179572 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.182125 14719 raft_consensus.cc:3060] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.182328 14765 leader_election.cc:336] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.182776 15336 raft_consensus.cc:2749] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:42.183009 14765 leader_election.cc:336] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.183760 14765 leader_election.cc:336] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.188246 15331 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.188772 15331 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:42.174063 14691 leader_election.cc:336] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.190004 14691 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:42.190864 15331 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.191197 15330 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.191380 15331 raft_consensus.cc:2749] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.191713 15330 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:42.195211 14765 leader_election.cc:336] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.195686 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.193131 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.196364 14722 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.197872 14767 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:42.198592 15335 raft_consensus.cc:2804] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.199008 15335 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.199370 15335 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.198873 15330 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.201084 15329 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.201596 15329 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.203778 14719 raft_consensus.cc:2468] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.206830 15335 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:42.208870 14617 leader_election.cc:336] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.206789 14767 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.210444 15335 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.210703 15330 raft_consensus.cc:2804] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.211206 15330 raft_consensus.cc:697] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.212003 15330 consensus_queue.cc:237] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:42.195825 14765 leader_election.cc:336] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.215514 14765 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:42.217240 15075 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.214085 14474 catalog_manager.cc:5697] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.219019 15317 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.217684 15075 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.222011 14472 catalog_manager.cc:5697] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.221532 15328 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.224509 15328 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.223084 15331 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.225867 15331 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.225929 15317 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.227896 15331 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.226569 15328 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.229281 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.229439 15335 raft_consensus.cc:2749] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.224493 15075 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.230154 14722 raft_consensus.cc:2468] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.230661 15317 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.231724 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.231894 15324 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.232355 15324 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.232617 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.233186 14653 raft_consensus.cc:2468] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.233494 14722 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.234107 14767 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
W20260709 13:06:42.234342 14617 leader_election.cc:336] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.234941 15335 raft_consensus.cc:2804] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.235670 15335 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.236028 15335 raft_consensus.cc:3060] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.236351 14619 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.237250 15324 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.238683 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.239346 15237 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:42.239681 14691 leader_election.cc:336] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.240128 14691 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:42.246289 15317 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.246851 15317 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.241001 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.241015 14619 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:42.248370 15332 raft_consensus.cc:2749] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.234997 15329 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.251302 15317 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.251806 15336 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.252089 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.252763 14722 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.253266 15331 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.253790 15331 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.255048 15335 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.246316 14764 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.252686 15336 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.256752 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.256981 15075 raft_consensus.cc:2804] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:42.255798 14765 leader_election.cc:336] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.253981 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.257364 14651 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:42.257719 14719 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.258061 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.258720 14690 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.259723 15272 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.260058 15272 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.260380 15272 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:42.260948 14617 leader_election.cc:336] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.239738 15237 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.258761 14798 raft_consensus.cc:2393] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 2: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
W20260709 13:06:42.258735 14765 leader_election.cc:336] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.262642 14619 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.265010 15329 raft_consensus.cc:2804] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.265376 15329 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.257381 15075 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.265919 15075 raft_consensus.cc:3060] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.266312 15237 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.252970 15324 raft_consensus.cc:2749] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.270793 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.271407 14722 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.272348 14767 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:42.273101 15328 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.273545 15328 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.273926 15328 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.275869 15075 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.276815 15332 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.277298 15332 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.279340 15332 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.279747 15332 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.280153 15332 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.283305 15332 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.283555 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.284166 14798 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.284421 15335 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.286029 14618 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.286788 15317 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.287201 15317 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.287302 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.287645 15317 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.287920 14725 raft_consensus.cc:3060] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.289714 14617 leader_election.cc:336] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.292869 14617 leader_election.cc:336] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.293865 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.295171 14619 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:42.295790 15331 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.299026 15272 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.296514 14725 raft_consensus.cc:2468] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.308889 14767 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:42.281116 15328 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.295851 15332 raft_consensus.cc:2749] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.311502 15332 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.311991 15332 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.266088 15329 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.304889 15347 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.313716 15347 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.314496 15332 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.315815 15347 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.305634 14854 raft_consensus.cc:493] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.316476 14854 raft_consensus.cc:515] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.318604 15335 raft_consensus.cc:2804] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.320686 15335 raft_consensus.cc:697] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.320991 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.321625 15335 consensus_queue.cc:237] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.324156 14474 catalog_manager.cc:5697] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.326227 15237 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.327291 14653 raft_consensus.cc:2393] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 2: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:42.321563 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.328316 14722 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.329806 14854 leader_election.cc:290] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:42.332868 14765 leader_election.cc:336] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.333544 14765 leader_election.cc:336] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.333776 15328 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.335129 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.336444 14653 raft_consensus.cc:2468] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
W20260709 13:06:42.336615 14765 leader_election.cc:336] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.337555 14765 leader_election.cc:336] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.339404 15336 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.335491 15272 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:42.339986 14765 leader_election.cc:336] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.340509 14765 leader_election.cc:336] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.341703 15317 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.342792 15075 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.343637 15317 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.343761 14764 leader_election.cc:304] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.344900 15075 raft_consensus.cc:2804] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.345261 15075 raft_consensus.cc:493] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.345616 15075 raft_consensus.cc:3060] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.346769 15272 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.347267 15272 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.334239 15329 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.348861 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.349484 14798 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.349838 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.350711 15329 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.351634 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:42.352463 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.352861 15329 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.353776 15329 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.352883 14797 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.354506 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.354915 15237 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:42.355194 14727 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.354722 14617 leader_election.cc:336] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.356747 14617 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:42.357753 15317 raft_consensus.cc:2749] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.353005 14653 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:42.360632 14765 leader_election.cc:336] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.361977 14797 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:42.362565 14727 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:42.363711 14619 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.364040 15329 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.352242 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.341109 14719 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.364473 15237 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.351835 14618 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.365583 14767 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.366165 14725 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.367542 15346 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.367949 15346 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.368299 15346 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.354480 14722 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.372449 14618 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.372843 14767 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.380131 14653 raft_consensus.cc:2468] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 4.
I20260709 13:06:42.373332 15336 raft_consensus.cc:2804] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.373646 15272 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
W20260709 13:06:42.340453 14691 leader_election.cc:336] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.380990 15336 raft_consensus.cc:697] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.381857 15336 consensus_queue.cc:237] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.377065 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.382001 14690 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.383049 14797 raft_consensus.cc:2468] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.382242 14691 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:42.383450 14725 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:42.376142 15346 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:42.384109 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 43680.9us
W20260709 13:06:42.384585 14691 leader_election.cc:336] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.384765 14619 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.385322 14691 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:42.381289 15335 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.385076 15331 raft_consensus.cc:2749] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.386345 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:42.386461 15335 raft_consensus.cc:697] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.385565 15317 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.386876 14798 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.387420 15317 raft_consensus.cc:697] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.387853 15346 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.388401 15346 raft_consensus.cc:2804] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.388233 15317 consensus_queue.cc:237] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.388885 15346 raft_consensus.cc:697] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.383210 15272 raft_consensus.cc:2804] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.389652 15272 raft_consensus.cc:697] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:42.387358 15335 consensus_queue.cc:237] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.386847 15257 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.390472 15272 consensus_queue.cc:237] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:42.377758 14617 leader_election.cc:336] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.365001 15237 raft_consensus.cc:697] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.393754 15237 consensus_queue.cc:237] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.395368 14798 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:42.396442 14618 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.397027 14474 catalog_manager.cc:5697] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.397801 15257 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.398229 15257 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.399750 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.400272 14653 raft_consensus.cc:3060] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.401831 15257 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.402567 15349 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.403120 15349 raft_consensus.cc:697] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.403474 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.404047 14651 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:42.406957 14690 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.361330 15075 raft_consensus.cc:515] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.409638 15349 consensus_queue.cc:237] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.409473 15257 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.411881 15257 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.412190 15257 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.414367 14765 leader_election.cc:336] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.415042 15075 leader_election.cc:290] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.421204 14653 raft_consensus.cc:2468] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.409300 15346 consensus_queue.cc:237] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.432816 15257 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:42.437443 14691 leader_election.cc:336] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.439196 14618 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.437515 14722 raft_consensus.cc:1275] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:42.440416 14691 leader_election.cc:336] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.443588 14854 consensus_queue.cc:1048] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.444550 15075 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.444977 15075 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.447305 15349 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.447889 15349 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.451743 15075 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.454403 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.455046 14653 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.450958 15331 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.442437 15332 raft_consensus.cc:2804] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.461268 14653 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:42.462363 14690 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.486078 15272 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.490583 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:42.491443 14725 raft_consensus.cc:2468] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:42.462474 15332 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.503473 14767 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:42.504321 15328 raft_consensus.cc:2804] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.504748 15328 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.505111 15328 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.505930 15324 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.506415 15324 raft_consensus.cc:697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:42.507174 15324 consensus_queue.cc:237] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.456487 15331 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.486723 15272 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.496697 15332 raft_consensus.cc:3060] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.519215 14765 leader_election.cc:336] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.522363 15257 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.528669 15349 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.528302 14474 catalog_manager.cc:5697] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 3 to 4, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 4 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.537566 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:42.538352 14798 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:42.540249 14618 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.543290 15346 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.543663 15346 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.543998 15346 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.546056 15331 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.552444 15346 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.555166 15346 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.557713 14474 catalog_manager.cc:5697] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:42.564394 14765 consensus_peers.cc:597] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.565304 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:42.565866 14798 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.569847 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.570847 14653 raft_consensus.cc:2468] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:42.575928 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:42.576577 14651 raft_consensus.cc:2468] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:42.576889 14472 catalog_manager.cc:5697] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.578773 14690 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.578944 14472 catalog_manager.cc:5697] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.579674 14690 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.581457 15355 raft_consensus.cc:2804] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.581908 15355 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.582237 15355 raft_consensus.cc:3060] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.582914 15257 raft_consensus.cc:2804] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.583302 15257 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:06:42.583617 15257 raft_consensus.cc:3060] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.587347 15272 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.596521 15332 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.596685 15328 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:42.615811 14765 consensus_peers.cc:597] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.617772 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:42.617372 14472 catalog_manager.cc:5697] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.618588 14797 raft_consensus.cc:3060] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.619220 14472 catalog_manager.cc:5697] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.621320 15332 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.623227 14798 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
W20260709 13:06:42.623816 14691 leader_election.cc:336] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.624271 14691 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:42.624344 14618 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
W20260709 13:06:42.625139 14691 leader_election.cc:336] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.626883 15237 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.627449 15237 raft_consensus.cc:697] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.626972 14472 catalog_manager.cc:5697] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.628211 15237 consensus_queue.cc:237] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.628765 15364 raft_consensus.cc:2749] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:42.631788 14691 leader_election.cc:336] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.635227 15257 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.625927 14474 catalog_manager.cc:5697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.637274 14764 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.638311 15335 raft_consensus.cc:2804] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.638756 15335 raft_consensus.cc:697] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.639722 15257 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.639526 15335 consensus_queue.cc:237] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:42.640336 14765 leader_election.cc:336] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.641489 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.642534 14725 raft_consensus.cc:1275] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.643911 14651 raft_consensus.cc:3060] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.641820 14691 leader_election.cc:336] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.645210 14691 leader_election.cc:336] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.651849 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:42.652495 14719 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.651096 14691 leader_election.cc:336] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.657245 14797 raft_consensus.cc:2468] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:42.658371 14618 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:42.659227 15349 raft_consensus.cc:2804] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.659801 15349 raft_consensus.cc:697] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:42.634995 15328 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:42.663021 15075 consensus_queue.cc:1048] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.659197 15355 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:42.660813 15349 consensus_queue.cc:237] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.667627 14725 raft_consensus.cc:1275] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.672237 14651 raft_consensus.cc:2468] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:42.673519 14690 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.675086 15257 raft_consensus.cc:2804] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.675328 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.675531 15257 raft_consensus.cc:697] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:42.675871 14651 raft_consensus.cc:3060] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.683199 15355 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:42.683538 14722 raft_consensus.cc:1275] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.683931 15357 consensus_queue.cc:1048] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.685375 15257 consensus_queue.cc:237] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:42.687251 14691 leader_election.cc:336] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.689812 14651 raft_consensus.cc:2468] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.659765 14719 raft_consensus.cc:2468] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:42.690282 14472 catalog_manager.cc:5697] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.697242 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:42.699712 14648 raft_consensus.cc:3060] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.708288 14648 raft_consensus.cc:2468] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:42.691339 15357 consensus_queue.cc:1048] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 13:06:42.712899 14617 leader_election.cc:336] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.723030 14617 leader_election.cc:336] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.725080 14617 leader_election.cc:336] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.725875 14617 leader_election.cc:336] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.727607 14617 leader_election.cc:336] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.737951 14690 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
W20260709 13:06:42.739727 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 76922.9us
I20260709 13:06:42.740860 14767 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.741817 15348 raft_consensus.cc:2804] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.742341 15348 raft_consensus.cc:697] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:42.743147 15348 consensus_queue.cc:237] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:42.744869 14726 raft_consensus.cc:1275] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.739256 15364 raft_consensus.cc:2804] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.753515 14764 leader_election.cc:304] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:42.755359 15075 raft_consensus.cc:2804] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.764086 15075 raft_consensus.cc:697] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
W20260709 13:06:42.773026 14617 leader_election.cc:336] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:06:42.764952 15075 consensus_queue.cc:237] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:42.765720 15364 raft_consensus.cc:697] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:42.781803 15364 consensus_queue.cc:237] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
W20260709 13:06:42.786671 14617 leader_election.cc:336] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.787425 14617 leader_election.cc:336] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
W20260709 13:06:42.788045 14617 consensus_peers.cc:597] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:42.788543 14617 consensus_peers.cc:597] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.796866 14473 catalog_manager.cc:5697] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:42.806383 14765 consensus_peers.cc:597] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:42.807039 14765 consensus_peers.cc:597] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.800280 14474 catalog_manager.cc:5697] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.814720 14474 catalog_manager.cc:5697] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:42.819749 14764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 64725.2us
I20260709 13:06:42.823323 14651 raft_consensus.cc:1275] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.826251 14854 consensus_queue.cc:1048] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.831924 14800 raft_consensus.cc:1275] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.836186 14854 consensus_queue.cc:1048] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:06:42.854544 15332 consensus_queue.cc:1048] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.859001 14725 raft_consensus.cc:1275] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.870906 14725 raft_consensus.cc:1275] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.877405 15378 consensus_queue.cc:1048] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:06:42.895385 14472 catalog_manager.cc:5697] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:42.899016 14617 consensus_peers.cc:597] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:42.899801 14617 consensus_peers.cc:597] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.898990 14472 catalog_manager.cc:5697] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.922240 14796 raft_consensus.cc:1275] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.923334 15377 consensus_queue.cc:1048] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:42.930886 14725 raft_consensus.cc:1275] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.940099 15377 consensus_queue.cc:1048] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.936107 15332 consensus_queue.cc:1048] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:06:42.953506 14765 consensus_peers.cc:597] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:42.954049 14765 consensus_peers.cc:597] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.975939 14720 raft_consensus.cc:1275] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:42.989243 14617 consensus_peers.cc:597] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.995092 15353 consensus_queue.cc:1048] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:43.002588 14651 raft_consensus.cc:1275] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:43.002825 14691 consensus_peers.cc:597] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.997970 14727 raft_consensus.cc:1275] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.013705 15365 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:43.014739 15332 consensus_queue.cc:1048] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:43.027385 14472 catalog_manager.cc:5697] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.043443 14648 raft_consensus.cc:1275] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.048333 14648 raft_consensus.cc:1275] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.058465 15365 consensus_queue.cc:1048] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.060179 15348 consensus_queue.cc:1048] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:43.063005 14765 consensus_peers.cc:597] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.065558  7005 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14599)
W20260709 13:06:43.092298 14691 consensus_peers.cc:597] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.138952 14617 consensus_peers.cc:597] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.146826 14765 consensus_peers.cc:597] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.150885 14617 consensus_peers.cc:597] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.178205 14651 raft_consensus.cc:1275] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.193254 15361 consensus_queue.cc:1048] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:43.215906 14691 consensus_peers.cc:597] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.221012 14801 raft_consensus.cc:1275] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:43.222662 14765 consensus_peers.cc:597] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.227336 15329 consensus_queue.cc:1048] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:43.240370 14765 consensus_peers.cc:597] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.244753 14651 raft_consensus.cc:1275] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.246253 15361 consensus_queue.cc:1048] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:43.259469 14691 consensus_peers.cc:597] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.271257 14727 raft_consensus.cc:1275] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.272795 15385 consensus_queue.cc:1048] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:43.273800 14765 consensus_peers.cc:597] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.277796 14801 raft_consensus.cc:1275] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.279534 15349 consensus_queue.cc:1048] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:43.291179 14691 consensus_peers.cc:597] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.292367 14617 consensus_peers.cc:597] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.325122 14617 consensus_peers.cc:597] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.342723 14765 consensus_peers.cc:597] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.353096 14617 consensus_peers.cc:597] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.358289 14765 consensus_peers.cc:597] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.385061 14691 consensus_peers.cc:597] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.388953 14691 consensus_peers.cc:597] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.407204 14647 raft_consensus.cc:1275] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.408339 15385 consensus_queue.cc:1048] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:43.447510 14765 consensus_peers.cc:597] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.453784 14617 consensus_peers.cc:597] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.454185 14765 consensus_peers.cc:597] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.552452 14617 consensus_peers.cc:597] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.605088 14617 consensus_peers.cc:597] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.631265 14691 consensus_peers.cc:597] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.635279 14765 consensus_peers.cc:597] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.636446 14691 consensus_peers.cc:597] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.663282 14691 consensus_peers.cc:597] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.725052 14617 consensus_peers.cc:597] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.747781 14765 consensus_peers.cc:597] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.779465 14691 consensus_peers.cc:597] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.806916 14765 consensus_peers.cc:597] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.810545 14691 consensus_peers.cc:597] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.878165 14691 consensus_peers.cc:597] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:44.078534  7005 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 14599)
W20260709 13:06:45.001185 14765 consensus_peers.cc:597] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.021049 14617 consensus_peers.cc:597] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.079473  7005 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 14599)
W20260709 13:06:45.091074 14617 consensus_peers.cc:597] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.192950 14617 consensus_peers.cc:597] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.202448 14765 consensus_peers.cc:597] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.212781 14765 consensus_peers.cc:597] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.236966 14765 consensus_peers.cc:597] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.371088 14765 consensus_peers.cc:597] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.399471 14617 consensus_peers.cc:597] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.403793 14765 consensus_peers.cc:597] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.419158 14765 consensus_peers.cc:597] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.433027 14617 consensus_peers.cc:597] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.452365 14765 consensus_peers.cc:597] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.475405 14617 consensus_peers.cc:597] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.564002 14691 consensus_peers.cc:597] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.588496 14691 consensus_peers.cc:597] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.628264 14617 consensus_peers.cc:597] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.655377 14765 consensus_peers.cc:597] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.699532 14765 consensus_peers.cc:597] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.712356 14691 consensus_peers.cc:597] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.751451 14765 consensus_peers.cc:597] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.773160 14617 consensus_peers.cc:597] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.781811 14691 consensus_peers.cc:597] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.787977 14765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111) [suppressed 430 similar messages]
W20260709 13:06:45.799549 14691 consensus_peers.cc:597] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.802606 14691 consensus_peers.cc:597] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.840372 14617 consensus_peers.cc:597] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.897162 14765 consensus_peers.cc:597] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.897964 14617 consensus_peers.cc:597] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:45.898542 14617 consensus_peers.cc:597] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.911242 14765 consensus_peers.cc:597] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.916716 14691 consensus_peers.cc:597] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.941802 14617 consensus_peers.cc:597] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.014671 14765 consensus_peers.cc:597] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.055872 14617 consensus_peers.cc:597] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.079986  7005 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 14599)
W20260709 13:06:46.092839 14765 consensus_peers.cc:597] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.135506 14691 consensus_peers.cc:597] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.187811 14691 consensus_peers.cc:597] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.221976 14617 consensus_peers.cc:597] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.257391 14765 consensus_peers.cc:597] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.319381 14691 consensus_peers.cc:597] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.324963 14691 consensus_peers.cc:597] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.342962 14765 consensus_peers.cc:597] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.373833 14765 consensus_peers.cc:597] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.508602 14691 consensus_peers.cc:597] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.537322 14691 consensus_peers.cc:597] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:47.080543  7005 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 14599)
I20260709 13:06:47.255621  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
I20260709 13:06:47.367461  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:47.373814 15422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:47.374491 15424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:47.376811  7005 server_base.cc:1061] running on GCE node
W20260709 13:06:47.377370 15421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:47.380591  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:47.380905  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:47.381187  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602407381166 us; error 0 us; skew 500 ppm
I20260709 13:06:47.381897  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:47.385062  7005 webserver.cc:533] Webserver started at http://127.6.215.65:38251/ using document root <none> and password file <none>
I20260709 13:06:47.385583  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:47.385740  7005 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:06:47.389240  7005 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:47.398615 15429 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:47.399547  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:47.399919  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
format_stamp: "Formatted at 2026-07-09 13:06:29 on dist-test-slave-r31z"
I20260709 13:06:47.400461  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:06:47.411996 14617 consensus_peers.cc:597] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.429895  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:47.431737  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:47.433246  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:47.439558 15436 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:06:47.576272 14765 consensus_peers.cc:597] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:47.630863 14765 consensus_peers.cc:597] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:47.631313 14765 consensus_peers.cc:597] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.680445  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:06:47.680925  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.244s	user 0.011s	sys 0.000s
I20260709 13:06:47.681398  7005 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:06:47.686344 15436 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.701383 15436 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.702255 15436 tablet_bootstrap.cc:492] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.702922 15436 ts_tablet_manager.cc:1403] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:06:47.705598 15436 raft_consensus.cc:359] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.706619 15436 raft_consensus.cc:740] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.707363 15436 consensus_queue.cc:260] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
W20260709 13:06:47.710976 14765 consensus_peers.cc:597] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.712402 15436 ts_tablet_manager.cc:1434] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
W20260709 13:06:47.712618 14617 consensus_peers.cc:597] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.713191 15436 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.723946 15436 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.724591 15436 tablet_bootstrap.cc:492] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.725051 15436 ts_tablet_manager.cc:1403] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:06:47.726805 15436 raft_consensus.cc:359] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:47.727264 15436 raft_consensus.cc:740] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.727771 15436 consensus_queue.cc:260] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:47.728998 15436 ts_tablet_manager.cc:1434] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:47.729642 15436 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.744907 15436 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.745676 15436 tablet_bootstrap.cc:492] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.746292 15436 ts_tablet_manager.cc:1403] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:06:47.758634 15436 raft_consensus.cc:359] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.761194 15436 raft_consensus.cc:740] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.761814 15436 consensus_queue.cc:260] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.763348 15436 ts_tablet_manager.cc:1434] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:06:47.763940 15436 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.774565 15436 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.775213 15436 tablet_bootstrap.cc:492] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.775657 15436 ts_tablet_manager.cc:1403] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:06:47.777429 15436 raft_consensus.cc:359] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:47.778029 15436 raft_consensus.cc:740] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.778723 15436 consensus_queue.cc:260] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:47.780469 15436 ts_tablet_manager.cc:1434] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:47.781038 15436 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.792892 15436 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.793923 15436 tablet_bootstrap.cc:492] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.794543 15436 ts_tablet_manager.cc:1403] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:06:47.796737 15436 raft_consensus.cc:359] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.797329 15436 raft_consensus.cc:740] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.798117 15436 consensus_queue.cc:260] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.800032 15436 ts_tablet_manager.cc:1434] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:47.800778 15436 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:47.816460 14691 consensus_peers.cc:597] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.818252 15436 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.819173 15436 tablet_bootstrap.cc:492] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.819759 15436 ts_tablet_manager.cc:1403] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:06:47.822171 15436 raft_consensus.cc:359] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.822808 15436 raft_consensus.cc:740] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.823446 15436 consensus_queue.cc:260] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.825206 15436 ts_tablet_manager.cc:1434] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:47.826030 15436 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.849107 15436 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.850036 15436 tablet_bootstrap.cc:492] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.851711 15436 ts_tablet_manager.cc:1403] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:06:47.854107 15436 raft_consensus.cc:359] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.854763 15436 raft_consensus.cc:740] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.856886 15436 consensus_queue.cc:260] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.860172 15436 ts_tablet_manager.cc:1434] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:47.860909 15436 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:47.880605 14765 consensus_peers.cc:597] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.883034 15436 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.883896 15436 tablet_bootstrap.cc:492] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.884482 15436 ts_tablet_manager.cc:1403] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:06:47.886794 15436 raft_consensus.cc:359] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.887351 15436 raft_consensus.cc:740] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.887969 15436 consensus_queue.cc:260] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.889776 15436 ts_tablet_manager.cc:1434] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:47.890435 15436 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:47.891276 14765 consensus_peers.cc:597] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.901541 15436 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.902539 15436 tablet_bootstrap.cc:492] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.903198 15436 ts_tablet_manager.cc:1403] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:06:47.905572 15436 raft_consensus.cc:359] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.906237 15436 raft_consensus.cc:740] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.906863 15436 consensus_queue.cc:260] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.908594 15436 ts_tablet_manager.cc:1434] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:47.909299 15436 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.914289  7005 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:06:47.914538  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.233s	user 0.211s	sys 0.002s
I20260709 13:06:47.920006 15436 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.921195 15436 tablet_bootstrap.cc:492] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.921741 15436 ts_tablet_manager.cc:1403] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:06:47.924010 15436 raft_consensus.cc:359] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.924659 15436 raft_consensus.cc:740] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.925462 15436 consensus_queue.cc:260] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:47.927201 15436 ts_tablet_manager.cc:1434] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:47.927767 15436 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:47.940032 15436 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.940894 15436 tablet_bootstrap.cc:492] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.941527 15436 ts_tablet_manager.cc:1403] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 13:06:47.943442 15436 raft_consensus.cc:359] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.943950 15436 raft_consensus.cc:740] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.944499 15436 consensus_queue.cc:260] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.946048 15436 ts_tablet_manager.cc:1434] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:47.946818 15436 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:47.964298 14617 consensus_peers.cc:597] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:47.967079 14765 consensus_peers.cc:597] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:47.970173 14617 consensus_peers.cc:597] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.975346 15436 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:47.976332 15436 tablet_bootstrap.cc:492] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:47.976970 15436 ts_tablet_manager.cc:1403] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
W20260709 13:06:47.978048 14691 consensus_peers.cc:597] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.979700 15436 raft_consensus.cc:359] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.980373 15436 raft_consensus.cc:740] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.980926 15436 consensus_queue.cc:260] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:47.982837 15436 ts_tablet_manager.cc:1434] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:47.983569 15436 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:47.995397 14765 consensus_peers.cc:597] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.004027 15436 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.005091 15436 tablet_bootstrap.cc:492] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.005764 15436 ts_tablet_manager.cc:1403] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:06:48.008029 15436 raft_consensus.cc:359] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.008908 15436 raft_consensus.cc:740] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.009632 15436 consensus_queue.cc:260] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.018543 15436 ts_tablet_manager.cc:1434] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:48.020584 15436 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.035050 15436 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.036574 15436 tablet_bootstrap.cc:492] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.037164 15436 ts_tablet_manager.cc:1403] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
W20260709 13:06:48.037559 14617 consensus_peers.cc:597] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.039384 15436 raft_consensus.cc:359] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.039944 15436 raft_consensus.cc:740] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.040514 15436 consensus_queue.cc:260] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.042557 15436 ts_tablet_manager.cc:1434] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:48.043329 15436 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.043960  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:43631
I20260709 13:06:48.044167 15508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:43631 every 8 connection(s)
I20260709 13:06:48.074225 15436 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.075547 15436 tablet_bootstrap.cc:492] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.076309 15436 ts_tablet_manager.cc:1403] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 13:06:48.079411 15436 raft_consensus.cc:359] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.080318 15436 raft_consensus.cc:740] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.081121 15436 consensus_queue.cc:260] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.083364 15436 ts_tablet_manager.cc:1434] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:48.084239 15436 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.098112 15482 raft_consensus.cc:3060] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:48.103144 14765 consensus_peers.cc:597] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.108611 15510 heartbeater.cc:344] Connected to a master server at 127.6.215.126:37295
I20260709 13:06:48.109064 15510 heartbeater.cc:461] Registering TS with master...
W20260709 13:06:48.110396 14765 consensus_peers.cc:597] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.110682 15510 heartbeater.cc:507] Master 127.6.215.126:37295 requested a full tablet report, sending...
I20260709 13:06:48.115278 15436 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.116627 15436 tablet_bootstrap.cc:492] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.117306 15436 ts_tablet_manager.cc:1403] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
W20260709 13:06:48.117763 14691 consensus_peers.cc:597] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.119834 15436 raft_consensus.cc:359] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.120550 15436 raft_consensus.cc:740] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.121410 15436 consensus_queue.cc:260] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.123509 15436 ts_tablet_manager.cc:1434] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 13:06:48.124310 14617 consensus_peers.cc:597] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:48.125065 14617 consensus_peers.cc:597] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.124300 15436 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.146605 15436 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.147289 15436 tablet_bootstrap.cc:492] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.147796 15436 ts_tablet_manager.cc:1403] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:06:48.148886 14473 ts_manager.cc:194] Re-registered known tserver with Master: 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:48.149925 15436 raft_consensus.cc:359] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.150557 15436 raft_consensus.cc:740] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.151204 15436 consensus_queue.cc:260] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.152971 15436 ts_tablet_manager.cc:1434] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:48.153765 15436 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.168875 15436 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.169332 15483 raft_consensus.cc:3060] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.169596 15436 tablet_bootstrap.cc:492] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.170226 15436 ts_tablet_manager.cc:1403] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 13:06:48.172477 15436 raft_consensus.cc:359] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.172935 15436 raft_consensus.cc:740] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.173496 15436 consensus_queue.cc:260] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.175583 15436 ts_tablet_manager.cc:1434] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:06:48.176354 15436 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.185016 14473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59474
I20260709 13:06:48.192024 15510 heartbeater.cc:499] Master 127.6.215.126:37295 was elected leader, sending a full tablet report...
I20260709 13:06:48.201391 15436 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.202409 15436 tablet_bootstrap.cc:492] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.203265 15436 ts_tablet_manager.cc:1403] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.012s
I20260709 13:06:48.205699 15436 raft_consensus.cc:359] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.206190 15436 raft_consensus.cc:740] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.206750 15436 consensus_queue.cc:260] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.208508 15436 ts_tablet_manager.cc:1434] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:06:48.209288 15436 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.225133 15436 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.226054 15436 tablet_bootstrap.cc:492] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.226672 15436 ts_tablet_manager.cc:1403] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:06:48.229077 15436 raft_consensus.cc:359] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.230050 15436 raft_consensus.cc:740] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.230877 15436 consensus_queue.cc:260] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.233541 15436 ts_tablet_manager.cc:1434] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:48.234702 15436 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.265722 15436 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.266585 15436 tablet_bootstrap.cc:492] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.267235 15436 ts_tablet_manager.cc:1403] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.004s
I20260709 13:06:48.269624 15436 raft_consensus.cc:359] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.270364 15436 raft_consensus.cc:740] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.271052 15436 consensus_queue.cc:260] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.273206 15436 ts_tablet_manager.cc:1434] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:48.274056 15436 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:48.286553 14617 consensus_peers.cc:597] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:48.289713 14617 consensus_peers.cc:597] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.294816 15436 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.295814 15436 tablet_bootstrap.cc:492] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.296824 15436 ts_tablet_manager.cc:1403] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
W20260709 13:06:48.298877 14691 consensus_peers.cc:597] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.299423 15436 raft_consensus.cc:359] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.300083 15436 raft_consensus.cc:740] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.300733 15436 consensus_queue.cc:260] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.302598 15436 ts_tablet_manager.cc:1434] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:06:48.303555 15436 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.317453 15436 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.318549 15436 tablet_bootstrap.cc:492] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.319088 15436 ts_tablet_manager.cc:1403] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:06:48.320986 15436 raft_consensus.cc:359] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.321492 15436 raft_consensus.cc:740] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.322012 15436 consensus_queue.cc:260] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.323450 15436 ts_tablet_manager.cc:1434] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:48.324311 15436 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.337873 15436 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.339141 15436 tablet_bootstrap.cc:492] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.339908 15436 ts_tablet_manager.cc:1403] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:06:48.341708 15436 raft_consensus.cc:359] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.342196 15436 raft_consensus.cc:740] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.342630 15436 consensus_queue.cc:260] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.344237 15436 ts_tablet_manager.cc:1434] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:06:48.345028 15436 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.358182 15482 raft_consensus.cc:3060] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.358803 15483 raft_consensus.cc:3060] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.364198 15436 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.365088 15436 tablet_bootstrap.cc:492] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.365753 15436 ts_tablet_manager.cc:1403] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:06:48.368548 15436 raft_consensus.cc:359] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.369333 15436 raft_consensus.cc:740] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.370059 15436 consensus_queue.cc:260] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.372463 15436 ts_tablet_manager.cc:1434] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:48.373229 15436 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.386468 15436 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.387138 15436 tablet_bootstrap.cc:492] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.387621 15436 ts_tablet_manager.cc:1403] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:06:48.389611 15436 raft_consensus.cc:359] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.390060 15436 raft_consensus.cc:740] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.390690 15436 consensus_queue.cc:260] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.392746 15436 ts_tablet_manager.cc:1434] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:48.393791 15436 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.407816 15436 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.409140 15436 tablet_bootstrap.cc:492] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.410069 15436 ts_tablet_manager.cc:1403] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:06:48.412231 15482 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.412652 15436 raft_consensus.cc:359] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.413337 15436 raft_consensus.cc:740] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.413990 15436 consensus_queue.cc:260] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.416021 15436 ts_tablet_manager.cc:1434] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:48.416752 15436 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.417024 15483 raft_consensus.cc:3060] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.439616 15436 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.440377 15436 tablet_bootstrap.cc:492] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.440968 15436 ts_tablet_manager.cc:1403] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:06:48.444067 15436 raft_consensus.cc:359] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.444707 15436 raft_consensus.cc:740] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.445245 15436 consensus_queue.cc:260] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.446923 15436 ts_tablet_manager.cc:1434] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:48.447542 15436 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.452445 15482 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.465111 15436 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.465839 15436 tablet_bootstrap.cc:492] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.466452 15436 ts_tablet_manager.cc:1403] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:06:48.468317 15436 raft_consensus.cc:359] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.468761 15436 raft_consensus.cc:740] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.469301 15436 consensus_queue.cc:260] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.470892 15436 ts_tablet_manager.cc:1434] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:48.471957 15436 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.481150 15482 raft_consensus.cc:3060] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.492664 15483 raft_consensus.cc:3060] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.508564 15436 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.509822 15436 tablet_bootstrap.cc:492] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.510439 15436 ts_tablet_manager.cc:1403] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.014s
I20260709 13:06:48.513298 15436 raft_consensus.cc:359] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.513995 15436 raft_consensus.cc:740] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.514936 15436 consensus_queue.cc:260] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.517277 15436 ts_tablet_manager.cc:1434] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:06:48.518088 15436 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.520210 15482 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.523535 15479 raft_consensus.cc:3060] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.542631 15436 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.543535 15436 tablet_bootstrap.cc:492] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.544170 15436 ts_tablet_manager.cc:1403] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:06:48.546486 15436 raft_consensus.cc:359] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.547118 15436 raft_consensus.cc:740] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.547683 15436 consensus_queue.cc:260] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.549603 15436 ts_tablet_manager.cc:1434] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:06:48.550335 15436 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.588625 15436 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.589478 15436 tablet_bootstrap.cc:492] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.590065 15436 ts_tablet_manager.cc:1403] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.024s
I20260709 13:06:48.592268 15436 raft_consensus.cc:359] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.592959 15436 raft_consensus.cc:740] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.593780 15436 consensus_queue.cc:260] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.595721 15436 ts_tablet_manager.cc:1434] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:48.596354 15436 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.608990 15436 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.610205 15436 tablet_bootstrap.cc:492] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.610893 15436 ts_tablet_manager.cc:1403] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:06:48.613310 15436 raft_consensus.cc:359] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.613855 15436 raft_consensus.cc:740] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.614459 15436 consensus_queue.cc:260] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.616302 15436 ts_tablet_manager.cc:1434] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:48.617203 15436 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.638447 15436 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.639284 15436 tablet_bootstrap.cc:492] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.639902 15436 ts_tablet_manager.cc:1403] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:06:48.642371 15436 raft_consensus.cc:359] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.643065 15436 raft_consensus.cc:740] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.644466 15436 consensus_queue.cc:260] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.645960 15436 ts_tablet_manager.cc:1434] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:48.646538 15436 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:48.650355 14691 consensus_peers.cc:597] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.658592 15436 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.659338 15436 tablet_bootstrap.cc:492] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.659823 15436 ts_tablet_manager.cc:1403] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:06:48.661643 15436 raft_consensus.cc:359] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.662106 15436 raft_consensus.cc:740] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.662606 15436 consensus_queue.cc:260] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.664001 15436 ts_tablet_manager.cc:1434] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:48.664858 15436 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.676885 15436 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.677631 15436 tablet_bootstrap.cc:492] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.678122 15436 ts_tablet_manager.cc:1403] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:06:48.679607 15482 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.680397 15436 raft_consensus.cc:359] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.681097 15436 raft_consensus.cc:740] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.681737 15436 consensus_queue.cc:260] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.683670 15436 ts_tablet_manager.cc:1434] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:06:48.684466 15436 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
W20260709 13:06:48.708740 14765 consensus_peers.cc:597] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.712723 15436 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.713819 15436 tablet_bootstrap.cc:492] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.714711 15436 ts_tablet_manager.cc:1403] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.000s
I20260709 13:06:48.719095 15436 raft_consensus.cc:359] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.719785 15436 raft_consensus.cc:740] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.720402 15436 consensus_queue.cc:260] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.722931 15436 ts_tablet_manager.cc:1434] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:48.723677 15436 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.725689 15482 raft_consensus.cc:3060] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.731284 15483 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.761261 15479 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:48.767277 14765 consensus_peers.cc:597] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.768205 15436 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.769109 15436 tablet_bootstrap.cc:492] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.771045 15436 ts_tablet_manager.cc:1403] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.011s
I20260709 13:06:48.774397 15436 raft_consensus.cc:359] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.775043 15436 raft_consensus.cc:740] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.776002 15436 consensus_queue.cc:260] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.778481 15436 ts_tablet_manager.cc:1434] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:06:48.779300 15436 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.793011 15436 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.794100 15436 tablet_bootstrap.cc:492] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.794902 15436 ts_tablet_manager.cc:1403] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:06:48.797288 15436 raft_consensus.cc:359] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.797945 15436 raft_consensus.cc:740] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.798547 15436 consensus_queue.cc:260] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.801291 15436 ts_tablet_manager.cc:1434] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:48.802194 15436 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.819315 15436 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.820289 15436 tablet_bootstrap.cc:492] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.820930 15436 ts_tablet_manager.cc:1403] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:06:48.823175 15436 raft_consensus.cc:359] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.823634 15436 raft_consensus.cc:740] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.824210 15436 consensus_queue.cc:260] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.825716 15436 ts_tablet_manager.cc:1434] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:06:48.826361 15436 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.831241 15483 raft_consensus.cc:3060] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.840375 15479 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.861812 15436 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.862684 15436 tablet_bootstrap.cc:492] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.863289 15436 ts_tablet_manager.cc:1403] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.021s
I20260709 13:06:48.865656 15436 raft_consensus.cc:359] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.866269 15436 raft_consensus.cc:740] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.866936 15436 consensus_queue.cc:260] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.869279 15436 ts_tablet_manager.cc:1434] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:48.870085 15436 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.893150 15436 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.893952 15436 tablet_bootstrap.cc:492] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.894487 15436 ts_tablet_manager.cc:1403] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:06:48.896215 15436 raft_consensus.cc:359] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.896724 15436 raft_consensus.cc:740] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.897245 15436 consensus_queue.cc:260] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.898834 15436 ts_tablet_manager.cc:1434] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:48.899577 15436 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.914708 15436 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.915458 15436 tablet_bootstrap.cc:492] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.915939 15436 ts_tablet_manager.cc:1403] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:06:48.918166 15436 raft_consensus.cc:359] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.918800 15436 raft_consensus.cc:740] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.919498 15436 consensus_queue.cc:260] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:48.921502 15436 ts_tablet_manager.cc:1434] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:06:48.922207 15436 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.968259 15436 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.969198 15436 tablet_bootstrap.cc:492] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.969827 15436 ts_tablet_manager.cc:1403] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.015s
I20260709 13:06:48.972055 15436 raft_consensus.cc:359] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.972810 15436 raft_consensus.cc:740] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.973315 15436 consensus_queue.cc:260] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:48.975204 15436 ts_tablet_manager.cc:1434] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:06:48.975893 15436 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap starting.
I20260709 13:06:48.995728 15436 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:48.996397 15436 tablet_bootstrap.cc:492] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Bootstrap complete.
I20260709 13:06:48.996946 15436 ts_tablet_manager.cc:1403] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 13:06:48.999236 15436 raft_consensus.cc:359] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:48.999786 15436 raft_consensus.cc:740] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.000476 15436 consensus_queue.cc:260] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:49.001955 15436 ts_tablet_manager.cc:1434] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:06:49.012781 15479 raft_consensus.cc:3060] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.098368 15483 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.125537 15483 raft_consensus.cc:3060] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.132853 15482 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.194587 15482 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:54.934792 14619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.024s	sys 0.031s
W20260709 13:06:54.935279 14619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.024s	sys 0.032s
I20260709 13:06:54.950748 15586 raft_consensus.cc:493] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:54.966174 15586 raft_consensus.cc:515] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:54.973933 14616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.005s	sys 0.005s
W20260709 13:06:54.988387 14616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.006s	sys 0.005s
I20260709 13:06:54.995110 15581 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:54.996048 15581 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.066128 15581 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.069854 15589 raft_consensus.cc:493] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.070611 15589 raft_consensus.cc:515] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.072794 15589 leader_election.cc:290] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.074496 14648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45520 (request call id 512) took 1105 ms. Trace:
I20260709 13:06:55.075572 14648 rpcz_store.cc:276] 0709 13:06:53.968828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.000686 (+1031858us) service_pool.cc:224] Handling call
0709 13:06:55.001131 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.001331 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.001382 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.001426 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:55.001464 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.074156 (+ 72692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.074313 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.079833 15586 leader_election.cc:290] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.080360 15586 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.080827 15586 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.082909 15586 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.032918 15594 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.092383 15594 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.094956 15594 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.095484 15594 raft_consensus.cc:493] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.075117 15587 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.144867 15587 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.097810 15597 raft_consensus.cc:493] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.146698 15597 raft_consensus.cc:515] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.148898 15597 leader_election.cc:290] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.105486 15599 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.149720 15599 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.152259 15599 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.153141 15599 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.043993 15590 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.155165 15590 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.158236 15590 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.072649 15593 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.159368 15593 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.119287 15595 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.063197 15591 raft_consensus.cc:493] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.162038 15591 raft_consensus.cc:515] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.164371 15591 leader_election.cc:290] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.164947 15591 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.165416 15591 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.167249 15591 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.167685 15591 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.168148 15591 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.169512 15593 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.170099 15593 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.170521 15593 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.172722 15593 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.161629 15595 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.175063 15595 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.155825 15594 raft_consensus.cc:515] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.178997 15594 leader_election.cc:290] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.199468 15600 raft_consensus.cc:493] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.200168 15600 raft_consensus.cc:515] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.154935 15599 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.212561 15599 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.215221 15598 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.215943 15598 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.218156 15598 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.220306 15608 raft_consensus.cc:493] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.220674 15603 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.222357 15604 raft_consensus.cc:493] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.240533 15603 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.240710 15604 raft_consensus.cc:515] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.242684 15603 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.222746 15592 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.224200 15591 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.247676 15587 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.248076 15592 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.248837 15604 leader_election.cc:290] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.227067 15605 raft_consensus.cc:493] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.249881 15605 raft_consensus.cc:515] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.250512 15592 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.229359 15606 raft_consensus.cc:493] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.231297 15609 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.233708 15613 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
W20260709 13:06:55.234047 14764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.011s	sys 0.018s
I20260709 13:06:55.234875 15611 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.237567 15615 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.252907 15613 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.253321 15615 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:55.237861 14766 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.006s	sys 0.018s
I20260709 13:06:55.232568 15590 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.255087 15613 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.252130 15609 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.252948 15611 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.257613 15609 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.258126 15611 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.255447 15615 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:55.255016 14766 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.006s	sys 0.018s
I20260709 13:06:55.261250 15603 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.261775 15603 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.263707 15603 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
W20260709 13:06:55.267643 14767 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.225s	user 0.011s	sys 0.008s
W20260709 13:06:55.268080 14767 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.011s	sys 0.008s
I20260709 13:06:55.269246 15603 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.269750 15603 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.271003 15599 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.271652 15603 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.271508 15599 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.238595 15589 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.231469 15607 raft_consensus.cc:493] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
W20260709 13:06:55.252580 14764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.011s	sys 0.018s
I20260709 13:06:55.272585 15607 raft_consensus.cc:515] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.275537 15607 leader_election.cc:290] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.276093 15589 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.277706 15614 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.278219 15614 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.278540 15591 raft_consensus.cc:493] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.279039 15591 raft_consensus.cc:515] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.280267 15614 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.280802 15614 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.280987 15591 leader_election.cc:290] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.291631 15599 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.281884 15614 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.283567 15595 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.298215 15614 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.297950 15595 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.299571 15612 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.300040 15591 raft_consensus.cc:493] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.300209 15607 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.300519 15595 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.300704 15607 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.301491 15614 raft_consensus.cc:493] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.301992 15614 raft_consensus.cc:515] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.302802 15607 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.304101 15614 leader_election.cc:290] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.304579 15614 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.243640 15608 raft_consensus.cc:515] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.255573 15590 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.305852 15619 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.306354 15619 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.307102 15608 leader_election.cc:290] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.252091 15606 raft_consensus.cc:515] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.309190 15606 leader_election.cc:290] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.284983 15600 leader_election.cc:290] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.285317 15598 raft_consensus.cc:493] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.300563 15591 raft_consensus.cc:515] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.272151 15603 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.271961 15483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38480 (request call id 210) took 1223 ms. Trace:
I20260709 13:06:55.310600 15483 rpcz_store.cc:276] 0709 13:06:54.048139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.053646 (+  5507us) service_pool.cc:224] Handling call
0709 13:06:54.053959 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.054142 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.054164 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.054212 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:54.054239 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.054313 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.271896 (+1217583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.311743 15603 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.308346 15619 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.300089 15612 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.307286 15590 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.310271 15598 raft_consensus.cc:515] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.314464 15603 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.288091 15605 leader_election.cc:290] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.288393 15613 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.288832 15609 raft_consensus.cc:493] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.311834 15591 leader_election.cc:290] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.289248 15611 raft_consensus.cc:493] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.289477 15589 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.289712 15615 raft_consensus.cc:493] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.314836 15612 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.315831 15611 raft_consensus.cc:515] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.315971 15615 raft_consensus.cc:515] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.317206 15613 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.315510 15609 raft_consensus.cc:515] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.325169 15611 leader_election.cc:290] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.325196 15613 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.321692 15598 leader_election.cc:290] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.391340 15587 raft_consensus.cc:493] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.161695 14653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45520 (request call id 510) took 1216 ms. Trace:
I20260709 13:06:55.384377 15568 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.391546 15582 raft_consensus.cc:493] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.393862 15596 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.393684 15582 raft_consensus.cc:515] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.394827 15596 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.396966 15568 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.400179 15594 raft_consensus.cc:493] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.399858 15568 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.384374 15581 raft_consensus.cc:493] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.325199 15609 leader_election.cc:290] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.390446 15586 raft_consensus.cc:493] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.417622 15586 raft_consensus.cc:515] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.418001 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.419062 15482 raft_consensus.cc:2468] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.391424 15589 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.325169 15615 leader_election.cc:290] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.305070 15614 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.451220 15602 raft_consensus.cc:493] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.414968 15598 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.392513 15587 raft_consensus.cc:515] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.415555 15604 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.415841 15613 raft_consensus.cc:493] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.416599 15611 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.392549 14653 rpcz_store.cc:276] 0709 13:06:53.945178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.160691 (+1215513us) service_pool.cc:224] Handling call
0709 13:06:55.160997 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.161187 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.161211 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.161252 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:55.161280 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.161330 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.161519 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.421952 15582 leader_election.cc:290] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.421908 15618 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.423614 15568 raft_consensus.cc:493] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.420511 15586 leader_election.cc:290] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.455247 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.455377 15617 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.456194 15482 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:55.437925 15616 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.456662 15604 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.457517 15616 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.458681 15602 raft_consensus.cc:515] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.460496 15616 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.407714 15596 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.458304 15568 raft_consensus.cc:515] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:55.455597 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 63772.7us
I20260709 13:06:55.461278 15602 leader_election.cc:290] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.448024 15581 raft_consensus.cc:515] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.448505 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.485327 15620 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.486389 15620 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.466997 14646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.488108 14649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45520 (request call id 514) took 1518 ms. Trace:
I20260709 13:06:55.401115 15594 raft_consensus.cc:515] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.466696 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.501956 14650 raft_consensus.cc:2468] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.503260 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.467897 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.503638 15594 leader_election.cc:290] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.451864 15589 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.504884 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.491046 15581 leader_election.cc:290] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.506067 15589 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.467406 15568 leader_election.cc:290] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.507021 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.507828 15482 raft_consensus.cc:2468] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.482131 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.483412 15614 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.461449 15618 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.456306 15617 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.449048 15599 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.500147 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.511967 15599 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.462193 15613 raft_consensus.cc:515] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.464141 15587 leader_election.cc:290] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.466135 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.470582 15615 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.511369 15618 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.519444 15594 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.513481 15617 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.520375 15594 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.461596 15609 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.455418 15598 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.490213 14651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45520 (request call id 509) took 1545 ms. Trace:
I20260709 13:06:55.467365 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.461916 15611 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.528904 15609 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.529328 15615 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.531049 15611 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.518687 15596 raft_consensus.cc:493] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.531704 15609 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.463408 15604 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.519119 15483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:55.468286 14674 debug-util.cc:398] Leaking SignalData structure 0x7b08002b4880 after lost signal to thread 7008
I20260709 13:06:55.521677 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.518992 15599 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.528888 14651 rpcz_store.cc:276] 0709 13:06:53.944890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.488911 (+1544021us) service_pool.cc:224] Handling call
0709 13:06:55.489424 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.489679 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.489705 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.489779 (+    74us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:55.489849 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.489910 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.490014 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.512974 15582 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.535488 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.535768 15592 raft_consensus.cc:493] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.535490 15479 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.536458 15475 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.536640 15592 raft_consensus.cc:515] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.533929 15594 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.510725 14649 rpcz_store.cc:276] 0709 13:06:53.969449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.450213 (+1480764us) service_pool.cc:224] Handling call
0709 13:06:55.450813 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.483489 (+ 32676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.483534 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.483628 (+    94us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:55.483674 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.487673 (+  3999us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5400478454. stack: 00007fbd21c09343 00007fbd21c09240 00007fbd215981d4 00007fbd2b2d6304 00007fbd2b2d6299 00007fbd24c91571 00007fbd24d28e01 00007fbd24d2783e 00007fbd29cec419 00007fbd23263bd4 00007fbd23263b62 00007fbd23263a91 00007fbd23263a0c 00007fbd23262cc2 00007fbd2306348c 00007fbd230628c6
0709 13:06:55.487732 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.487906 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44780800}
I20260709 13:06:55.535212 15580 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.536057 15582 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.539800 15580 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.540870 15615 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.532014 15596 raft_consensus.cc:515] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.542414 15582 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.543503 15596 leader_election.cc:290] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.511341 15620 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:55.544109 14674 debug-util.cc:398] Leaking SignalData structure 0x7b08002898e0 after lost signal to thread 14510
I20260709 13:06:55.545035 15598 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.542554 15594 raft_consensus.cc:493] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.546206 15594 raft_consensus.cc:515] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.549119 15624 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.536137 15483 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.551083 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.551328 15613 leader_election.cc:290] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.539158 15592 leader_election.cc:290] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.556598 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.557492 15482 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:55.561426 15604 raft_consensus.cc:493] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.562116 15604 raft_consensus.cc:515] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.542114 15580 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.565985 15624 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.568745 15624 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.573801 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.574595 15482 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:55.575392 15596 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.576128 15596 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.578423 15596 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.579422 15592 raft_consensus.cc:493] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.580329 15592 raft_consensus.cc:515] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.581018 15631 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.581883 15631 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.583012 15592 leader_election.cc:290] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.583693 15592 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.584378 15592 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.585770 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.586385 15482 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.589488 15594 leader_election.cc:290] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.592140 15613 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.592741 15613 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.595595 15613 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
W20260709 13:06:55.575464 14674 debug-util.cc:398] Leaking SignalData structure 0x7b08001505a0 after lost signal to thread 15508
I20260709 13:06:55.598434 15477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.598939 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.601989 15478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.603434 15604 leader_election.cc:290] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.607066 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.608382 15479 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:55.608757 15594 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.610862 15594 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:55.613263 14764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 47708.2us
I20260709 13:06:55.584301 15631 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.632344 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.628608 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.638320 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.632802 15481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.628546 15599 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.640012 15599 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.613564 15633 raft_consensus.cc:493] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.641227 15633 raft_consensus.cc:515] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.642460 15599 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.618625 14765 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.631692 15626 raft_consensus.cc:493] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.643580 15626 raft_consensus.cc:515] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.632308 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.642361 15477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.631155 15627 raft_consensus.cc:493] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.644724 14765 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:55.631428 15603 raft_consensus.cc:493] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.647111 15603 raft_consensus.cc:515] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.641526 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.647854 15620 raft_consensus.cc:2804] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.648381 15620 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.648761 15620 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.618306 15594 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.645788 15475 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:55.649792 15626 leader_election.cc:290] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.650502 15626 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.650847 15626 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.651253 15626 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.619370 14764 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:55.654579 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.655201 15479 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:55.655488 15623 raft_consensus.cc:2804] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.655867 15623 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.630899 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.657308 15603 leader_election.cc:290] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.657718 14765 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:55.657851 15483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.647960 15592 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.658613 15483 raft_consensus.cc:2468] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:55.658803 15593 raft_consensus.cc:2804] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.663472 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.664773 15476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.665540 15623 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.666580 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.667338 15477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.670377 15601 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.670739 15629 raft_consensus.cc:493] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.670921 15604 raft_consensus.cc:493] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.683512 15601 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.684144 15604 raft_consensus.cc:515] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.685963 15601 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.681254 15483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.686302 15604 leader_election.cc:290] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.671298 15580 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.672497 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.630403 15478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.687019 15580 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.673507 15568 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.688130 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.688251 15568 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.689052 15580 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.683634 15629 raft_consensus.cc:515] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.690320 15568 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.670591 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.691629 15629 leader_election.cc:290] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.677719 15624 raft_consensus.cc:493] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.678377 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.675506 15593 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.692426 15624 raft_consensus.cc:515] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.693027 15593 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.694619 15624 leader_election.cc:290] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.695492 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.696059 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea0a87730ae48b398447afece8bcc4e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.680311 15476 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:55.681391 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.682111 15481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.683447 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.681779 15620 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.700263 14691 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:55.646440 15627 raft_consensus.cc:515] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.701038 14798 raft_consensus.cc:1240] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.702543 15624 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.702934 15627 leader_election.cc:290] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.703929 15620 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.706411 15593 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.708333 15593 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.702951 15624 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.686054 15631 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.711464 15631 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.711861 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.711349 15594 raft_consensus.cc:493] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.713287 15594 raft_consensus.cc:515] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.714550 15631 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.715304 15594 leader_election.cc:290] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.709209 15624 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.644279 15633 leader_election.cc:290] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.734817 15629 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.735478 15635 raft_consensus.cc:493] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.736315 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.735558 15629 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.738832 15629 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.736086 15635 raft_consensus.cc:515] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.739634 15629 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.740183 15629 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.740993 15635 leader_election.cc:290] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.742141 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.742257 15629 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.743482 15630 raft_consensus.cc:493] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.744059 15630 raft_consensus.cc:515] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.744745 15623 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.746625 15631 raft_consensus.cc:493] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.741549 15635 raft_consensus.cc:493] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.747385 15635 raft_consensus.cc:515] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.747697 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.748039 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a3f00eb3c740b0ad48a7844a8ad8e8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.748384 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.748716 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.763270 14798 raft_consensus.cc:2468] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:55.749698 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.765862 14795 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:55.749902 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.766788 14800 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:55.750865 14794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.749699 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.747284 15631 raft_consensus.cc:515] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.746379 15630 leader_election.cc:290] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.757614 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.769131 14653 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.757779 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:55.758046 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.758522 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.760843 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.770197 15631 leader_election.cc:290] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.770591 14649 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.766089 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
W20260709 13:06:55.761526 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 153438us
I20260709 13:06:55.750823 15623 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.773394 14765 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.775575 15620 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.775983 15620 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.773841 14690 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.776373 15620 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.777582 15613 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.777786 15630 raft_consensus.cc:2749] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.778235 15613 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.780306 15613 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.776129 14765 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.785158 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.787127 15593 raft_consensus.cc:2804] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.789832 15593 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.790424 15593 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.785655 14617 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:55.792989 14617 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:55.793179 15594 raft_consensus.cc:2804] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.793610 15594 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.793962 15594 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.795723 15622 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.796289 14765 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:55.796670 14617 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:55.796284 15622 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.799185 15622 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.799801 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.800203 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.800515 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.801573 14719 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.776396 15626 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.801277 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.801226 14726 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.803545 15626 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:06:55.797423 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 44784.3us
I20260709 13:06:55.798418 15599 raft_consensus.cc:2804] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.805599 15599 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.806008 15599 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.798358 14721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.806131 14691 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:55.806758 14721 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:55.785943 15620 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.808514 14765 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.807857 15630 raft_consensus.cc:2804] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.725324 15624 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.810809 15596 raft_consensus.cc:2804] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.817786 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.819789 14727 raft_consensus.cc:1240] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Rejecting Update request from peer d54b0718d36f4f72ac7cef2358fbe6b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.819998 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.822866 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.811820 15594 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.825929 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.826081 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.812448 15630 raft_consensus.cc:493] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.827956 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.828724 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.828863 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.829790 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.832423 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.832542 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.833575 15635 leader_election.cc:290] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.834978 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.827236 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.836158 14794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.833724 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b133e1b7b49e7aa040543173e9286" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.837065 14794 raft_consensus.cc:2393] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 2: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:55.819363 15596 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.837880 15596 raft_consensus.cc:3060] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.833168 14800 raft_consensus.cc:2468] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 1.
I20260709 13:06:55.838286 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.818558 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.824309 15620 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.818015 15623 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.840698 15623 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.841111 15623 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.843830 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.843489 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.830622 15630 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.844780 14765 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:55.813706 15593 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.845995 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.847718 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.847450 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.848987 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.847222 14765 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:55.843606 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.849053 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.850821 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.852345 15603 raft_consensus.cc:2804] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.854933 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.857963 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.855552 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.857021 15603 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.859616 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.856773 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.858444 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.866806 15481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.867214 15630 raft_consensus.cc:515] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.868567 15623 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.859937 15603 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.869673 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.870831 15623 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.871461 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.870895 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.855417 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.868820 15481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.873737 15593 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.874189 15481 raft_consensus.cc:2468] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:55.875072 15630 leader_election.cc:290] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.876698 15596 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.877935 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.878449 15481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.878968 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2075e17bd50a4018aca3418b80b18311" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.879148 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.879374 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.880376 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.879016 15481 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.881705 15596 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.883350 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.884919 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.880683 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.886355 14691 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:55.886811 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.887176 15599 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.887846 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.887667 15631 raft_consensus.cc:2804] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.888334 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.888936 14618 leader_election.cc:304] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:55.890580 15589 raft_consensus.cc:2749] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.888643 15631 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:55.891202 15631 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.891296 15589 consensus_queue.cc:1059] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:55.891834 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.892457 15602 raft_consensus.cc:3055] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:55.892827 15602 raft_consensus.cc:740] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:55.884876 15624 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.893740 15602 consensus_queue.cc:260] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.894825 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.895102 15602 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.875149 15594 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.849635 15620 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.897527 15620 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.897710 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.898753 15620 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.899320 15631 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:55.900245 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.901823 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.902328 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.903282 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.903352 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.904690 15631 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:55.907281 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.908885 15603 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.949115 15603 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.929009 15620 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:55.952433 14792 raft_consensus.cc:1240] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.954114 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.955781 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.956889 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:55.958127 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.959293 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.959559 14767 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.960074 15620 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:55.960723 15620 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.960851 15477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.961134 15620 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.961637 15620 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.964080 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:55.965256 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:55.965986 14767 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.971974 15620 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.974013 15620 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.976958 14767 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.978394 15623 raft_consensus.cc:2804] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.978781 15623 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.979148 15623 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.980108 15627 raft_consensus.cc:2804] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.980788 15627 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:55.981155 15627 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.981505 15593 consensus_queue.cc:1059] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:55.984200 15593 raft_consensus.cc:3055] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.984515 15593 raft_consensus.cc:740] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:55.985553 15593 consensus_queue.cc:260] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:55.986735 15593 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.991566 15623 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.992547 15477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.993729 15623 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.994302 14764 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:55.995591 15626 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:55.995853 15477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.996762 14764 leader_election.cc:304] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:55.998065 14764 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:55.999536 15617 raft_consensus.cc:2749] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.002074 15620 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.002512 15620 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:56.002859 15620 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.005662 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.006891 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.007979 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.009011 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.010121 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.011163 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.012203 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.011763 15620 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.013314 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.014915 15620 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:56.015184 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.016518 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.017519 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.018497 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.019500 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.995963 15626 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:56.021981 15626 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.022114 15430 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.023620 15613 raft_consensus.cc:2749] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.024868 15430 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.026181 15613 raft_consensus.cc:2749] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.913182 15481 raft_consensus.cc:2468] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:55.913571 15622 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:56.027313 15482 raft_consensus.cc:1240] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Rejecting Update request from peer d54b0718d36f4f72ac7cef2358fbe6b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.027446 15430 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.028515 15622 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.914588 14796 raft_consensus.cc:1240] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.914759 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.915446 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8104dc86ca4c3e84135792a5ac1769" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.915795 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.916126 15476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.029254 15627 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:55.916712 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.030565 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:56.031615 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:56.031797 14651 raft_consensus.cc:1240] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.032145 15627 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:55.916800 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:56.033071 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356bbe8ee6554693b1a545b2da7051c8" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.917304 14646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.917686 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.917920 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.918467 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.919155 15478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.919543 15483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.919941 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.920874 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9633676643a14702b9f1cbf070a1e46d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:55.921563 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:55.922209 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:55.923884 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.924929 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.924521 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.916075 15599 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:55.928951 15432 leader_election.cc:304] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:55.929752 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
W20260709 13:06:56.045686 15432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 116927us
I20260709 13:06:56.046512 14801 raft_consensus.cc:1240] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.931193 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:56.048111 14800 raft_consensus.cc:1240] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.932960 14794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.932232 14797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:55.938724 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d41095708f541448eba428743f63659" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.050127 14646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:55.939338 14618 leader_election.cc:304] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.051365 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:56.051815 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 112568us
I20260709 13:06:56.051925 14725 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:55.940677 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.940426 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.053565 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.053685 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.053910 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.054739 15483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.043181 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:55.942245 14718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.055125 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.942494 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd33d2753c08470f9b9b1d7145f75b16" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.941781 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2666ab9efa994f198f2fb2f02c70df8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.942873 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5fb9d53fa74b5ba11f946ac902a5f2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.943186 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:55.944929 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:56.028723 15613 raft_consensus.cc:2749] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.034739 14691 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:06:55.945873 14721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.035874 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:56.044363 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.044554 14799 raft_consensus.cc:1240] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.043864 15430 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.045771 15598 raft_consensus.cc:2804] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.052523 14618 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:55.941264 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.052786 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:56.055135 14767 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.056473 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.063475 14618 leader_election.cc:304] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:56.059973 15633 raft_consensus.cc:2804] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.064296 14618 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:56.065253 15622 raft_consensus.cc:2749] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.066879 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.069176 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.067929 14618 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:56.070436 14618 leader_election.cc:304] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.067873 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.072309 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.056495 14718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.060832 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.062529 15598 raft_consensus.cc:493] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:55.966352 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:56.071445 15582 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.063988 14794 raft_consensus.cc:1240] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.073897 14618 leader_election.cc:304] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.064280 15596 raft_consensus.cc:2749] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.075619 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.071688 15586 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.081729 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.084296 15586 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:56.084594 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b65e4261c474c129d623f3ba0ce2600" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.068678 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.085301 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.077607 15598 raft_consensus.cc:3060] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.085783 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea40529e58642ecad3ba57398343c6f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.086458 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.086974 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6652116aaa1648d2bc0a4cd9b44ade8f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.087575 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.087894 14718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.067281 15613 raft_consensus.cc:2749] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.082895 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.074519 15622 raft_consensus.cc:2749] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.089001 14718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.084769 15586 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.084352 15581 raft_consensus.cc:2749] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.067868 15638 raft_consensus.cc:2804] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:56.090099 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7024877fba144524a8e2d1e04cb420d7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.082919 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.091487 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6d2fcb98dd448f83c04cf7b41c0d4a" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.082382 15582 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:56.092701 15582 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.093562 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.094692 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51da01c912804ff4ac1b26589077ae40" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.094961 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.095131 14718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.095702 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.073654 15633 raft_consensus.cc:697] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.095994 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.076942 14721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
W20260709 13:06:56.097440 15430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 53631.7us
I20260709 13:06:56.097937 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.088119 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff0cde640b64fd6b574f51fc2c50a62" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.098655 15581 consensus_queue.cc:1059] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:56.098778 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.092806 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.102593 14726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93517bd81c4746cd9280a1658d50fe99" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.101245 15430 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.101802 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa647d819f4427c8f1eecbe00003fa4" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.100891 14723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d627f14ee4f22a43a3b0d36455e24" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.091888 15638 raft_consensus.cc:493] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:56.096284 14718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
W20260709 13:06:56.106253 14619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 69700.6us
I20260709 13:06:56.104444 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.108757 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.109513 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.109863 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.110215 15613 raft_consensus.cc:2749] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.102844 15581 raft_consensus.cc:3055] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.111053 15581 raft_consensus.cc:740] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.112524 15581 consensus_queue.cc:260] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.103610 14721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9cb0b2e53c4638b38fef94ecff6df7" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.113600 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f8f129f7da41399b8c4084d2514329" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.113969 15581 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.116611 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:56.115527 14690 leader_election.cc:304] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.105810 15622 consensus_queue.cc:1059] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:56.118376 14690 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.119643 14690 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.120546 15624 raft_consensus.cc:2749] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.120453 15626 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.107904 15638 raft_consensus.cc:3060] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.102810 15633 consensus_queue.cc:237] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.122032 15635 raft_consensus.cc:2749] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.123903 14690 leader_election.cc:304] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.124799 15596 consensus_queue.cc:1059] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.125959 15594 raft_consensus.cc:3055] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.126358 15594 raft_consensus.cc:740] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.126492 15622 raft_consensus.cc:3055] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.126874 15622 raft_consensus.cc:740] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.127202 15594 consensus_queue.cc:260] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.127724 15622 consensus_queue.cc:260] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.128399 15594 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.121687 15624 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.125921 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.130651 14690 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.122110 15430 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.131502 15631 raft_consensus.cc:2749] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.131413 14692 leader_election.cc:304] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.137840 15613 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.140466 15624 raft_consensus.cc:2749] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.140316 15631 raft_consensus.cc:2749] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.135798 14765 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.142059 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.144202 15593 raft_consensus.cc:2749] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.131928 15603 consensus_queue.cc:1059] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:56.144546 15589 consensus_queue.cc:1059] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.145062 15596 consensus_queue.cc:1059] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:56.144308 14692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 53661us
I20260709 13:06:56.147156 14692 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.145781 15622 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.148064 15587 raft_consensus.cc:3055] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.148403 15627 raft_consensus.cc:3055] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.148859 15627 raft_consensus.cc:740] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:56.148468 15587 raft_consensus.cc:740] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.129540 15582 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.149859 15587 consensus_queue.cc:260] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.151010 15587 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.148108 15602 raft_consensus.cc:3055] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.153043 15602 raft_consensus.cc:740] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.153895 15602 consensus_queue.cc:260] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.155042 15602 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.149796 15627 consensus_queue.cc:260] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.126874 15598 raft_consensus.cc:515] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.158407 15627 raft_consensus.cc:3060] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.160209 14765 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.160940 14725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.155263 15582 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:56.162264 14796 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:56.163074 15593 raft_consensus.cc:2749] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.153913 15430 leader_election.cc:304] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.164408 14765 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.165876 15598 leader_election.cc:290] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:56.166584 15598 raft_consensus.cc:2749] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.167311 14619 leader_election.cc:304] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.169729 14619 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.171881 14645 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:56.172983 15624 raft_consensus.cc:2749] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.174049 15624 consensus_queue.cc:1059] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.175062 15635 raft_consensus.cc:3055] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.175443 15635 raft_consensus.cc:740] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.175577 15593 raft_consensus.cc:2749] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.176314 15635 consensus_queue.cc:260] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:56.177165 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:56.178073 15635 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.178303 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.179726 15596 raft_consensus.cc:2749] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.181589 14648 raft_consensus.cc:1240] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Rejecting Update request from peer d54b0718d36f4f72ac7cef2358fbe6b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.158591 15626 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:56.186165 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.188135 15638 raft_consensus.cc:515] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.188213 14765 leader_election.cc:304] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.190588 14619 leader_election.cc:304] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.190869 14765 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.152350 15586 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.198451 14765 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.200367 15593 raft_consensus.cc:2749] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.174979 14692 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.202392 14692 leader_election.cc:304] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.202237 15603 raft_consensus.cc:2749] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.203682 15601 raft_consensus.cc:2749] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:56.208676 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 62649us
I20260709 13:06:56.210659 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:56.171975 15581 raft_consensus.cc:2749] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.214861 14692 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.199716 15626 raft_consensus.cc:2749] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.216075 14617 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
W20260709 13:06:56.218439 15430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 64592us
I20260709 13:06:56.218595 14800 raft_consensus.cc:1240] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.228080 14692 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
W20260709 13:06:56.228238 14619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 56991.4us
I20260709 13:06:56.221566 15624 raft_consensus.cc:2749] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.229655 14617 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.229991 15581 raft_consensus.cc:2749] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.230583 15631 raft_consensus.cc:2749] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.212878 15601 raft_consensus.cc:2749] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.229125 14692 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.232445 15581 consensus_queue.cc:1059] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.233119 15596 raft_consensus.cc:2749] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.233635 15587 raft_consensus.cc:3055] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.233991 15587 raft_consensus.cc:740] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.234910 15601 raft_consensus.cc:2749] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.234812 15587 consensus_queue.cc:260] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.235406 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:56.235599 15601 consensus_queue.cc:1059] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.235976 15587 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.236725 15624 raft_consensus.cc:3055] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.237087 15624 raft_consensus.cc:740] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.237847 15624 consensus_queue.cc:260] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.239084 14764 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.241947 14692 leader_election.cc:304] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.242637 14764 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.216511 15613 raft_consensus.cc:2749] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.244041 14619 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.245023 15587 raft_consensus.cc:2749] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.245337 14619 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.246461 15602 raft_consensus.cc:2749] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.209097 15622 raft_consensus.cc:2749] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.246897 14764 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.247056 15586 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:56.245111 15617 raft_consensus.cc:2749] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.247728 15620 raft_consensus.cc:2749] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.247999 14619 leader_election.cc:304] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.243134 15626 raft_consensus.cc:2749] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.249944 15586 raft_consensus.cc:2749] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.250277 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:56.250875 15631 raft_consensus.cc:2749] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.251091 14619 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.251438 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:56.251814 15586 raft_consensus.cc:2749] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.246593 15638 leader_election.cc:290] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:56.253535 14619 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.254197 15638 raft_consensus.cc:2749] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.255036 14619 leader_election.cc:304] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.246019 15624 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.255805 15638 raft_consensus.cc:2749] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.256156 14619 leader_election.cc:304] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.256846 15638 raft_consensus.cc:2749] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.259228 14764 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.258664 14619 leader_election.cc:304] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.259907 15626 raft_consensus.cc:2749] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.260833 15638 raft_consensus.cc:2749] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.261042 14764 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.261804 15626 raft_consensus.cc:2749] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.262612 14619 leader_election.cc:304] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.263295 15638 raft_consensus.cc:2749] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.247740 15430 leader_election.cc:304] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.267020 15640 raft_consensus.cc:2749] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.267735 15430 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.268465 15640 raft_consensus.cc:2749] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.269332 15430 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.270095 15640 raft_consensus.cc:2749] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.271572 15430 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.272324 15640 raft_consensus.cc:2749] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.274195 14648 raft_consensus.cc:1240] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.274591 14644 raft_consensus.cc:1240] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.275820 14650 raft_consensus.cc:1240] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.272680 15430 leader_election.cc:304] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.276484 15631 consensus_queue.cc:1059] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.277051 15640 raft_consensus.cc:2749] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.277316 15635 consensus_queue.cc:1059] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.265468 14619 leader_election.cc:304] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.266309 14764 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.278712 15601 consensus_queue.cc:1059] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.280828 15473 raft_consensus.cc:1240] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.281319 15586 raft_consensus.cc:2749] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.279774 15601 raft_consensus.cc:3055] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.282099 15601 raft_consensus.cc:740] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.255105 14692 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.278168 14691 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.283198 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.283999 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.284219 15630 raft_consensus.cc:2749] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.284840 14619 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.285832 15638 raft_consensus.cc:2749] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.286134 14764 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.285847 15633 consensus_queue.cc:1059] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.286960 14692 leader_election.cc:304] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.286872 15627 raft_consensus.cc:2749] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.287285 15633 raft_consensus.cc:2749] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.277827 15631 raft_consensus.cc:3055] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.287236 15617 raft_consensus.cc:2749] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.288143 15631 raft_consensus.cc:740] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.288781 14619 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.284392 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceebbbc7cabf4ee4a60995c283eb7c47" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.289634 15638 raft_consensus.cc:2749] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.289021 15631 consensus_queue.cc:260] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.293613 15631 raft_consensus.cc:3060] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.287525 15629 raft_consensus.cc:3055] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.297706 15629 raft_consensus.cc:740] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.298520 15629 consensus_queue.cc:260] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.299823 14650 raft_consensus.cc:1240] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.300885 15629 raft_consensus.cc:3060] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.301815 15633 consensus_queue.cc:1059] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.288997 14764 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.302729 15633 raft_consensus.cc:3055] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.276927 14474 catalog_manager.cc:5697] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 2 to 3, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.303079 15633 raft_consensus.cc:740] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.303267 15627 raft_consensus.cc:2804] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:56.303781 15627 raft_consensus.cc:697] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:56.303961 15633 consensus_queue.cc:260] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.305887 15627 consensus_queue.cc:237] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.306164 15601 consensus_queue.cc:260] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:56.306677 15633 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.307646 15601 raft_consensus.cc:3060] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.313747 15630 raft_consensus.cc:2749] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.314262 14692 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.315120 15630 raft_consensus.cc:2749] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.315595 14692 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.316423 15630 raft_consensus.cc:2749] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.316915 14692 leader_election.cc:304] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.325865 14722 raft_consensus.cc:2468] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:56.327562 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.326682 14764 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.327627 14796 raft_consensus.cc:1240] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.330668 14800 raft_consensus.cc:1240] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.330772 14619 leader_election.cc:304] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.333420 15633 raft_consensus.cc:2749] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.334262 14792 raft_consensus.cc:1240] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.334131 15587 consensus_queue.cc:1059] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.332906 15586 raft_consensus.cc:2804] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:56.335305 15622 raft_consensus.cc:3055] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.335403 15586 raft_consensus.cc:697] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.335744 15622 raft_consensus.cc:740] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.336542 15622 consensus_queue.cc:260] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.337832 15622 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.340658 15617 raft_consensus.cc:2749] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.341594 15586 consensus_queue.cc:237] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.335098 15587 consensus_queue.cc:1059] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:06:56.345427 15587 raft_consensus.cc:3055] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.345746 15587 raft_consensus.cc:740] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.340741 15602 consensus_queue.cc:1059] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:56.346490 15587 consensus_queue.cc:260] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.348788 15587 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.348951 15617 consensus_queue.cc:1059] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.349550 15602 raft_consensus.cc:3055] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.349927 15602 raft_consensus.cc:740] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.350127 15599 raft_consensus.cc:3055] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.350267 15630 raft_consensus.cc:3055] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.350548 15599 raft_consensus.cc:740] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:56.350715 15630 raft_consensus.cc:740] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.351413 15599 consensus_queue.cc:260] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:56.351629 15630 consensus_queue.cc:260] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.352834 15630 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.354820 15599 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.357165 14764 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.360019 15602 consensus_queue.cc:260] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:56.361132 14692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 44304.6us
I20260709 13:06:56.361660 15602 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.365229 14476 catalog_manager.cc:5697] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 2, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 2 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.361781 14722 raft_consensus.cc:1240] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Rejecting Update request from peer d54b0718d36f4f72ac7cef2358fbe6b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.368821 15617 consensus_queue.cc:1059] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.369894 15617 raft_consensus.cc:3055] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.370210 15617 raft_consensus.cc:740] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:56.371201 15617 consensus_queue.cc:260] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:56.372525 15617 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.361889 14692 leader_election.cc:304] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.374109 15629 raft_consensus.cc:2749] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.374212 14692 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.376729 15624 raft_consensus.cc:2749] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.371088 14617 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:56.374786 15627 raft_consensus.cc:2749] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.378865 15602 raft_consensus.cc:2749] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.376778 14692 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.381821 15624 raft_consensus.cc:2749] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.382252 14692 leader_election.cc:304] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.384653 14764 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.384814 14692 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:56.388816 15624 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.389635 15624 raft_consensus.cc:697] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.390518 15624 consensus_queue.cc:237] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.391548 15433 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.392917 15433 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.399971 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c1574eeecf47e1b9d43861c4145347" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.393512 15640 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.395604 14792 raft_consensus.cc:1240] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.401144 15640 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:56.396925 14796 raft_consensus.cc:1240] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Rejecting Update request from peer 506ec781022645d4be0fcdf0bb76dd1a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.401620 15640 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.403115 15635 consensus_queue.cc:1059] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.403004 15613 raft_consensus.cc:2749] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.388079 15601 raft_consensus.cc:2749] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.404646 15629 consensus_queue.cc:1059] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.405638 15635 raft_consensus.cc:3055] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.408595 15635 raft_consensus.cc:740] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.410751 14722 raft_consensus.cc:2468] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:56.412073 15433 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.411918 15635 consensus_queue.cc:260] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.412740 15613 raft_consensus.cc:2749] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.408761 15629 raft_consensus.cc:3055] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:56.413192 15433 leader_election.cc:304] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.413623 15629 raft_consensus.cc:740] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:56.414529 15629 consensus_queue.cc:260] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:56.415851 15433 leader_election.cc:304] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.415943 15629 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.387969 15627 raft_consensus.cc:2749] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.418500 15613 raft_consensus.cc:2749] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.419018 15635 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.428045 15598 raft_consensus.cc:2749] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.433058 15433 leader_election.cc:304] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.433928 15598 raft_consensus.cc:2749] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.431022 15640 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:56.437901 15433 leader_election.cc:304] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.441952 15640 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:56.442322 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:56.443207 15433 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.444554 15640 raft_consensus.cc:2749] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.445992 15433 leader_election.cc:304] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.446714 15598 raft_consensus.cc:2749] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.447201 15433 leader_election.cc:304] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.447359 15598 raft_consensus.cc:2749] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.451748 14473 catalog_manager.cc:5697] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 2, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 2 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.464191 14474 catalog_manager.cc:5697] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 2 to 3, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.465673 15613 raft_consensus.cc:2749] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.466996 15433 leader_election.cc:304] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.478319 15598 raft_consensus.cc:2749] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.479775 15433 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.480579 15598 raft_consensus.cc:2749] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.481698 15433 leader_election.cc:304] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.482434 15598 raft_consensus.cc:2749] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.486783 15433 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.488485 15598 raft_consensus.cc:2749] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.489691 15433 leader_election.cc:304] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.490386 15598 raft_consensus.cc:2749] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.492296 15433 leader_election.cc:304] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.493043 15598 raft_consensus.cc:2749] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.494029 15433 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.494560 15598 raft_consensus.cc:2749] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.494949 15433 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.495674 15598 raft_consensus.cc:2749] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.496096 15433 leader_election.cc:304] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.496794 15598 raft_consensus.cc:2749] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.497206 15433 leader_election.cc:304] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.498051 15598 raft_consensus.cc:2749] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.498472 15433 leader_election.cc:304] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.499176 15598 raft_consensus.cc:2749] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.499605 15433 leader_election.cc:304] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.500708 15598 raft_consensus.cc:2749] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.501094 15433 leader_election.cc:304] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.501808 15598 raft_consensus.cc:2749] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.502198 15433 leader_election.cc:304] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.503538 15433 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.504034 15640 raft_consensus.cc:2749] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.504377 15433 leader_election.cc:304] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:56.504642 15640 raft_consensus.cc:2749] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.505141 15598 raft_consensus.cc:2804] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:56.506668 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:56.508069 15598 raft_consensus.cc:697] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:56.510206 15433 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:56.509091 15598 consensus_queue.cc:237] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:56.510653 15472 raft_consensus.cc:1240] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Rejecting Update request from peer df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.511379 15640 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.512136 15602 consensus_queue.cc:1059] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.513150 15602 raft_consensus.cc:3055] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:56.513741 15602 raft_consensus.cc:740] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:56.514959 15602 consensus_queue.cc:260] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:56.516809 15602 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.538280 14476 catalog_manager.cc:5697] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.586722 14796 raft_consensus.cc:1275] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.587894 15635 consensus_queue.cc:1048] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.607532 15472 raft_consensus.cc:1275] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.609145 15635 consensus_queue.cc:1048] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:56.709463 14644 raft_consensus.cc:1275] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.710493 15617 consensus_queue.cc:1048] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.720405 14722 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.738109 14722 raft_consensus.cc:1275] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.745535 15627 consensus_queue.cc:1048] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.748518 14796 raft_consensus.cc:3060] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.758728 14796 raft_consensus.cc:1275] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.760217 15602 consensus_queue.cc:1048] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.779099 14724 raft_consensus.cc:1275] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.780872 15586 consensus_queue.cc:1048] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.848781 15472 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.856515 15472 raft_consensus.cc:1275] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.858043 15624 consensus_queue.cc:1048] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.944178 14792 raft_consensus.cc:1275] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.955498 15601 consensus_queue.cc:1048] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:56.977504 14724 raft_consensus.cc:1275] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.979166 15598 consensus_queue.cc:1048] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.991323 14792 raft_consensus.cc:3060] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:56.997753 14792 raft_consensus.cc:1275] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:56.999233 15666 consensus_queue.cc:1048] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:57.147866 15602 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.148375 15602 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.151219 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.151857 14792 raft_consensus.cc:2468] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:57.153194 14618 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.153858 15587 raft_consensus.cc:2804] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.154136 15587 raft_consensus.cc:493] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.154399 15587 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.155655 15602 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.155859 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.160099 15587 raft_consensus.cc:515] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.161648 15587 leader_election.cc:290] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.162503 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.162412 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789330431ce4e7ea306d15229f2efe2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.163228 14792 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.169955 14792 raft_consensus.cc:2468] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.170924 14618 leader_election.cc:304] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:57.171625 15587 raft_consensus.cc:2804] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.172843 15587 raft_consensus.cc:697] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.174438 15587 consensus_queue.cc:237] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.184125 14474 catalog_manager.cc:5697] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.358978 15587 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.359566 15587 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.361603 15587 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.362694 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.362574 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.363407 14792 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.364238 14618 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.364804 15587 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.365191 15587 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.365540 15587 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.371271 15587 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.373857 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.374300 15587 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.374217 15622 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.374410 14792 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.375538 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.374949 15622 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.377882 15622 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.377985 15666 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:57.378566 15666 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.379237 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.380525 15666 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:57.381616 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:57.382002 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.382174 14727 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:57.382668 14650 raft_consensus.cc:2393] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 2: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:57.383980 15433 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:57.386771 15666 raft_consensus.cc:2804] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:57.387171 15666 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:57.387558 15666 raft_consensus.cc:3060] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:57.388093 14792 raft_consensus.cc:2468] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:06:57.394872 15666 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.397572 14618 leader_election.cc:304] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:57.398376 15622 raft_consensus.cc:2804] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.398766 15622 raft_consensus.cc:697] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.399416 15622 consensus_queue.cc:237] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.405300 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:57.406852 14650 raft_consensus.cc:2393] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 2: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:57.405521 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:57.408679 15666 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:57.402542 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.414106 14792 raft_consensus.cc:2468] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:57.421741 14474 catalog_manager.cc:5697] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.424660 14618 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:57.425971 15622 raft_consensus.cc:2804] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.426331 15622 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.426647 15622 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.428942 14727 raft_consensus.cc:2468] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:57.430066 15433 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:57.431047 15666 raft_consensus.cc:2804] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:57.432158 15666 raft_consensus.cc:697] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:06:57.433010 15666 consensus_queue.cc:237] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.434731 15622 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.438086 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.438314 15622 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.438700 14792 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.439805 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.446098 14792 raft_consensus.cc:2468] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.447219 14618 leader_election.cc:304] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:57.447947 15622 raft_consensus.cc:2804] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.448431 15622 raft_consensus.cc:697] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.449182 15622 consensus_queue.cc:237] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.449399 14474 catalog_manager.cc:5697] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.464154 14474 catalog_manager.cc:5697] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.551141 15666 raft_consensus.cc:493] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:57.551649 15666 raft_consensus.cc:515] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.553644 15666 leader_election.cc:290] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.554740 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.554749 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef572ce75064396b97d4704e5f93335" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.556468 14792 raft_consensus.cc:2368] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 3. Current term is 4.
I20260709 13:06:57.557438 15432 leader_election.cc:400] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 3. Current term is 4.
I20260709 13:06:57.557726 15432 leader_election.cc:403] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.558514 15666 raft_consensus.cc:3060] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.564112 15666 raft_consensus.cc:2749] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 3. Current term is 4.
I20260709 13:06:57.567850 15666 raft_consensus.cc:493] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:57.568202 15666 raft_consensus.cc:515] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.569823 15666 leader_election.cc:290] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.570429 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.570663 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf7b96dec18f42cd9f7cd905861e7ae2" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.571170 14792 raft_consensus.cc:2368] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:57.572410 15432 leader_election.cc:400] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:57.572677 15432 leader_election.cc:403] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.573141 15666 raft_consensus.cc:3060] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.577847 15666 raft_consensus.cc:2749] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:57.607614 15601 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.608139 15601 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.609937 15601 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:57.610601 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.611306 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.611899 14792 raft_consensus.cc:2468] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:57.612874 14692 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:57.613485 15624 raft_consensus.cc:2804] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.613812 15624 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.614049 15624 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.619045 15624 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.621168 15624 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:57.622383 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:57.622119 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.623804 14792 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.633873 14792 raft_consensus.cc:2468] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:57.634711 14692 leader_election.cc:304] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:57.635260 15624 raft_consensus.cc:2804] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.635699 15624 raft_consensus.cc:697] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:57.636449 15624 consensus_queue.cc:237] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.638496 14792 raft_consensus.cc:1275] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:57.639784 15622 consensus_queue.cc:1048] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:57.644099 15622 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.644574 15622 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.647274 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.647861 15472 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.649062 14617 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.649895 15587 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.650317 15587 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.650626 15587 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.653821 15622 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:57.654726 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:57.663415 15622 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.663981 15622 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.665565 14474 catalog_manager.cc:5697] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.668483 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.668700 15622 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.669135 14801 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.670441 14618 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.671480 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.674687 15587 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.677249 15622 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.677742 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.678515 15472 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.677676 15622 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.680598 15622 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.685146 15624 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.685197 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:57.684365 15627 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.687389 15624 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:57.687834 15627 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.690925 15624 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.691398 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.691867 15624 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.692305 15624 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.693976 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.694545 14801 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:57.690856 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.695526 15622 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.696430 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.695516 14692 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:57.698689 14644 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:57.699119 15601 raft_consensus.cc:2804] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.699558 15601 raft_consensus.cc:493] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.699873 15601 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.699906 14690 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.700791 15629 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.701146 15629 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.701469 15629 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.696774 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.698324 15475 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 1.
I20260709 13:06:57.707911 15602 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.708176 15629 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.708397 15602 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.710476 15602 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:57.694869 15624 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.711613 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:57.712345 14724 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 1.
I20260709 13:06:57.712713 15627 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:57.684136 15587 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:57.714169 14619 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.715152 15602 raft_consensus.cc:2804] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.715509 15602 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.713255 15601 raft_consensus.cc:515] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:57.714058 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.711723 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.715170 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:57.716243 14801 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:57.716655 14724 raft_consensus.cc:2468] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:57.717047 14796 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.715828 15602 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.718163 14767 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:57.719520 15617 raft_consensus.cc:2804] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.719882 15617 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.720198 15617 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.717312 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:57.730108 14644 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.731606 15629 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.733031 14796 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:06:57.735049 15601 leader_election.cc:290] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.735888 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.736542 14801 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.737248 15587 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.737725 15587 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.739573 15587 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.740550 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.741206 15475 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:57.742316 14617 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.744516 14618 leader_election.cc:304] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.747192 15472 raft_consensus.cc:2468] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:06:57.748391 14617 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:57.749416 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.750204 14796 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.750669 15679 raft_consensus.cc:2804] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.751160 15679 raft_consensus.cc:697] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.751955 15679 consensus_queue.cc:237] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.747751 15587 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.756271 15587 raft_consensus.cc:493] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.756603 15587 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.762672 15602 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.765978 15602 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:57.759063 15617 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.759909 15622 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.778604 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:57.779246 14724 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.780228 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.782859 15617 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:57.760918 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.762784 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c58429a8964ea4bc7fe0ae68093fde" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.784564 15475 raft_consensus.cc:3060] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.784487 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:57.785416 14727 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.784543 14476 catalog_manager.cc:5697] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.791862 15475 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:57.756709 14644 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 4.
I20260709 13:06:57.792948 14724 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.758263 15684 raft_consensus.cc:2804] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.793917 15684 raft_consensus.cc:697] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.794193 14619 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.795322 14690 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.794750 15684 consensus_queue.cc:237] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.802323 14727 raft_consensus.cc:2468] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 3.
I20260709 13:06:57.763978 14801 raft_consensus.cc:2468] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:57.773792 15640 raft_consensus.cc:493] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:57.803407 15640 raft_consensus.cc:515] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.804033 14692 leader_election.cc:304] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:57.804816 15680 raft_consensus.cc:2804] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.805259 15680 raft_consensus.cc:697] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
W20260709 13:06:57.804831 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 56518.9us
I20260709 13:06:57.805471 15640 leader_election.cc:290] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.806047 15680 consensus_queue.cc:237] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:57.807072 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.807729 15475 raft_consensus.cc:3060] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.800274 15679 raft_consensus.cc:2804] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.792914 15472 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.809907 15679 raft_consensus.cc:697] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.807900 14767 leader_election.cc:304] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:06:57.808259 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.767629 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.820135 15617 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.820722 15617 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.822151 15640 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:57.822710 15479 raft_consensus.cc:3060] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.824564 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.824820 15472 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 4.
I20260709 13:06:57.797601 15601 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.825516 15601 raft_consensus.cc:697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:57.826313 15601 consensus_queue.cc:237] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.828785 15626 raft_consensus.cc:2804] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:57.822671 15640 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.829393 15626 raft_consensus.cc:697] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:57.829856 15473 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:57.820363 14801 raft_consensus.cc:2368] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 3. Current term is 4.
I20260709 13:06:57.830231 15626 consensus_queue.cc:237] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.831614 14765 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:57.831964 15479 raft_consensus.cc:1275] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:57.832578 15662 raft_consensus.cc:2804] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.832954 15662 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.833482 15662 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.837766 15432 leader_election.cc:400] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 3. Current term is 4.
I20260709 13:06:57.838117 15432 leader_election.cc:403] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.820225 15679 consensus_queue.cc:237] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.841792 15622 consensus_queue.cc:1048] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:57.845758 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959e66f7e7ea4430b66b08c75d3f8a3d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.820230 14796 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.866190 14796 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:57.881004 15666 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:57.881652 15666 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.883801 15666 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.885857 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.886596 14650 raft_consensus.cc:2393] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 2: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:57.871114 14648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:57.874617 15681 raft_consensus.cc:493] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.889333 15681 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.890466 15475 raft_consensus.cc:2468] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:06:57.894554 15662 raft_consensus.cc:515] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.895251 14648 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:57.895792 15587 raft_consensus.cc:515] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:57.896814 15662 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.894797 15681 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.898208 15690 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:57.909790 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.898473 14476 catalog_manager.cc:5697] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.865772 15617 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.902465 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:57.910539 14796 raft_consensus.cc:2393] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 3: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:57.910812 14650 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.916071 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:57.916702 14796 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.918678 15473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.919263 15473 raft_consensus.cc:3060] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.923588 14796 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:06:57.932196 15697 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.932765 15697 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:57.936431 15697 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.930114 14618 leader_election.cc:304] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:57.901285 15675 raft_consensus.cc:2749] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 3. Current term is 4.
I20260709 13:06:57.943837 15683 raft_consensus.cc:2804] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.945093 15624 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:57.953224 14727 raft_consensus.cc:1275] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:57.957183 15482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1bac898ef214078a9abf3e595a27520" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:57.929054 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:57.960335 15482 raft_consensus.cc:3060] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.955590 15587 leader_election.cc:290] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:57.995894 15640 leader_election.cc:290] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.920583 15690 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:57.960031 15624 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:57.997397 15473 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 3.
I20260709 13:06:57.998253 15690 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:57.960502 15683 raft_consensus.cc:697] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:57.999461 15683 consensus_queue.cc:237] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.003264 15679 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.003703 15679 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.006225 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:57.998459 15624 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.006870 15479 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:58.007606 15627 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.008069 15627 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.008932 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.010455 15679 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:58.010053 14474 catalog_manager.cc:5697] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.993716 15676 consensus_queue.cc:1048] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:58.011565 15478 raft_consensus.cc:1275] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.013760 15478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:58.014457 15478 raft_consensus.cc:2368] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 3. Current term is 4.
I20260709 13:06:58.017192 15676 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:58.017755 15676 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.019826 15624 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.020315 15624 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.020748 15676 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:58.022179 15624 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.022557 14691 leader_election.cc:400] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631) with higher term. Message: Invalid argument: T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 3. Current term is 4.
I20260709 13:06:58.022866 14691 leader_election.cc:403] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.031144 15624 raft_consensus.cc:3060] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.032249 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.032932 14644 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:58.033865 15475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:58.034325 15430 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.034667 15475 raft_consensus.cc:2393] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 3: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:58.035524 15622 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.035931 14617 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:06:58.037251 15483 raft_consensus.cc:1275] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.039443 14650 raft_consensus.cc:2468] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 3.
I20260709 13:06:58.035988 15622 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.041479 15695 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.041647 15679 raft_consensus.cc:2749] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:58.046891 15478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:58.009977 15627 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:58.047642 15679 consensus_queue.cc:1048] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.046308 14472 catalog_manager.cc:5697] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.986805 14792 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:58.031169 15684 consensus_queue.cc:1048] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:58.049422 15675 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:58.046020 15622 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.046358 15695 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.051970 15482 raft_consensus.cc:2468] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:06:58.060315 14727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:58.062740 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:58.049808 15675 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:58.060992 14727 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
W20260709 13:06:58.058130 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 128098us
I20260709 13:06:58.063306 14722 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
W20260709 13:06:58.090896 14764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 135281us
I20260709 13:06:58.087191 14619 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.094430 14765 leader_election.cc:304] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.096012 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff5557a61fd4c41885144bd05bc9bb8" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.096907 14792 raft_consensus.cc:2368] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.099675 14651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.100289 14651 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:58.101603 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.081312 15675 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.102308 14649 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:58.102413 14765 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
W20260709 13:06:58.322824 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 104315us
I20260709 13:06:58.217871 14800 raft_consensus.cc:1275] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.177657 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.216065 15697 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.300937 14722 raft_consensus.cc:1275] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.123119 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.333452 15697 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.122776 15704 raft_consensus.cc:2804] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.131227 14646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.335192 14646 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:58.335640 15697 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:58.218307 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.336349 14801 raft_consensus.cc:2393] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 2: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:58.336457 14795 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:58.098949 15432 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
I20260709 13:06:58.123490 14649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.217787 14794 raft_consensus.cc:1275] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.268208 14764 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.348402 15666 raft_consensus.cc:2804] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:58.348904 15666 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:58.349273 15666 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.350011 15704 raft_consensus.cc:697] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:58.350893 15704 consensus_queue.cc:237] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:58.352106 14764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 83988.6us
I20260709 13:06:58.118387 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:58.184068 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.354499 14796 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:58.267887 15622 raft_consensus.cc:493] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 506ec781022645d4be0fcdf0bb76dd1a)
I20260709 13:06:58.355369 15622 raft_consensus.cc:515] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.357887 15622 leader_election.cc:290] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.264930 14798 raft_consensus.cc:1275] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.217960 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.271510 15479 raft_consensus.cc:1275] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.149803 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.141533 14644 raft_consensus.cc:1275] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.203092 14799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.361383 14799 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:58.361980 15602 raft_consensus.cc:493] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.362462 15602 raft_consensus.cc:515] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:58.319928 15675 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.354077 14719 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 1.
I20260709 13:06:58.366815 15675 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:58.367550 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:58.098114 15684 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.121719 15676 raft_consensus.cc:493] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54b0718d36f4f72ac7cef2358fbe6b6)
I20260709 13:06:58.368628 14794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963b71519e2643fb8a5312cb09636126" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.130344 15695 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.125180 14690 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.369433 14794 raft_consensus.cc:2368] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3.
I20260709 13:06:58.339294 15683 consensus_queue.cc:1048] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.260708 14472 catalog_manager.cc:5697] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.370072 15695 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:58.370443 15695 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:06:58.353960 15706 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.370828 15695 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.370920 15706 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.371397 15706 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.369622 15703 consensus_queue.cc:1048] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:06:58.369617 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 246734us
I20260709 13:06:58.368999 15676 raft_consensus.cc:515] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:06:58.374750 14690 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.375437 15700 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.375872 15700 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.376263 15700 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.369730 15684 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.377192 15684 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.378513 15706 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.369316 15682 consensus_queue.cc:1048] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:58.370580 14472 catalog_manager.cc:5697] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.368559 15478 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
W20260709 13:06:58.347929 15432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 253723us
I20260709 13:06:58.359706 14793 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:58.383303 15700 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.122546 15624 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631) with higher term. Message: Invalid argument: T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 3. Current term is 4.
I20260709 13:06:58.384616 14646 raft_consensus.cc:1275] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.384618 14724 raft_consensus.cc:1275] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.385269 15700 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.387991 14799 raft_consensus.cc:1275] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.375355 15676 leader_election.cc:290] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:58.389900 14722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:58.390543 14722 raft_consensus.cc:2368] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.392181 15433 leader_election.cc:400] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787) with higher term. Message: Invalid argument: T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.392462 15433 leader_election.cc:403] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.392805 14792 raft_consensus.cc:1275] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.395262 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:06:58.396633 15690 consensus_queue.cc:1048] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.397253 15676 raft_consensus.cc:3060] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.397698 14646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:58.398242 14646 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.398676 15602 leader_election.cc:290] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:58.395188 15622 consensus_queue.cc:1048] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:58.400548 15624 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:58.402119 14692 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.402896 15624 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.403255 15624 raft_consensus.cc:493] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.403466 15432 leader_election.cc:400] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.406663 14792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.407720 14792 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.409220 15676 raft_consensus.cc:2749] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787) with higher term. Message: Invalid argument: T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.403576 15624 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.404572 15479 raft_consensus.cc:1275] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.416385 15432 leader_election.cc:403] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.416527 15690 consensus_queue.cc:1048] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.417658 14799 raft_consensus.cc:1275] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.421938 15684 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.423036 14649 raft_consensus.cc:2393] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 3: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:58.423144 15676 raft_consensus.cc:2749] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.425722 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:58.430269 14652 raft_consensus.cc:3060] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.434543 15601 consensus_queue.cc:1048] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.435804 15666 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.437978 15478 raft_consensus.cc:1275] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.438966 14474 catalog_manager.cc:5697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.439963 15695 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:58.441485 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 73305.1us
I20260709 13:06:58.442106 15695 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.444657 15690 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:58.447923 14644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:58.450213 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.451074 14793 raft_consensus.cc:2368] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3.
I20260709 13:06:58.452248 15684 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.453174 14692 leader_election.cc:400] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3.
I20260709 13:06:58.453606 14692 leader_election.cc:403] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.454111 15718 raft_consensus.cc:2804] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.454550 15718 raft_consensus.cc:493] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.454950 15718 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.456691 15684 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.457202 15684 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:58.454252 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 352946us
I20260709 13:06:58.459227 15706 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:06:58.453429 14792 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:58.454249 15680 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.472244 15624 raft_consensus.cc:515] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.473454 14719 raft_consensus.cc:2393] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd in current term 3: Already voted for candidate 506ec781022645d4be0fcdf0bb76dd1a in this term.
I20260709 13:06:58.476660 14652 raft_consensus.cc:1275] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.482723 15684 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:58.484355 14692 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.486873 14618 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.488052 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:58.488835 14618 leader_election.cc:400] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3.
I20260709 13:06:58.489133 14618 leader_election.cc:403] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.490149 15602 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.490238 15622 raft_consensus.cc:2749] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df879bc63e404e889fd4efcdc33281cd for earlier term 2. Current term is 3.
I20260709 13:06:58.490535 15602 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.490901 15602 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.488189 14719 raft_consensus.cc:1275] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.495321 15718 raft_consensus.cc:515] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:58.498333 15602 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.499843 15690 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.500218 15602 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:58.500379 15690 raft_consensus.cc:697] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:58.502856 15666 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:06:58.502732 15690 consensus_queue.cc:237] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:58.506409 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 174318us
I20260709 13:06:58.512741 15681 consensus_queue.cc:1048] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:58.515390 15476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:58.516053 15476 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 2.
I20260709 13:06:58.523380 15676 consensus_queue.cc:1048] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.527864 15483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d147ffb9b1ba41d985cbae2564f1148c" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
I20260709 13:06:58.536880 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" is_pre_election: true
W20260709 13:06:58.537985 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 49292.4us
I20260709 13:06:58.539809 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:06:58.540252 15483 raft_consensus.cc:1275] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.540553 14650 raft_consensus.cc:2393] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54b0718d36f4f72ac7cef2358fbe6b6 in current term 3: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:58.537961 15479 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 2.
I20260709 13:06:58.543294 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:58.545579 14647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:58.545691 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:58.575953 14652 raft_consensus.cc:2368] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.549973 15601 consensus_queue.cc:1048] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.576979 14646 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:58.551527 15472 raft_consensus.cc:1275] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:58.552533 15476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:58.578888 15476 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.579887 15624 leader_election.cc:290] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:06:58.554225 15680 raft_consensus.cc:2749] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771) with higher term. Message: Invalid argument: T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a for earlier term 2. Current term is 3.
I20260709 13:06:58.584295 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.585031 14793 raft_consensus.cc:2393] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 2: Already voted for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in this term.
I20260709 13:06:58.586117 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e27211ed824a3d8fd174e10c30a832" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.587476 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.558689 15684 consensus_queue.cc:1048] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.562536 15602 consensus_queue.cc:1048] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:58.591892 15718 leader_election.cc:290] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:58.566499 14617 leader_election.cc:304] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:06:58.594444 15622 raft_consensus.cc:2749] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:58.560652 14644 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:06:58.572098 14472 catalog_manager.cc:5697] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 3, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 3 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.602530 14650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:06:58.603277 14650 raft_consensus.cc:2393] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 506ec781022645d4be0fcdf0bb76dd1a in current term 3: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:58.588676 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.596207 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345f32f81f7a4bd8af4458f831f49e96" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.603720 14796 raft_consensus.cc:3060] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.603967 14645 raft_consensus.cc:2393] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in current term 2: Already voted for candidate df879bc63e404e889fd4efcdc33281cd in this term.
I20260709 13:06:58.604377 14801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.604913 14801 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.596438 14800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" is_pre_election: true
I20260709 13:06:58.607626 14797 raft_consensus.cc:1275] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.602586 15684 consensus_queue.cc:1048] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:58.615648 14801 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:58.616336 14720 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 3.
I20260709 13:06:58.616596 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:06:58.617192 14724 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.619395 14796 raft_consensus.cc:2468] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:06:58.620373 14692 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.622262 14765 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.627393 15700 raft_consensus.cc:2804] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.633062 15700 raft_consensus.cc:697] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:06:58.633997 14617 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.634578 15627 raft_consensus.cc:2764] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:58.634840 15683 raft_consensus.cc:2804] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.635286 15683 raft_consensus.cc:493] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.635627 15683 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.634037 15700 consensus_queue.cc:237] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:06:58.645282 15430 leader_election.cc:400] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Vote denied by peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167) with higher term. Message: Invalid argument: T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.648854 15430 leader_election.cc:403] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.647275 15479 raft_consensus.cc:1275] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.655848 15706 consensus_queue.cc:1048] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:58.681725 15478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8a7d306e3949bbb6b1b8b5e4a53bf0" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
W20260709 13:06:58.718698 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 45948.5us
I20260709 13:06:58.689422 15602 consensus_queue.cc:1048] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:06:58.704311 15617 consensus_queue.cc:1048] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:06:58.704696 15478 raft_consensus.cc:3060] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.705191 15476 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
W20260709 13:06:58.765463 15728 log.cc:927] Time spent T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:06:58.768389 15666 raft_consensus.cc:2749] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167) with higher term. Message: Invalid argument: T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 for earlier term 2. Current term is 3.
I20260709 13:06:58.773612 15478 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 3.
I20260709 13:06:58.694880 14793 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:06:58.776546 14765 leader_election.cc:304] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.777730 15692 raft_consensus.cc:2804] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.778241 15692 raft_consensus.cc:697] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:58.779037 15692 consensus_queue.cc:237] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:06:58.784134 15683 raft_consensus.cc:515] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:58.787897 14724 raft_consensus.cc:2468] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 3.
I20260709 13:06:58.793951 14617 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.794780 15587 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.795291 15587 raft_consensus.cc:697] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:58.796130 15587 consensus_queue.cc:237] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
W20260709 13:06:58.797566 14767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 124812us
I20260709 13:06:58.806656 14473 catalog_manager.cc:5697] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.814993 14767 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:06:58.815816 15731 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:58.816354 15731 raft_consensus.cc:697] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:06:58.817016 15683 leader_election.cc:290] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:06:58.818092 15479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
I20260709 13:06:58.818676 15479 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:58.818883 14764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 144281us
I20260709 13:06:58.822057 14618 leader_election.cc:304] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df879bc63e404e889fd4efcdc33281cd; no voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6
W20260709 13:06:58.816290 15727 log.cc:927] Time spent T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:06:58.827261 14796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4bcd1270a4459b8be8056af170226e" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:06:58.827806 14796 raft_consensus.cc:3060] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.833315 15479 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:58.834456 14617 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:06:58.839340 14796 raft_consensus.cc:2468] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:06:58.825244 15683 raft_consensus.cc:2749] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:58.831375 15602 consensus_queue.cc:1048] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:06:58.850752 15682 raft_consensus.cc:2804] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:58.917626 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 70775.8us
W20260709 13:06:58.922964 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 88204.7us
I20260709 13:06:58.856338 15731 consensus_queue.cc:237] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
W20260709 13:06:58.985023 15741 log.cc:927] Time spent T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:06:58.989843 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 61546.9us
I20260709 13:06:58.858598 15432 leader_election.cc:304] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: df879bc63e404e889fd4efcdc33281cd
W20260709 13:06:59.105685 15432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 253483us
I20260709 13:06:59.098618 15666 raft_consensus.cc:2764] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 13:06:59.111799 15737 log.cc:927] Time spent T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:06:59.126237 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 198293us
W20260709 13:06:59.128759 14619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 201375us
I20260709 13:06:59.155139 14650 raft_consensus.cc:1275] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:59.177280 15723 log.cc:927] Time spent T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
W20260709 13:06:59.180905 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 84517.6us
I20260709 13:06:59.190380 15483 raft_consensus.cc:1275] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.208099 14792 raft_consensus.cc:1275] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.128334 15682 raft_consensus.cc:697] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:06:59.211858 15682 consensus_queue.cc:237] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:06:59.218987 15690 consensus_queue.cc:1048] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.219895 15745 consensus_queue.cc:1048] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:59.235204 14652 raft_consensus.cc:1275] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.251536 15624 consensus_queue.cc:1048] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:59.277499 15750 consensus_queue.cc:1048] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:06:59.285722 15758 log.cc:927] Time spent T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:06:59.305495 14651 raft_consensus.cc:1275] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.310135 14724 raft_consensus.cc:1275] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.312706 15749 consensus_queue.cc:1048] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:06:59.361248 15704 consensus_queue.cc:1048] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:06:59.443881 14795 raft_consensus.cc:1275] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.458860 15629 consensus_queue.cc:1048] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.472802 15478 raft_consensus.cc:1275] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.474493 15697 consensus_queue.cc:1048] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:59.488829 15759 log.cc:927] Time spent T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: Append to log took a long time: real 0.216s	user 0.008s	sys 0.000s
W20260709 13:06:59.541649 15775 log.cc:927] Time spent T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:06:59.540611 14473 catalog_manager.cc:5697] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 3, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 3 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } }
I20260709 13:06:59.543614 14473 catalog_manager.cc:5697] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.602327 15472 raft_consensus.cc:1275] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.611781 15679 consensus_queue.cc:1048] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.619964 14476 catalog_manager.cc:5697] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.625442 14793 raft_consensus.cc:1275] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.627663 15475 raft_consensus.cc:1275] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:59.629881 15679 consensus_queue.cc:1048] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.629942 15681 consensus_queue.cc:1048] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:59.622479 14476 catalog_manager.cc:5697] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 1 to 3, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 3 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.846657  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:59.925274 14472 catalog_manager.cc:5697] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 1 to 3, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 3 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.957757 14653 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:00.009773 14619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:36787, user_credentials={real_user=slave}} blocked reactor thread for 77803.1us
W20260709 13:07:00.034032 14692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 91610.5us
W20260709 13:07:00.051831 15779 log.cc:927] Time spent T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:07:00.070281 14764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 92809.4us
I20260709 13:07:00.092088 14653 raft_consensus.cc:1275] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:00.143095 14793 raft_consensus.cc:1275] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:00.152182 15617 consensus_queue.cc:1048] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.149385 15676 raft_consensus.cc:493] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader df879bc63e404e889fd4efcdc33281cd)
I20260709 13:07:00.155496 15676 raft_consensus.cc:515] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:00.158526 15676 leader_election.cc:290] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:07:00.170730 14720 raft_consensus.cc:1275] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:00.230027 14690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:38167, user_credentials={real_user=slave}} blocked reactor thread for 114088us
W20260709 13:07:00.358098 14617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 167617us
I20260709 13:07:00.365176 15704 consensus_queue.cc:1048] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:00.372781 14691 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 182527us
I20260709 13:07:00.384397 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a" is_pre_election: true
I20260709 13:07:00.386914 14653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902ea702a7c34a36a5c2ab940c67baee" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "df879bc63e404e889fd4efcdc33281cd" is_pre_election: true
I20260709 13:07:00.395434 15430 leader_election.cc:304] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67; no voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd
I20260709 13:07:00.402048 15675 raft_consensus.cc:2749] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.419543 15753 consensus_queue.cc:1048] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:00.567219 14652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17"
dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
mode: GRACEFUL
new_leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:45354
I20260709 13:07:00.568418 14652 raft_consensus.cc:606] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Received request to transfer leadership to TS 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:00.655007 14720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:00.655609 14720 raft_consensus.cc:606] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:00.678884 14795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6148470389e947ffad07416847abd3ba"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:00.679394 14795 raft_consensus.cc:606] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Received request to transfer leadership to TS 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:00.683092 14795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:00.683607 14795 raft_consensus.cc:606] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:00.686359 14795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:00.686854 14795 raft_consensus.cc:606] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:00.692126 14795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:00.692638 14795 raft_consensus.cc:606] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:00.693864 15784 raft_consensus.cc:993] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:00.694382 15784 raft_consensus.cc:1081] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:00.695777  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:00.695889 15475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:07:00.696587 15475 raft_consensus.cc:493] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:00.696972 15475 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.697505  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:00.711302 15475 raft_consensus.cc:515] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:00.713681 15475 leader_election.cc:290] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 5 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:07:00.714646 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:00.715237 14652 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.716650 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40422e35fd4d4a068bc2d1ff1a9b70c3" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:00.717177 14724 raft_consensus.cc:3055] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.717555 14724 raft_consensus.cc:740] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:00.718231 14724 consensus_queue.cc:260] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:00.719329 14724 raft_consensus.cc:3060] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.722975 14652 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 5.
I20260709 13:07:00.724174 15430 leader_election.cc:304] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:00.724895 15676 raft_consensus.cc:2804] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.725366 15676 raft_consensus.cc:697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 5 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:00.725878 14724 raft_consensus.cc:2468] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 5.
I20260709 13:07:00.726191 15676 consensus_queue.cc:237] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:00.728646 15732 raft_consensus.cc:993] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:00.729185 15750 raft_consensus.cc:1081] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Signalling peer 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:00.730563 14720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6148470389e947ffad07416847abd3ba"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:07:00.731033 14720 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:00.731402 14720 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.738596 14474 catalog_manager.cc:5697] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 4 to 5, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 5 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.740625 14720 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:00.744202 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:00.744755 14652 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.745111 14720 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:00.745878 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:00.746368 14795 raft_consensus.cc:3055] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:00.746654 14795 raft_consensus.cc:740] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:00.747293 14795 consensus_queue.cc:260] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:00.748322 14795 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.754501 14652 raft_consensus.cc:2468] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:00.755728 14690 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:00.756501 15680 raft_consensus.cc:2804] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:00.756937 15680 raft_consensus.cc:697] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:00.757422 14795 raft_consensus.cc:2468] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:00.757753 15680 consensus_queue.cc:237] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:00.770880 14474 catalog_manager.cc:5697] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.908959 15732 raft_consensus.cc:993] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:00.909443 15732 raft_consensus.cc:1081] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:00.911092 15475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:07:00.911652 15475 raft_consensus.cc:493] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:00.912101 15475 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.935645 15475 raft_consensus.cc:515] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:00.938098 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:00.938263 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702fc54076c4ee586ef69972a9449b5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:00.938910 14798 raft_consensus.cc:3055] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.939301 14798 raft_consensus.cc:740] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:00.939179 14720 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.940135 14798 consensus_queue.cc:260] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:00.941501 14798 raft_consensus.cc:3060] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.937621 15475 leader_election.cc:290] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:00.947171 14798 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:07:00.948076 15432 leader_election.cc:304] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:00.948707 15676 raft_consensus.cc:2804] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:00.948261 14720 raft_consensus.cc:2468] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:07:00.949254 15676 raft_consensus.cc:697] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:00.950099 15676 consensus_queue.cc:237] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:00.958913 15627 raft_consensus.cc:993] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:00.959384 15627 raft_consensus.cc:1081] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:00.961918 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:07:00.962520 15481 raft_consensus.cc:493] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:00.962951 15481 raft_consensus.cc:3060] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.984153 15481 raft_consensus.cc:515] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:00.985986 14474 catalog_manager.cc:5697] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 2 to 3, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.987265 15481 leader_election.cc:290] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:00.987435 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:00.988095 14720 raft_consensus.cc:3060] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:00.992604 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0aecc60f134c1188c9339ac259486f" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:00.993196 14798 raft_consensus.cc:3055] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:00.993486 14798 raft_consensus.cc:740] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:00.994136 14798 consensus_queue.cc:260] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:00.996676 14798 raft_consensus.cc:3060] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.000415 14720 raft_consensus.cc:2468] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:01.001609 15433 leader_election.cc:304] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:07:01.002517 15676 raft_consensus.cc:2804] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:01.003189 15676 raft_consensus.cc:697] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:01.004009 15676 consensus_queue.cc:237] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:01.008499 14798 raft_consensus.cc:2468] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:01.016455 14474 catalog_manager.cc:5697] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.063678 15790 raft_consensus.cc:993] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:01.064103 15790 raft_consensus.cc:1081] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:01.065702 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:07:01.066310 15481 raft_consensus.cc:493] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:01.066692 15481 raft_consensus.cc:3060] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.072865 15481 raft_consensus.cc:515] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:01.075143 15481 leader_election.cc:290] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:07:01.076797 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:01.077872 14652 raft_consensus.cc:3060] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.082558 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfc715d1a74a2e9398771912873ead" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:01.083420 14798 raft_consensus.cc:3055] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:01.083707 14798 raft_consensus.cc:740] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:01.084398 14798 consensus_queue.cc:260] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:01.085615 14798 raft_consensus.cc:3060] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.091746 14798 raft_consensus.cc:2468] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:01.092284 14652 raft_consensus.cc:2468] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:01.093175 15430 leader_election.cc:304] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:01.093791 15676 raft_consensus.cc:2804] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:01.094890 15676 raft_consensus.cc:697] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:01.095752 15676 consensus_queue.cc:237] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:01.105376 14474 catalog_manager.cc:5697] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.117594 15753 raft_consensus.cc:993] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: : Instructing follower 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:01.118036 15753 raft_consensus.cc:1081] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Signalling peer 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:01.122558 14724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:52298
I20260709 13:07:01.123091 14724 raft_consensus.cc:493] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:01.123404 14724 raft_consensus.cc:3060] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.131124 14724 raft_consensus.cc:515] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.133376 14724 leader_election.cc:290] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:01.133534 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:01.134093 14798 raft_consensus.cc:3060] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.134128 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb9d1bdbdc46ce96e07db0c6ffcf17" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:01.134886 14652 raft_consensus.cc:3055] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:01.135375 14652 raft_consensus.cc:740] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:07:01.136212 14652 consensus_queue.cc:260] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.137409 14652 raft_consensus.cc:3060] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.141803 14798 raft_consensus.cc:2468] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:01.143110 14692 leader_election.cc:304] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:01.143569 14652 raft_consensus.cc:2468] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:01.143872 15680 raft_consensus.cc:2804] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:01.144381 15680 raft_consensus.cc:697] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:01.145133 15680 consensus_queue.cc:237] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.160434 14474 catalog_manager.cc:5697] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.198417 14652 raft_consensus.cc:1275] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 5 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:01.199427 15676 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.212548 14724 raft_consensus.cc:1275] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 5 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:01.215113 15817 consensus_queue.cc:1048] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.283581 14652 raft_consensus.cc:1275] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.284766 15680 consensus_queue.cc:1048] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.299332 14798 raft_consensus.cc:1275] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.301643 15784 consensus_queue.cc:1048] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.468356 14798 raft_consensus.cc:1275] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.470476 15817 consensus_queue.cc:1048] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.487985 14724 raft_consensus.cc:1275] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.490140 15676 consensus_queue.cc:1048] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.496529 14795 raft_consensus.cc:1275] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.500890 15676 consensus_queue.cc:1048] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.518352 14720 raft_consensus.cc:1275] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:01.519778 15676 consensus_queue.cc:1048] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.523732 14652 raft_consensus.cc:1275] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.525103 15676 consensus_queue.cc:1048] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.572324 14795 raft_consensus.cc:1275] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:01.574532 15817 consensus_queue.cc:1048] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.629005 14795 raft_consensus.cc:1275] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.630579 15680 consensus_queue.cc:1048] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.650410 14652 raft_consensus.cc:1275] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:01.652592 15784 consensus_queue.cc:1048] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:01.698513  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:01.762944  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:01.801316 14720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:01.801967 14720 raft_consensus.cc:606] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:01.804270 14798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "182e9237880d46949460b001423a61ab"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:01.804798 14798 raft_consensus.cc:606] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Received request to transfer leadership to TS 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:01.807297 14645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3724176103ea41e8bc3897d78affc140"
dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
mode: GRACEFUL
new_leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
 from {username='slave'} at 127.0.0.1:45354
I20260709 13:07:01.807847 14645 raft_consensus.cc:606] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Received request to transfer leadership to TS d54b0718d36f4f72ac7cef2358fbe6b6
I20260709 13:07:01.811146 14720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6148470389e947ffad07416847abd3ba"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "df879bc63e404e889fd4efcdc33281cd"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:01.811687 14720 raft_consensus.cc:606] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Received request to transfer leadership to TS df879bc63e404e889fd4efcdc33281cd
I20260709 13:07:01.815364 14798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:01.815901 14798 raft_consensus.cc:606] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Received request to transfer leadership to TS 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:01.821430 14798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:01.821950 14798 raft_consensus.cc:606] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Received request to transfer leadership to TS 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:01.823423  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:01.825006  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:01.828934 15627 raft_consensus.cc:993] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:01.829627 15627 raft_consensus.cc:1081] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Signalling peer 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:01.831166 14720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:07:01.832088 14720 raft_consensus.cc:493] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:01.832664 14720 raft_consensus.cc:3060] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.839644 14720 raft_consensus.cc:515] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.842232 14720 leader_election.cc:290] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:01.842481 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:01.842329 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8911b4d6ee99489799d587b29247fe1c" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:01.843070 14798 raft_consensus.cc:3055] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:01.843390 14798 raft_consensus.cc:740] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:01.843487 14645 raft_consensus.cc:3060] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.844146 14798 consensus_queue.cc:260] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.845315 14798 raft_consensus.cc:3060] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.850574 14645 raft_consensus.cc:2468] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:01.851755 14798 raft_consensus.cc:2468] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:01.852857 14692 leader_election.cc:304] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:01.853616 15680 raft_consensus.cc:2804] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:01.854087 15680 raft_consensus.cc:697] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:01.854899 15680 consensus_queue.cc:237] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.857645 15784 raft_consensus.cc:993] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower df879bc63e404e889fd4efcdc33281cd to start an election
I20260709 13:07:01.858121 15784 raft_consensus.cc:1081] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Signalling peer df879bc63e404e889fd4efcdc33281cd to start an election
I20260709 13:07:01.859982 14645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6148470389e947ffad07416847abd3ba"
dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
 from {username='slave'} at 127.0.0.1:45520
I20260709 13:07:01.860607 14645 raft_consensus.cc:493] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:01.860965 14645 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.872449 14645 raft_consensus.cc:515] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.875510 14645 leader_election.cc:290] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:01.876720 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:01.874006 14474 catalog_manager.cc:5697] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.877624 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6148470389e947ffad07416847abd3ba" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:01.878170 14720 raft_consensus.cc:3055] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.878465 14720 raft_consensus.cc:740] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:01.879281 14720 consensus_queue.cc:260] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.880601 14720 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.881304 14798 raft_consensus.cc:3060] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.887264 14720 raft_consensus.cc:2468] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:07:01.888598 14619 leader_election.cc:304] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:01.889300 15740 raft_consensus.cc:2804] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.889784 15740 raft_consensus.cc:697] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:07:01.890678 14798 raft_consensus.cc:2468] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 3.
I20260709 13:07:01.890584 15740 consensus_queue.cc:237] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:01.900506 14476 catalog_manager.cc:5697] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 2 to 3, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 3 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.987263 15831 raft_consensus.cc:993] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:01.987723 15831 raft_consensus.cc:1081] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:01.989472 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:07:01.990016 15481 raft_consensus.cc:493] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:01.990458 15481 raft_consensus.cc:3060] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.027017 15789 raft_consensus.cc:993] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: : Instructing follower d54b0718d36f4f72ac7cef2358fbe6b6 to start an election
I20260709 13:07:02.027559 15789 raft_consensus.cc:1081] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Signalling peer d54b0718d36f4f72ac7cef2358fbe6b6 to start an election
I20260709 13:07:02.048049 14795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3724176103ea41e8bc3897d78affc140"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
 from {username='slave'} at 127.0.0.1:39712
I20260709 13:07:02.049794 14795 raft_consensus.cc:493] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:02.051201 14795 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.061194 15481 raft_consensus.cc:515] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:02.064332 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:02.064913 14645 raft_consensus.cc:3060] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.065057 15481 leader_election.cc:290] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:07:02.066068 14720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b97cf3540541f984f1edaa8b7e2246" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:02.066654 14720 raft_consensus.cc:3055] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:02.066984 14720 raft_consensus.cc:740] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:02.062382 14795 raft_consensus.cc:515] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.067759 14720 consensus_queue.cc:260] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:02.069149 14720 raft_consensus.cc:3060] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.071653 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:02.072250 14719 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.074501 14645 raft_consensus.cc:2468] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:02.069907 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3724176103ea41e8bc3897d78affc140" candidate_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:02.075726 15430 leader_election.cc:304] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:02.075824 14652 raft_consensus.cc:3055] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:02.076259 14652 raft_consensus.cc:740] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:07:02.076498 15676 raft_consensus.cc:2804] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.076957 15676 raft_consensus.cc:697] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:02.077824 15676 consensus_queue.cc:237] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:02.081202 14719 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 4.
I20260709 13:07:02.082589 14767 leader_election.cc:304] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:02.069783 14795 leader_election.cc:290] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 4 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:07:02.076977 14652 consensus_queue.cc:260] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.083834 15790 raft_consensus.cc:2804] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.084498 15790 raft_consensus.cc:697] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 LEADER]: Becoming Leader. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:02.084975 14652 raft_consensus.cc:3060] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.085294 15790 consensus_queue.cc:237] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.085183 14720 raft_consensus.cc:2468] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:02.093075 14652 raft_consensus.cc:2468] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54b0718d36f4f72ac7cef2358fbe6b6 in term 4.
I20260709 13:07:02.104969 14476 catalog_manager.cc:5697] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.105819 14474 catalog_manager.cc:5697] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 reported cstate change: term changed from 3 to 4, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68). New cstate: current_term: 4 leader_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.115060 15786 raft_consensus.cc:993] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:02.116114 15627 raft_consensus.cc:1081] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Signalling peer 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:02.117641 14720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "182e9237880d46949460b001423a61ab"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:07:02.118129 14720 raft_consensus.cc:493] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:02.118651 14720 raft_consensus.cc:3060] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.124819 14720 raft_consensus.cc:515] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.127092 14720 leader_election.cc:290] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:02.127125 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:02.127420 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182e9237880d46949460b001423a61ab" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:02.127976 14795 raft_consensus.cc:3055] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:02.127843 14652 raft_consensus.cc:3060] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.128352 14795 raft_consensus.cc:740] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:02.129194 14795 consensus_queue.cc:260] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.130789 14795 raft_consensus.cc:3060] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.135202 14652 raft_consensus.cc:2468] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:02.136399 14690 leader_election.cc:304] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:02.137128 15784 raft_consensus.cc:2804] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.137517 14795 raft_consensus.cc:2468] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 2.
I20260709 13:07:02.137622 15784 raft_consensus.cc:697] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:02.138720 15784 consensus_queue.cc:237] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.149138 14476 catalog_manager.cc:5697] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 1 to 2, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 2 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.211458 15786 raft_consensus.cc:993] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:02.212090 15786 raft_consensus.cc:1081] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Signalling peer 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:02.213800 14720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:07:02.214275 14720 raft_consensus.cc:493] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:02.214524 14720 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.220114 14720 raft_consensus.cc:515] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.221560 14720 leader_election.cc:290] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:02.222280 14652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:02.222575 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a56c1b19f64f2a8eaff792c37d79b0" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:02.222818 14652 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.223235 14795 raft_consensus.cc:3055] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.223579 14795 raft_consensus.cc:740] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:02.224344 14795 consensus_queue.cc:260] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.225611 14795 raft_consensus.cc:3060] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.228544 14652 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:07:02.229624 14690 leader_election.cc:304] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:02.230312 15831 raft_consensus.cc:2804] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.231565 15831 raft_consensus.cc:697] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:02.232434 15831 consensus_queue.cc:237] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:02.237736 14795 raft_consensus.cc:2468] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 3.
I20260709 13:07:02.243155 14474 catalog_manager.cc:5697] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 2 to 3, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 3 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.280721 14720 raft_consensus.cc:1275] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.282783 15789 consensus_queue.cc:1048] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.287020 14795 raft_consensus.cc:1275] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.292184 15789 consensus_queue.cc:1048] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:02.315315 14795 raft_consensus.cc:1275] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.317071 15831 consensus_queue.cc:1048] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:02.346601 14618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.68:38771, user_credentials={real_user=slave}} blocked reactor thread for 55395us
I20260709 13:07:02.364048 14652 raft_consensus.cc:1275] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.368637 15784 consensus_queue.cc:1048] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.471680 14652 raft_consensus.cc:1275] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.472900 15676 consensus_queue.cc:1048] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.500669 14720 raft_consensus.cc:1275] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.503312 15676 consensus_queue.cc:1048] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.574101 14645 raft_consensus.cc:1275] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.575431 15831 consensus_queue.cc:1048] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:02.584398 14798 raft_consensus.cc:1275] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.585827 15784 consensus_queue.cc:1048] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:02.705329 14719 raft_consensus.cc:1275] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:02.706692 15790 consensus_queue.cc:1048] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.713325 14645 raft_consensus.cc:1275] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Refusing update from remote peer d54b0718d36f4f72ac7cef2358fbe6b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:02.738199 15790 consensus_queue.cc:1048] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.821223 14645 raft_consensus.cc:1275] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.824404 15783 consensus_queue.cc:1048] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.825675 14795 raft_consensus.cc:1275] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.825840  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:02.827095 15783 consensus_queue.cc:1048] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.894078  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:02.950563 14793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:02.951184 14793 raft_consensus.cc:606] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:02.954023 14719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:02.954607 14719 raft_consensus.cc:606] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:02.956981 14719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:02.957456 14719 raft_consensus.cc:606] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:02.961179 14645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd"
dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45354
I20260709 13:07:02.961985 14645 raft_consensus.cc:606] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:02.965242 14719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "df879bc63e404e889fd4efcdc33281cd"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:02.965778 14719 raft_consensus.cc:606] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Received request to transfer leadership to TS df879bc63e404e889fd4efcdc33281cd
I20260709 13:07:02.973953 14793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:02.974650 14793 raft_consensus.cc:606] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:02.976495  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:02.978948  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:03.005388 15831 raft_consensus.cc:993] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.005946 15784 raft_consensus.cc:1081] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.007229 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:07:03.007623 15481 raft_consensus.cc:493] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.007911 15481 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.014617 15481 raft_consensus.cc:515] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.016471 15481 leader_election.cc:290] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 4 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:03.017946 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:03.018523 14719 raft_consensus.cc:3055] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.018793 14719 raft_consensus.cc:740] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:03.019657 14719 consensus_queue.cc:260] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.025058 14719 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.030589 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f507402c5f47dab63dc0d6cc423e45" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:03.031208 14798 raft_consensus.cc:3060] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.036909 14798 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 4.
I20260709 13:07:03.038172 15432 leader_election.cc:304] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:03.038932 15817 raft_consensus.cc:2804] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.038892 14719 raft_consensus.cc:2468] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 4.
I20260709 13:07:03.045797 15817 raft_consensus.cc:697] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:03.047837 15817 consensus_queue.cc:237] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.054451 15857 raft_consensus.cc:993] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.054973 15857 raft_consensus.cc:1081] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.056799 15478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:07:03.057367 15478 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.057771 15478 raft_consensus.cc:3060] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.065407 15478 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.074644 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:03.074795 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe49d815dee48d3b45b9c3275a9aba5" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:03.075429 14793 raft_consensus.cc:3055] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:03.075217 14719 raft_consensus.cc:3060] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.075773 14793 raft_consensus.cc:740] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:03.077142 14793 consensus_queue.cc:260] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.078293 14793 raft_consensus.cc:3060] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.083760 14719 raft_consensus.cc:2468] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:03.092525 15433 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:07:03.092901 14476 catalog_manager.cc:5697] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 3 to 4, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 4 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.094089 15478 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:03.094975 15861 raft_consensus.cc:2804] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.097468 15861 raft_consensus.cc:697] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:03.097244 14793 raft_consensus.cc:2468] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:03.103405 15861 consensus_queue.cc:237] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.142340 14476 catalog_manager.cc:5697] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.245210 15783 raft_consensus.cc:993] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower df879bc63e404e889fd4efcdc33281cd to start an election
I20260709 13:07:03.245680 15831 raft_consensus.cc:1081] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Signalling peer df879bc63e404e889fd4efcdc33281cd to start an election
I20260709 13:07:03.247951 14646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f"
dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
 from {username='slave'} at 127.0.0.1:45520
I20260709 13:07:03.248528 14646 raft_consensus.cc:493] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.249012 14646 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.255878 14646 raft_consensus.cc:515] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:03.257784 14646 leader_election.cc:290] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:03.258323 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:03.258950 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a48fa215640848445056cdc9dc61f" candidate_uuid: "df879bc63e404e889fd4efcdc33281cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:03.258991 14793 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.259483 14719 raft_consensus.cc:3055] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.259737 14719 raft_consensus.cc:740] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:03.260345 14719 consensus_queue.cc:260] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:03.261545 14719 raft_consensus.cc:3060] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.266656 14719 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:07:03.267647 14619 leader_election.cc:304] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:03.268177 14793 raft_consensus.cc:2468] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df879bc63e404e889fd4efcdc33281cd in term 4.
I20260709 13:07:03.268795 15840 raft_consensus.cc:2804] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.269292 15840 raft_consensus.cc:697] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Becoming Leader. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:07:03.270149 15840 consensus_queue.cc:237] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:03.280956 14476 catalog_manager.cc:5697] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd reported cstate change: term changed from 3 to 4, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to df879bc63e404e889fd4efcdc33281cd (127.6.215.66). New cstate: current_term: 4 leader_uuid: "df879bc63e404e889fd4efcdc33281cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.357998 15857 raft_consensus.cc:993] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.358704 15857 raft_consensus.cc:1081] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.361208 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:07:03.361727 15481 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.362027 15481 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.368682 15481 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.370170 15481 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:03.371059 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:03.371677 14798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db6fbac587a4051b87b0763a5cb6546" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:03.372864 14719 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.373003 14798 raft_consensus.cc:3055] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.373432 14798 raft_consensus.cc:740] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:03.374118 14798 consensus_queue.cc:260] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.375253 14798 raft_consensus.cc:3060] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.380396 14719 raft_consensus.cc:2468] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:07:03.381439 15433 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:07:03.383167 15861 raft_consensus.cc:2804] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.383630 15861 raft_consensus.cc:697] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:03.384488 15861 consensus_queue.cc:237] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.401727 14476 catalog_manager.cc:5697] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 2 to 3, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.402550 14798 raft_consensus.cc:2468] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:07:03.467792 14795 raft_consensus.cc:1275] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:03.470556 15863 consensus_queue.cc:1048] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:03.480309 15783 raft_consensus.cc:993] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.480762 15783 raft_consensus.cc:1081] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.482385 15478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:07:03.482903 15478 raft_consensus.cc:493] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.483284 15478 raft_consensus.cc:3060] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.484349 15840 raft_consensus.cc:993] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.484798 15840 raft_consensus.cc:1081] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:03.486246 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38502
I20260709 13:07:03.486722 15481 raft_consensus.cc:493] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:03.487705 15481 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.493216 15478 raft_consensus.cc:515] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.495333 15478 leader_election.cc:290] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:03.499068 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:03.499136 15481 raft_consensus.cc:515] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:03.499600 14719 raft_consensus.cc:3055] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:03.500204 14719 raft_consensus.cc:740] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:03.501016 14719 consensus_queue.cc:260] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.502219 14719 raft_consensus.cc:3060] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.505266 14795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e17887ea2648f790f2eea586a10f68" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:03.506357 14795 raft_consensus.cc:3060] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.506803 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:03.509541 14645 raft_consensus.cc:3055] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.510017 14645 raft_consensus.cc:740] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:07:03.509616 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea3984c76074afa8be83ccbfc7d92fd" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:03.510887 14724 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.510812 14645 consensus_queue.cc:260] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:03.511951 14645 raft_consensus.cc:3060] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.501533 15481 leader_election.cc:290] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:07:03.519385 14719 raft_consensus.cc:2468] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:03.520541 14724 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:07:03.521071 15433 leader_election.cc:304] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a; no voters: 
I20260709 13:07:03.521850 15862 raft_consensus.cc:2804] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.522301 15862 raft_consensus.cc:697] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:03.523084 15862 consensus_queue.cc:237] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:03.525138 14645 raft_consensus.cc:2468] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 3.
I20260709 13:07:03.527988 15430 leader_election.cc:304] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:03.528784 15676 raft_consensus.cc:2804] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.529208 15676 raft_consensus.cc:697] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:03.530041 15676 consensus_queue.cc:237] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:03.544400 14724 raft_consensus.cc:1275] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.545981 15676 consensus_queue.cc:1048] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.569198 14795 raft_consensus.cc:2468] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:03.573014 14720 raft_consensus.cc:1275] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:03.574568 15817 consensus_queue.cc:1048] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.591928 14795 raft_consensus.cc:1275] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.601835 15817 consensus_queue.cc:1048] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:03.655905 14476 catalog_manager.cc:5697] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.658195 14476 catalog_manager.cc:5697] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 2 to 3, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 3 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.763973 14795 raft_consensus.cc:1275] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.765163 15789 consensus_queue.cc:1048] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:03.795830 14724 raft_consensus.cc:1275] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Refusing update from remote peer df879bc63e404e889fd4efcdc33281cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:03.797200 15840 consensus_queue.cc:1048] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:03.903468 14795 raft_consensus.cc:1275] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:03.904871 15817 consensus_queue.cc:1048] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:03.930789 14724 raft_consensus.cc:1275] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:03.932269 15861 consensus_queue.cc:1048] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:03.972137 14795 raft_consensus.cc:1275] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.973902 15862 consensus_queue.cc:1048] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.980252  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:04.012475 14724 raft_consensus.cc:1275] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.013908 15817 consensus_queue.cc:1048] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.047384 14646 raft_consensus.cc:1275] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:04.049428 15862 consensus_queue.cc:1048] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.066967 14719 raft_consensus.cc:1275] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:04.070093 15863 consensus_queue.cc:1048] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.086181  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:04.148904 14646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b854989a274b4691e05ab9aa845495"
dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:45354
I20260709 13:07:04.149545 14646 raft_consensus.cc:606] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:04.152513 14795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46"
dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
mode: GRACEFUL
new_leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:45024
I20260709 13:07:04.152974 14795 raft_consensus.cc:606] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Received request to transfer leadership to TS 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:04.154089  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:04.155251  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:04.330613 15790 raft_consensus.cc:993] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: : Instructing follower 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:04.331166 15790 raft_consensus.cc:1081] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Signalling peer 506ec781022645d4be0fcdf0bb76dd1a to start an election
I20260709 13:07:04.333220 14724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
 from {username='slave'} at 127.0.0.1:52286
I20260709 13:07:04.333755 14724 raft_consensus.cc:493] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.334074 14724 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.340646 14724 raft_consensus.cc:515] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:04.342744 14724 leader_election.cc:290] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771)
I20260709 13:07:04.344045 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:04.344674 14793 raft_consensus.cc:3055] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:04.344978 14793 raft_consensus.cc:740] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d54b0718d36f4f72ac7cef2358fbe6b6, State: Running, Role: LEADER
I20260709 13:07:04.345763 14793 consensus_queue.cc:260] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:04.347005 14793 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.348146 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd2e1bed5724ce8ab462353f3f71b46" candidate_uuid: "506ec781022645d4be0fcdf0bb76dd1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:04.348712 14645 raft_consensus.cc:3060] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.355413 14793 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 4.
I20260709 13:07:04.356863 14692 leader_election.cc:304] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 506ec781022645d4be0fcdf0bb76dd1a, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:04.357790 15851 raft_consensus.cc:2804] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.365756 14645 raft_consensus.cc:2468] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 506ec781022645d4be0fcdf0bb76dd1a in term 4.
I20260709 13:07:04.369818 15851 raft_consensus.cc:697] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Becoming Leader. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:04.370841 15851 consensus_queue.cc:237] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } }
I20260709 13:07:04.380563 14474 catalog_manager.cc:5697] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a reported cstate change: term changed from 3 to 4, leader changed from d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68) to 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67). New cstate: current_term: 4 leader_uuid: "506ec781022645d4be0fcdf0bb76dd1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.435187 15753 raft_consensus.cc:993] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:04.435585 15789 raft_consensus.cc:1081] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:04.436925 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b854989a274b4691e05ab9aa845495"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38502
I20260709 13:07:04.437465 15481 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.437770 15481 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.444839 15481 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:04.446691 15481 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 4 election: Requested vote from peers d54b0718d36f4f72ac7cef2358fbe6b6 (127.6.215.68:38771), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
I20260709 13:07:04.447347 14793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6"
I20260709 13:07:04.447774 14645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b854989a274b4691e05ab9aa845495" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:04.447917 14793 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.448298 14645 raft_consensus.cc:3055] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:04.448604 14645 raft_consensus.cc:740] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df879bc63e404e889fd4efcdc33281cd, State: Running, Role: LEADER
I20260709 13:07:04.449283 14645 consensus_queue.cc:260] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:04.450434 14645 raft_consensus.cc:3060] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.456961 14793 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 4.
I20260709 13:07:04.458252 15432 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 
I20260709 13:07:04.459386 15817 raft_consensus.cc:2804] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.459465 14645 raft_consensus.cc:2468] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 4.
I20260709 13:07:04.459854 15817 raft_consensus.cc:697] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:04.460758 15817 consensus_queue.cc:237] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:04.471776 14474 catalog_manager.cc:5697] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 3 to 4, leader changed from df879bc63e404e889fd4efcdc33281cd (127.6.215.66) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 4 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.880905 14646 raft_consensus.cc:1275] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.882102 15890 consensus_queue.cc:1048] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.894202 14793 raft_consensus.cc:1275] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer 506ec781022645d4be0fcdf0bb76dd1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.895663 15851 consensus_queue.cc:1048] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:04.922281 14646 raft_consensus.cc:1275] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.924540 15862 consensus_queue.cc:1048] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:04.935273 14795 raft_consensus.cc:1275] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.936853 15863 consensus_queue.cc:1048] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:05.156021  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:05.206597  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:05.260802 14719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d"
dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
mode: GRACEFUL
new_leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:57078
I20260709 13:07:05.261440 14719 raft_consensus.cc:606] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Received request to transfer leadership to TS 4e3db9695e9c4fd1bfaa6d98644f6f67
I20260709 13:07:05.262709  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:05.264604  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:05.781860 15904 raft_consensus.cc:993] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: : Instructing follower 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:05.782693 15890 raft_consensus.cc:1081] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Signalling peer 4e3db9695e9c4fd1bfaa6d98644f6f67 to start an election
I20260709 13:07:05.786248 15481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d"
dest_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:07:05.787097 15481 raft_consensus.cc:493] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:05.787892 15481 raft_consensus.cc:3060] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.798967 15481 raft_consensus.cc:515] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:05.802202 14646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df879bc63e404e889fd4efcdc33281cd"
I20260709 13:07:05.802687 14719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaad462138b4b2894c6c92ec9403e0d" candidate_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "506ec781022645d4be0fcdf0bb76dd1a"
I20260709 13:07:05.803056 14646 raft_consensus.cc:3060] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.803349 14719 raft_consensus.cc:3055] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:05.804009 14719 raft_consensus.cc:740] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 506ec781022645d4be0fcdf0bb76dd1a, State: Running, Role: LEADER
I20260709 13:07:05.802392 15481 leader_election.cc:290] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Requested vote from peers df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167), 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787)
I20260709 13:07:05.805029 14719 consensus_queue.cc:260] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:05.808086 14719 raft_consensus.cc:3060] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.810462 14646 raft_consensus.cc:2468] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:05.811561 15430 leader_election.cc:304] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd; no voters: 
I20260709 13:07:05.812539 15907 raft_consensus.cc:2804] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:05.813107 15907 raft_consensus.cc:697] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Becoming Leader. State: Replica: 4e3db9695e9c4fd1bfaa6d98644f6f67, State: Running, Role: LEADER
I20260709 13:07:05.814179 15907 consensus_queue.cc:237] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } }
I20260709 13:07:05.814889 14719 raft_consensus.cc:2468] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e3db9695e9c4fd1bfaa6d98644f6f67 in term 2.
I20260709 13:07:05.825264 14474 catalog_manager.cc:5697] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 reported cstate change: term changed from 1 to 2, leader changed from 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67) to 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.265689  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:06.313825  7005 tablet_server.cc:179] TabletServer@127.6.215.65:43631 shutting down...
I20260709 13:07:06.321558 14645 raft_consensus.cc:1275] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:06.324120 15907 consensus_queue.cc:1048] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:06.329664 14765 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 201 similar messages]
I20260709 13:07:06.390915 14719 raft_consensus.cc:1275] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Refusing update from remote peer 4e3db9695e9c4fd1bfaa6d98644f6f67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:06.394796 15907 consensus_queue.cc:1048] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:06.396083 14617 consensus_peers.cc:597] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.405520 14765 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:43631, user_credentials={real_user=slave}} blocked reactor thread for 76001.2us
W20260709 13:07:06.415359 14765 consensus_peers.cc:597] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.418298 14617 consensus_peers.cc:597] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.422979 14765 consensus_peers.cc:597] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.423616 14765 consensus_peers.cc:597] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.436295  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:06.436782 14765 consensus_peers.cc:597] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.438787  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.441483  7005 raft_consensus.cc:2243] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.444753  7005 raft_consensus.cc:2272] T 83dfc715d1a74a2e9398771912873ead P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.448256  7005 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:06.449954 14617 consensus_peers.cc:597] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.450624  7005 raft_consensus.cc:2243] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.452363  7005 raft_consensus.cc:2272] T 4b65e4261c474c129d623f3ba0ce2600 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.458395 14765 consensus_peers.cc:597] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.458761  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.460006  7005 raft_consensus.cc:2243] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.461211  7005 raft_consensus.cc:2272] T 7702fc54076c4ee586ef69972a9449b5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.464823  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.465767  7005 raft_consensus.cc:2243] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.466492  7005 raft_consensus.cc:2272] T 3e8104dc86ca4c3e84135792a5ac1769 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.470175  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.471658  7005 raft_consensus.cc:2243] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.472783  7005 raft_consensus.cc:2272] T 51da01c912804ff4ac1b26589077ae40 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.476748 14617 consensus_peers.cc:597] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.478510  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.480114  7005 raft_consensus.cc:2243] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.481281  7005 raft_consensus.cc:2272] T 01b97cf3540541f984f1edaa8b7e2246 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.484619  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.485792  7005 raft_consensus.cc:2243] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.486526  7005 raft_consensus.cc:2272] T bf7b96dec18f42cd9f7cd905861e7ae2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.491004  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.494364  7005 raft_consensus.cc:2243] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.495155  7005 raft_consensus.cc:2272] T 6652116aaa1648d2bc0a4cd9b44ade8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.496017 14617 consensus_peers.cc:597] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.496789 14691 consensus_peers.cc:597] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.499300  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.500690  7005 raft_consensus.cc:2243] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.501365  7005 raft_consensus.cc:2272] T 6ef572ce75064396b97d4704e5f93335 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.504076  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.504915  7005 raft_consensus.cc:2243] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.505580  7005 raft_consensus.cc:2272] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.508301 14765 consensus_peers.cc:597] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.508638  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.509332  7005 raft_consensus.cc:2243] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.510593  7005 raft_consensus.cc:2272] T 01b854989a274b4691e05ab9aa845495 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.513788  7005 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:06.513906 14617 consensus_peers.cc:597] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.514552  7005 raft_consensus.cc:2243] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.515043  7005 raft_consensus.cc:2272] T 68f8f129f7da41399b8c4084d2514329 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.517282  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.518041  7005 raft_consensus.cc:2243] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.518894  7005 raft_consensus.cc:2272] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.521641  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.522496  7005 raft_consensus.cc:2243] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.523083  7005 raft_consensus.cc:2272] T c1bac898ef214078a9abf3e595a27520 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.524178 14617 consensus_peers.cc:597] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.524372 14691 consensus_peers.cc:597] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.525810  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.526430  7005 raft_consensus.cc:2243] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.526863  7005 raft_consensus.cc:2272] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.528957  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.529546  7005 raft_consensus.cc:2243] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.529992  7005 raft_consensus.cc:2272] T 902ea702a7c34a36a5c2ab940c67baee P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.532603  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.533167  7005 raft_consensus.cc:2243] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.533687  7005 raft_consensus.cc:2272] T 93517bd81c4746cd9280a1658d50fe99 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.536551  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.537321  7005 raft_consensus.cc:2243] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.537976  7005 raft_consensus.cc:2272] T fc9cb0b2e53c4638b38fef94ecff6df7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.538585 14617 consensus_peers.cc:597] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.540248  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.540887  7005 raft_consensus.cc:2243] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.541322  7005 raft_consensus.cc:2272] T 31e27211ed824a3d8fd174e10c30a832 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.543241  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.543809  7005 raft_consensus.cc:2243] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.544641  7005 raft_consensus.cc:2272] T dbe49d815dee48d3b45b9c3275a9aba5 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.547673  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.548416  7005 raft_consensus.cc:2243] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.549391  7005 raft_consensus.cc:2272] T fc0aecc60f134c1188c9339ac259486f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.549839 14765 consensus_peers.cc:597] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.552572  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.553447  7005 raft_consensus.cc:2243] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.554093  7005 raft_consensus.cc:2272] T 2075e17bd50a4018aca3418b80b18311 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.557595  7005 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:06.558576 14765 consensus_peers.cc:597] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.558737  7005 raft_consensus.cc:2243] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.559973  7005 raft_consensus.cc:2272] T d147ffb9b1ba41d985cbae2564f1148c P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.563580  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.564671  7005 raft_consensus.cc:2243] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:06.564899 14617 consensus_peers.cc:597] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.565280  7005 raft_consensus.cc:2272] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.568326  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.568948  7005 raft_consensus.cc:2243] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.569728  7005 raft_consensus.cc:2272] T caaad462138b4b2894c6c92ec9403e0d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.573621  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.574314  7005 raft_consensus.cc:2243] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.574805  7005 raft_consensus.cc:2272] T b3c58429a8964ea4bc7fe0ae68093fde P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.577327  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.578014  7005 raft_consensus.cc:2243] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.578544  7005 raft_consensus.cc:2272] T 959e66f7e7ea4430b66b08c75d3f8a3d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.582155  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.582888  7005 raft_consensus.cc:2243] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.583719  7005 raft_consensus.cc:2272] T 0db6fbac587a4051b87b0763a5cb6546 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.585160 14691 consensus_peers.cc:597] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.585930  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.586599  7005 raft_consensus.cc:2243] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.587019  7005 raft_consensus.cc:2272] T 2666ab9efa994f198f2fb2f02c70df8f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.589461  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.590126  7005 raft_consensus.cc:2243] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.590816  7005 raft_consensus.cc:2272] T 7024877fba144524a8e2d1e04cb420d7 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.592618 14691 consensus_peers.cc:597] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.593760  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.594491  7005 raft_consensus.cc:2243] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.595788  7005 raft_consensus.cc:2272] T 12e17887ea2648f790f2eea586a10f68 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.598140  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.598697  7005 raft_consensus.cc:2243] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.599102  7005 raft_consensus.cc:2272] T 8ea40529e58642ecad3ba57398343c6f P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.601101  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.601660  7005 raft_consensus.cc:2243] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.602459  7005 raft_consensus.cc:2272] T 6ea3984c76074afa8be83ccbfc7d92fd P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.604588  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.605077  7005 raft_consensus.cc:2243] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.605516  7005 raft_consensus.cc:2272] T db5fb9d53fa74b5ba11f946ac902a5f2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.608174  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.608886  7005 raft_consensus.cc:2243] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.609419  7005 raft_consensus.cc:2272] T 3789330431ce4e7ea306d15229f2efe2 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.611832  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.612581  7005 raft_consensus.cc:2243] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.613077  7005 raft_consensus.cc:2272] T eaa647d819f4427c8f1eecbe00003fa4 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.616216  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.617043  7005 raft_consensus.cc:2243] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.617705  7005 raft_consensus.cc:2272] T 2ea0a87730ae48b398447afece8bcc4e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.620476  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.621109  7005 raft_consensus.cc:2243] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.621784  7005 raft_consensus.cc:2272] T dc4bcd1270a4459b8be8056af170226e P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.625005  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.625617  7005 raft_consensus.cc:2243] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.626056  7005 raft_consensus.cc:2272] T 5ff0cde640b64fd6b574f51fc2c50a62 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.628109  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.628620  7005 raft_consensus.cc:2243] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.629201  7005 raft_consensus.cc:2272] T c65b133e1b7b49e7aa040543173e9286 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.632172  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.632814  7005 raft_consensus.cc:2243] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.633837  7005 raft_consensus.cc:2272] T 23f507402c5f47dab63dc0d6cc423e45 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.636756  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.637687  7005 raft_consensus.cc:2243] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.638388  7005 raft_consensus.cc:2272] T a87d627f14ee4f22a43a3b0d36455e24 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.642092  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.642742  7005 raft_consensus.cc:2243] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.643245  7005 raft_consensus.cc:2272] T 0ff5557a61fd4c41885144bd05bc9bb8 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.645489  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.645921  7005 raft_consensus.cc:2243] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.646627  7005 raft_consensus.cc:2272] T 86c1574eeecf47e1b9d43861c4145347 P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.648825  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:06.649391  7005 raft_consensus.cc:2243] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.649852  7005 raft_consensus.cc:2272] T 9633676643a14702b9f1cbf070a1e46d P 4e3db9695e9c4fd1bfaa6d98644f6f67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.653815 14765 consensus_peers.cc:597] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.667201 14617 consensus_peers.cc:597] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.670845 14617 consensus_peers.cc:597] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.682374 14691 consensus_peers.cc:597] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.699826 14617 consensus_peers.cc:597] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.711477 14691 consensus_peers.cc:597] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.735141 14691 consensus_peers.cc:597] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.744300 14765 consensus_peers.cc:597] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:06.744903 14765 consensus_peers.cc:597] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.755728  7005 tablet_server.cc:196] TabletServer@127.6.215.65:43631 shutdown complete.
W20260709 13:07:06.790856 14765 consensus_peers.cc:597] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Couldn't send request to peer 4e3db9695e9c4fd1bfaa6d98644f6f67. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.844940  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
I20260709 13:07:06.884059  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:06.885139  7005 tablet_replica.cc:333] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.886039  7005 raft_consensus.cc:2243] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.887161  7005 raft_consensus.cc:2272] T 6ef572ce75064396b97d4704e5f93335 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.890136  7005 tablet_replica.cc:333] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.890900  7005 raft_consensus.cc:2243] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.891494  7005 raft_consensus.cc:2272] T 2cd2e1bed5724ce8ab462353f3f71b46 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.893939  7005 tablet_replica.cc:333] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.894685  7005 raft_consensus.cc:2243] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.895668  7005 raft_consensus.cc:2272] T bf7b96dec18f42cd9f7cd905861e7ae2 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.898300  7005 tablet_replica.cc:333] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.899446  7005 raft_consensus.cc:2243] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.900041  7005 raft_consensus.cc:2272] T 83dfc715d1a74a2e9398771912873ead P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.902752  7005 tablet_replica.cc:333] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.903612  7005 raft_consensus.cc:2243] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.904163  7005 raft_consensus.cc:2272] T 01b97cf3540541f984f1edaa8b7e2246 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.907219  7005 tablet_replica.cc:333] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.908107  7005 raft_consensus.cc:2243] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:07:06.911250 14690 consensus_peers.cc:597] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.912961  7005 raft_consensus.cc:2272] T 6652116aaa1648d2bc0a4cd9b44ade8f P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.916054  7005 tablet_replica.cc:333] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.916970  7005 raft_consensus.cc:2243] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.917532  7005 raft_consensus.cc:2272] T 182e9237880d46949460b001423a61ab P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.917910 14764 consensus_peers.cc:597] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.920915  7005 tablet_replica.cc:333] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.922610  7005 raft_consensus.cc:2243] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.923777  7005 raft_consensus.cc:2272] T 959e66f7e7ea4430b66b08c75d3f8a3d P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.926537  7005 tablet_replica.cc:333] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.927280  7005 raft_consensus.cc:2243] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.928290  7005 raft_consensus.cc:2272] T ceebbbc7cabf4ee4a60995c283eb7c47 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.931289  7005 tablet_replica.cc:333] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.932081  7005 raft_consensus.cc:2243] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.932667  7005 raft_consensus.cc:2272] T 5d41095708f541448eba428743f63659 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.935639  7005 tablet_replica.cc:333] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.936487  7005 raft_consensus.cc:2243] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.936996  7005 raft_consensus.cc:2272] T 5ff0cde640b64fd6b574f51fc2c50a62 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.941337  7005 tablet_replica.cc:333] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.942200  7005 raft_consensus.cc:2243] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.942746  7005 raft_consensus.cc:2272] T eaa647d819f4427c8f1eecbe00003fa4 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.945852  7005 tablet_replica.cc:333] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.946545  7005 raft_consensus.cc:2243] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.947460  7005 raft_consensus.cc:2272] T dc4bcd1270a4459b8be8056af170226e P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.949704  7005 tablet_replica.cc:333] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.950212  7005 raft_consensus.cc:2243] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.950707  7005 raft_consensus.cc:2272] T c65b133e1b7b49e7aa040543173e9286 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.952873  7005 tablet_replica.cc:333] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.953518  7005 raft_consensus.cc:2243] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.953977  7005 raft_consensus.cc:2272] T 2ea0a87730ae48b398447afece8bcc4e P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.955957  7005 tablet_replica.cc:333] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.956503  7005 raft_consensus.cc:2243] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.956938  7005 raft_consensus.cc:2272] T d147ffb9b1ba41d985cbae2564f1148c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.958690  7005 tablet_replica.cc:333] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.959185  7005 raft_consensus.cc:2243] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.959573  7005 raft_consensus.cc:2272] T 2075e17bd50a4018aca3418b80b18311 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.961453  7005 tablet_replica.cc:333] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.961949  7005 raft_consensus.cc:2243] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.962327  7005 raft_consensus.cc:2272] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.964107  7005 tablet_replica.cc:333] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.964574  7005 raft_consensus.cc:2243] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.964915  7005 raft_consensus.cc:2272] T caaad462138b4b2894c6c92ec9403e0d P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.967566  7005 tablet_replica.cc:333] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.968431  7005 raft_consensus.cc:2243] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.969015  7005 raft_consensus.cc:2272] T 3724176103ea41e8bc3897d78affc140 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.972494  7005 tablet_replica.cc:333] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.973218  7005 raft_consensus.cc:2243] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.973821  7005 raft_consensus.cc:2272] T fc9cb0b2e53c4638b38fef94ecff6df7 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.976208 14764 consensus_peers.cc:597] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.977152  7005 tablet_replica.cc:333] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.978560  7005 raft_consensus.cc:2243] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.979065  7005 raft_consensus.cc:2272] T 963b71519e2643fb8a5312cb09636126 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.981937  7005 tablet_replica.cc:333] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.982779  7005 raft_consensus.cc:2243] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.983836  7005 raft_consensus.cc:2272] T 3789330431ce4e7ea306d15229f2efe2 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:06.986316 14764 consensus_peers.cc:597] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:06.986544  7005 tablet_replica.cc:333] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.987388  7005 raft_consensus.cc:2243] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.987833  7005 raft_consensus.cc:2272] T bd33d2753c08470f9b9b1d7145f75b16 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.990103  7005 tablet_replica.cc:333] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.990636  7005 raft_consensus.cc:2243] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:06.991066  7005 raft_consensus.cc:2272] T 345f32f81f7a4bd8af4458f831f49e96 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:06.994858  7005 tablet_replica.cc:333] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:06.995839  7005 raft_consensus.cc:2243] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:06.997555  7005 raft_consensus.cc:2272] T 93517bd81c4746cd9280a1658d50fe99 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.000887  7005 tablet_replica.cc:333] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.001626  7005 raft_consensus.cc:2243] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.002547  7005 raft_consensus.cc:2272] T 902ea702a7c34a36a5c2ab940c67baee P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.004626  7005 tablet_replica.cc:333] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.005115  7005 raft_consensus.cc:2243] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.005508  7005 raft_consensus.cc:2272] T 4b65e4261c474c129d623f3ba0ce2600 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.007254  7005 tablet_replica.cc:333] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.007758  7005 raft_consensus.cc:2243] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.008162  7005 raft_consensus.cc:2272] T 8911b4d6ee99489799d587b29247fe1c P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.011148  7005 tablet_replica.cc:333] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.012223  7005 raft_consensus.cc:2243] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.013185  7005 raft_consensus.cc:2272] T 68f8f129f7da41399b8c4084d2514329 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:07.015374 14764 consensus_peers.cc:597] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.015831  7005 tablet_replica.cc:333] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.016571  7005 raft_consensus.cc:2243] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.017024  7005 raft_consensus.cc:2272] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P df879bc63e404e889fd4efcdc33281cd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.019439  7005 tablet_replica.cc:333] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.020319  7005 raft_consensus.cc:2243] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.020830  7005 raft_consensus.cc:2272] T 6ea3984c76074afa8be83ccbfc7d92fd P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.023739  7005 tablet_replica.cc:333] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.024433  7005 raft_consensus.cc:2243] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.025334  7005 raft_consensus.cc:2272] T 8ea40529e58642ecad3ba57398343c6f P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.027859  7005 tablet_replica.cc:333] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.028345  7005 raft_consensus.cc:2243] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.028759  7005 raft_consensus.cc:2272] T f3a56c1b19f64f2a8eaff792c37d79b0 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.030561  7005 tablet_replica.cc:333] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.031026  7005 raft_consensus.cc:2243] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.031615  7005 raft_consensus.cc:2272] T 9633676643a14702b9f1cbf070a1e46d P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.034276  7005 tablet_replica.cc:333] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.034885  7005 raft_consensus.cc:2243] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.035405  7005 raft_consensus.cc:2272] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.037730  7005 tablet_replica.cc:333] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.038290  7005 raft_consensus.cc:2243] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.039441  7005 raft_consensus.cc:2272] T 6148470389e947ffad07416847abd3ba P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.041714  7005 tablet_replica.cc:333] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.042340  7005 raft_consensus.cc:2243] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.043205  7005 raft_consensus.cc:2272] T 3e8104dc86ca4c3e84135792a5ac1769 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.045866  7005 tablet_replica.cc:333] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.046376  7005 raft_consensus.cc:2243] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.046788  7005 raft_consensus.cc:2272] T 0ff5557a61fd4c41885144bd05bc9bb8 P df879bc63e404e889fd4efcdc33281cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.049160  7005 tablet_replica.cc:333] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.049690  7005 raft_consensus.cc:2243] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.050235  7005 raft_consensus.cc:2272] T a87d627f14ee4f22a43a3b0d36455e24 P df879bc63e404e889fd4efcdc33281cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.052170  7005 tablet_replica.cc:333] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.052592  7005 raft_consensus.cc:2243] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.053795  7005 raft_consensus.cc:2272] T d27a48fa215640848445056cdc9dc61f P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.056439  7005 tablet_replica.cc:333] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.056910  7005 raft_consensus.cc:2243] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.057790  7005 raft_consensus.cc:2272] T c1bac898ef214078a9abf3e595a27520 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.060995  7005 tablet_replica.cc:333] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
W20260709 13:07:07.060190 14764 consensus_peers.cc:597] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.062036  7005 raft_consensus.cc:2243] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.062613  7005 raft_consensus.cc:2272] T 01b854989a274b4691e05ab9aa845495 P df879bc63e404e889fd4efcdc33281cd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:07.062628 14764 consensus_peers.cc:597] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.065169  7005 tablet_replica.cc:333] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd: stopping tablet replica
I20260709 13:07:07.065671  7005 raft_consensus.cc:2243] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.066066  7005 raft_consensus.cc:2272] T 356bbe8ee6554693b1a545b2da7051c8 P df879bc63e404e889fd4efcdc33281cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:07.068825 14690 consensus_peers.cc:597] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.073606 14690 consensus_peers.cc:597] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.088286 14690 consensus_peers.cc:597] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.124758 14690 consensus_peers.cc:597] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.145829 14690 consensus_peers.cc:597] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.175292 14690 consensus_peers.cc:597] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.178224  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
W20260709 13:07:07.214974 14764 consensus_peers.cc:597] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.228442 14690 consensus_peers.cc:597] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.242012 14690 consensus_peers.cc:597] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.265704  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
W20260709 13:07:07.285811 14764 consensus_peers.cc:597] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.296768 14690 consensus_peers.cc:597] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.297246 14690 consensus_peers.cc:597] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.299497 14764 consensus_peers.cc:597] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.309738 14767 consensus_peers.cc:597] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.315802 14690 consensus_peers.cc:597] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.318661 14690 consensus_peers.cc:597] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a -> Peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Couldn't send request to peer df879bc63e404e889fd4efcdc33281cd. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.321652  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:07.322491  7005 tablet_replica.cc:333] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.323469  7005 raft_consensus.cc:2243] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.324425  7005 raft_consensus.cc:2272] T 2cd2e1bed5724ce8ab462353f3f71b46 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.327839  7005 tablet_replica.cc:333] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.328454  7005 raft_consensus.cc:2243] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.328914  7005 raft_consensus.cc:2272] T 6148470389e947ffad07416847abd3ba P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.331073  7005 tablet_replica.cc:333] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.331660  7005 raft_consensus.cc:2243] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.332073  7005 raft_consensus.cc:2272] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.334237  7005 tablet_replica.cc:333] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.334714  7005 raft_consensus.cc:2243] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.335059  7005 raft_consensus.cc:2272] T db5fb9d53fa74b5ba11f946ac902a5f2 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.336788  7005 tablet_replica.cc:333] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.337273  7005 raft_consensus.cc:2243] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.337675  7005 raft_consensus.cc:2272] T 01b97cf3540541f984f1edaa8b7e2246 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.339855  7005 tablet_replica.cc:333] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.340567  7005 raft_consensus.cc:2243] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.340989  7005 raft_consensus.cc:2272] T 7702fc54076c4ee586ef69972a9449b5 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.343454  7005 tablet_replica.cc:333] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.344030  7005 raft_consensus.cc:2243] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.344738  7005 raft_consensus.cc:2272] T 182e9237880d46949460b001423a61ab P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.346644  7005 tablet_replica.cc:333] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.347163  7005 raft_consensus.cc:2243] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.347548  7005 raft_consensus.cc:2272] T ceebbbc7cabf4ee4a60995c283eb7c47 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.349681  7005 tablet_replica.cc:333] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.350445  7005 raft_consensus.cc:2243] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.350939  7005 raft_consensus.cc:2272] T 6652116aaa1648d2bc0a4cd9b44ade8f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:07.352269 14767 consensus_peers.cc:597] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:07.353706 14767 consensus_peers.cc:597] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.354214  7005 tablet_replica.cc:333] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.354880  7005 raft_consensus.cc:2243] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.355314  7005 raft_consensus.cc:2272] T 86c1574eeecf47e1b9d43861c4145347 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.357285  7005 tablet_replica.cc:333] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.358067  7005 raft_consensus.cc:2243] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.358960  7005 raft_consensus.cc:2272] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.361673  7005 tablet_replica.cc:333] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.362445  7005 raft_consensus.cc:2243] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.362869  7005 raft_consensus.cc:2272] T fc0aecc60f134c1188c9339ac259486f P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.364916  7005 tablet_replica.cc:333] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.365458  7005 raft_consensus.cc:2243] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.365831  7005 raft_consensus.cc:2272] T d147ffb9b1ba41d985cbae2564f1148c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.367532  7005 tablet_replica.cc:333] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.368038  7005 raft_consensus.cc:2243] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.368458  7005 raft_consensus.cc:2272] T caaad462138b4b2894c6c92ec9403e0d P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.371654  7005 tablet_replica.cc:333] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.372478  7005 raft_consensus.cc:2243] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.373257  7005 raft_consensus.cc:2272] T b3c58429a8964ea4bc7fe0ae68093fde P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.375811  7005 tablet_replica.cc:333] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.376312  7005 raft_consensus.cc:2243] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.377020  7005 raft_consensus.cc:2272] T 51da01c912804ff4ac1b26589077ae40 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.379010  7005 tablet_replica.cc:333] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.379487  7005 raft_consensus.cc:2243] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.380136  7005 raft_consensus.cc:2272] T 5d41095708f541448eba428743f63659 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.382001  7005 tablet_replica.cc:333] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.382463  7005 raft_consensus.cc:2243] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.382831  7005 raft_consensus.cc:2272] T 23f507402c5f47dab63dc0d6cc423e45 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.384625  7005 tablet_replica.cc:333] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.385119  7005 raft_consensus.cc:2243] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.385823  7005 raft_consensus.cc:2272] T a87d627f14ee4f22a43a3b0d36455e24 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.387596  7005 tablet_replica.cc:333] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.388080  7005 raft_consensus.cc:2243] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.388423  7005 raft_consensus.cc:2272] T 3724176103ea41e8bc3897d78affc140 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.390153  7005 tablet_replica.cc:333] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.391052  7005 raft_consensus.cc:2243] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.391960  7005 raft_consensus.cc:2272] T fc9cb0b2e53c4638b38fef94ecff6df7 P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.394392  7005 tablet_replica.cc:333] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.395012  7005 raft_consensus.cc:2243] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.395550  7005 raft_consensus.cc:2272] T 40422e35fd4d4a068bc2d1ff1a9b70c3 P 506ec781022645d4be0fcdf0bb76dd1a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.398726  7005 tablet_replica.cc:333] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.399405  7005 raft_consensus.cc:2243] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.399807  7005 raft_consensus.cc:2272] T 68f8f129f7da41399b8c4084d2514329 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.401871  7005 tablet_replica.cc:333] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.402398  7005 raft_consensus.cc:2243] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.402829  7005 raft_consensus.cc:2272] T 93517bd81c4746cd9280a1658d50fe99 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.404829  7005 tablet_replica.cc:333] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.405326  7005 raft_consensus.cc:2243] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.406122  7005 raft_consensus.cc:2272] T 345f32f81f7a4bd8af4458f831f49e96 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.408317  7005 tablet_replica.cc:333] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.408944  7005 raft_consensus.cc:2243] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.409480  7005 raft_consensus.cc:2272] T 902ea702a7c34a36a5c2ab940c67baee P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:07.410567 14767 consensus_peers.cc:597] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.412189  7005 tablet_replica.cc:333] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.412796  7005 raft_consensus.cc:2243] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.413210  7005 raft_consensus.cc:2272] T bd33d2753c08470f9b9b1d7145f75b16 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.415699  7005 tablet_replica.cc:333] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.416637  7005 raft_consensus.cc:2243] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.417830  7005 raft_consensus.cc:2272] T 4b65e4261c474c129d623f3ba0ce2600 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.420778  7005 tablet_replica.cc:333] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.421397  7005 raft_consensus.cc:2243] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.422168  7005 raft_consensus.cc:2272] T 5ff0cde640b64fd6b574f51fc2c50a62 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.424247  7005 tablet_replica.cc:333] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.424747  7005 raft_consensus.cc:2243] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.425472  7005 raft_consensus.cc:2272] T eaa647d819f4427c8f1eecbe00003fa4 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.427614  7005 tablet_replica.cc:333] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.428213  7005 raft_consensus.cc:2243] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.428694  7005 raft_consensus.cc:2272] T 7024877fba144524a8e2d1e04cb420d7 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.431313  7005 tablet_replica.cc:333] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.432078  7005 raft_consensus.cc:2243] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.432539  7005 raft_consensus.cc:2272] T 12e17887ea2648f790f2eea586a10f68 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.435653  7005 tablet_replica.cc:333] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.436179  7005 raft_consensus.cc:2243] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.436584  7005 raft_consensus.cc:2272] T 356bbe8ee6554693b1a545b2da7051c8 P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.440470  7005 tablet_replica.cc:333] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.441196  7005 raft_consensus.cc:2243] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.441735  7005 raft_consensus.cc:2272] T d27a48fa215640848445056cdc9dc61f P 506ec781022645d4be0fcdf0bb76dd1a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.444407  7005 tablet_replica.cc:333] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.445081  7005 raft_consensus.cc:2243] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.445588  7005 raft_consensus.cc:2272] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.448297  7005 tablet_replica.cc:333] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.449038  7005 raft_consensus.cc:2243] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.449968  7005 raft_consensus.cc:2272] T 963b71519e2643fb8a5312cb09636126 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.452879  7005 tablet_replica.cc:333] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.453594  7005 raft_consensus.cc:2243] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.454092  7005 raft_consensus.cc:2272] T dbe49d815dee48d3b45b9c3275a9aba5 P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.456914  7005 tablet_replica.cc:333] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.457676  7005 raft_consensus.cc:2243] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.458758  7005 raft_consensus.cc:2272] T 8911b4d6ee99489799d587b29247fe1c P 506ec781022645d4be0fcdf0bb76dd1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.461658  7005 tablet_replica.cc:333] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.462302  7005 raft_consensus.cc:2243] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.462847  7005 raft_consensus.cc:2272] T 31e27211ed824a3d8fd174e10c30a832 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.464937  7005 tablet_replica.cc:333] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.465512  7005 raft_consensus.cc:2243] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.465963  7005 raft_consensus.cc:2272] T 6ea3984c76074afa8be83ccbfc7d92fd P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.467773  7005 tablet_replica.cc:333] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.468240  7005 raft_consensus.cc:2243] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.468621  7005 raft_consensus.cc:2272] T 8ea40529e58642ecad3ba57398343c6f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.470422  7005 tablet_replica.cc:333] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.470860  7005 raft_consensus.cc:2243] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.471582  7005 raft_consensus.cc:2272] T f3a56c1b19f64f2a8eaff792c37d79b0 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.473438  7005 tablet_replica.cc:333] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.473872  7005 raft_consensus.cc:2243] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.474257  7005 raft_consensus.cc:2272] T 2666ab9efa994f198f2fb2f02c70df8f P 506ec781022645d4be0fcdf0bb76dd1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.475977  7005 tablet_replica.cc:333] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a: stopping tablet replica
I20260709 13:07:07.476385  7005 raft_consensus.cc:2243] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.476903  7005 raft_consensus.cc:2272] T 0db6fbac587a4051b87b0763a5cb6546 P 506ec781022645d4be0fcdf0bb76dd1a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:07.480800 14767 consensus_peers.cc:597] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.551226  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
W20260709 13:07:07.565804 14767 consensus_peers.cc:597] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.67:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.568141 15857 raft_consensus.cc:493] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:07:07.568593 15857 raft_consensus.cc:515] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:07.570154 15857 leader_election.cc:290] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
W20260709 13:07:07.573894 14767 leader_election.cc:336] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Network error: Client connection negotiation failed: client connection to 127.6.215.67:36787: connect: Connection refused (error 111)
W20260709 13:07:07.574379 14765 leader_election.cc:336] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:07:07.574713 14765 leader_election.cc:304] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:07.575282 15857 raft_consensus.cc:2749] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:07.585558 14767 consensus_peers.cc:597] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.67:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.601456 15889 raft_consensus.cc:493] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:07:07.602041 15889 raft_consensus.cc:515] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } } peers { permanent_uuid: "df879bc63e404e889fd4efcdc33281cd" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38167 } }
I20260709 13:07:07.604451 15889 leader_election.cc:290] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631), df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167)
W20260709 13:07:07.609330 14764 leader_election.cc:336] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer df879bc63e404e889fd4efcdc33281cd (127.6.215.66:38167): Network error: Client connection negotiation failed: client connection to 127.6.215.66:38167: connect: Connection refused (error 111)
W20260709 13:07:07.609912 14765 leader_election.cc:336] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:07:07.610325 14765 leader_election.cc:304] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, df879bc63e404e889fd4efcdc33281cd
I20260709 13:07:07.611027 15889 raft_consensus.cc:2749] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:07.625944 14767 consensus_peers.cc:597] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 -> Peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Couldn't send request to peer 506ec781022645d4be0fcdf0bb76dd1a. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.67:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:07.627262 15889 raft_consensus.cc:493] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4e3db9695e9c4fd1bfaa6d98644f6f67)
I20260709 13:07:07.627756 15889 raft_consensus.cc:515] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "506ec781022645d4be0fcdf0bb76dd1a" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36787 } } peers { permanent_uuid: "d54b0718d36f4f72ac7cef2358fbe6b6" member_type: VOTER last_known_addr { host: "127.6.215.68" port: 38771 } } peers { permanent_uuid: "4e3db9695e9c4fd1bfaa6d98644f6f67" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 43631 } }
I20260709 13:07:07.629597 15889 leader_election.cc:290] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787), 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631)
I20260709 13:07:07.632385  7005 tablet_server.cc:179] TabletServer@127.6.215.68:0 shutting down...
W20260709 13:07:07.635516 14767 leader_election.cc:336] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 506ec781022645d4be0fcdf0bb76dd1a (127.6.215.67:36787): Network error: Client connection negotiation failed: client connection to 127.6.215.67:36787: connect: Connection refused (error 111)
W20260709 13:07:07.636183 14765 leader_election.cc:336] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4e3db9695e9c4fd1bfaa6d98644f6f67 (127.6.215.65:43631): Network error: Client connection negotiation failed: client connection to 127.6.215.65:43631: connect: Connection refused (error 111)
I20260709 13:07:07.640398 14765 leader_election.cc:304] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54b0718d36f4f72ac7cef2358fbe6b6; no voters: 4e3db9695e9c4fd1bfaa6d98644f6f67, 506ec781022645d4be0fcdf0bb76dd1a
I20260709 13:07:07.641214 15889 raft_consensus.cc:2749] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.682693  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:07.683338  7005 tablet_replica.cc:333] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.683982  7005 raft_consensus.cc:2243] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.684391  7005 raft_consensus.cc:2272] T bf7b96dec18f42cd9f7cd905861e7ae2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.686504  7005 tablet_replica.cc:333] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.687294  7005 raft_consensus.cc:2243] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.687893  7005 raft_consensus.cc:2272] T 2cd2e1bed5724ce8ab462353f3f71b46 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.689859  7005 tablet_replica.cc:333] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.690546  7005 raft_consensus.cc:2243] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.691295  7005 raft_consensus.cc:2272] T 7d6d2fcb98dd448f83c04cf7b41c0d4a P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.693073  7005 tablet_replica.cc:333] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.693646  7005 raft_consensus.cc:2243] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.694159  7005 raft_consensus.cc:2272] T 6ef572ce75064396b97d4704e5f93335 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.695858  7005 tablet_replica.cc:333] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.696358  7005 raft_consensus.cc:2243] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.696753  7005 raft_consensus.cc:2272] T 83dfc715d1a74a2e9398771912873ead P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.698714  7005 tablet_replica.cc:333] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.699268  7005 raft_consensus.cc:2243] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.700001  7005 raft_consensus.cc:2272] T 3724176103ea41e8bc3897d78affc140 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.701949  7005 tablet_replica.cc:333] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.702477  7005 raft_consensus.cc:2243] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.702874  7005 raft_consensus.cc:2272] T 182e9237880d46949460b001423a61ab P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.704715  7005 tablet_replica.cc:333] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.705313  7005 raft_consensus.cc:2243] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.705744  7005 raft_consensus.cc:2272] T ceebbbc7cabf4ee4a60995c283eb7c47 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.707903  7005 tablet_replica.cc:333] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.708639  7005 raft_consensus.cc:2243] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.709108  7005 raft_consensus.cc:2272] T 7702fc54076c4ee586ef69972a9449b5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.712107  7005 tablet_replica.cc:333] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.712695  7005 raft_consensus.cc:2243] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.713455  7005 raft_consensus.cc:2272] T 7024877fba144524a8e2d1e04cb420d7 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.715391  7005 tablet_replica.cc:333] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.715891  7005 raft_consensus.cc:2243] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.716259  7005 raft_consensus.cc:2272] T 51da01c912804ff4ac1b26589077ae40 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.718297  7005 tablet_replica.cc:333] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.719045  7005 raft_consensus.cc:2243] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.719708  7005 raft_consensus.cc:2272] T 3789330431ce4e7ea306d15229f2efe2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.721422  7005 tablet_replica.cc:333] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.721936  7005 raft_consensus.cc:2243] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.722646  7005 raft_consensus.cc:2272] T bd33d2753c08470f9b9b1d7145f75b16 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.724407  7005 tablet_replica.cc:333] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.724901  7005 raft_consensus.cc:2243] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.725291  7005 raft_consensus.cc:2272] T 345f32f81f7a4bd8af4458f831f49e96 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.727183  7005 tablet_replica.cc:333] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.727703  7005 raft_consensus.cc:2243] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.728407  7005 raft_consensus.cc:2272] T db5fb9d53fa74b5ba11f946ac902a5f2 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.730216  7005 tablet_replica.cc:333] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.730715  7005 raft_consensus.cc:2243] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.731109  7005 raft_consensus.cc:2272] T dc4bcd1270a4459b8be8056af170226e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.732868  7005 tablet_replica.cc:333] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.733399  7005 raft_consensus.cc:2243] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.734450  7005 raft_consensus.cc:2272] T 2ea0a87730ae48b398447afece8bcc4e P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.736850  7005 tablet_replica.cc:333] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.737528  7005 raft_consensus.cc:2243] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.738408  7005 raft_consensus.cc:2272] T c65b133e1b7b49e7aa040543173e9286 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.740587  7005 tablet_replica.cc:333] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.741178  7005 raft_consensus.cc:2243] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.741694  7005 raft_consensus.cc:2272] T fc0aecc60f134c1188c9339ac259486f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.743877  7005 tablet_replica.cc:333] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.744457  7005 raft_consensus.cc:2243] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.744930  7005 raft_consensus.cc:2272] T b3c58429a8964ea4bc7fe0ae68093fde P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.746822  7005 tablet_replica.cc:333] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.747350  7005 raft_consensus.cc:2243] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.748067  7005 raft_consensus.cc:2272] T 2075e17bd50a4018aca3418b80b18311 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.749914  7005 tablet_replica.cc:333] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.750573  7005 raft_consensus.cc:2243] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.751879  7005 raft_consensus.cc:2272] T d7a3f00eb3c740b0ad48a7844a8ad8e8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.754506  7005 tablet_replica.cc:333] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.755148  7005 raft_consensus.cc:2243] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.755566  7005 raft_consensus.cc:2272] T 86c1574eeecf47e1b9d43861c4145347 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.757306  7005 tablet_replica.cc:333] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.757843  7005 raft_consensus.cc:2243] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.758538  7005 raft_consensus.cc:2272] T 9633676643a14702b9f1cbf070a1e46d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.760371  7005 tablet_replica.cc:333] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.760854  7005 raft_consensus.cc:2243] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.761268  7005 raft_consensus.cc:2272] T 3efb9d1bdbdc46ce96e07db0c6ffcf17 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.763078  7005 tablet_replica.cc:333] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.763561  7005 raft_consensus.cc:2243] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.764485  7005 raft_consensus.cc:2272] T 6148470389e947ffad07416847abd3ba P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.766305  7005 tablet_replica.cc:333] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.766776  7005 raft_consensus.cc:2243] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.767160  7005 raft_consensus.cc:2272] T 3e8104dc86ca4c3e84135792a5ac1769 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.769063  7005 tablet_replica.cc:333] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.769600  7005 raft_consensus.cc:2243] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.770601  7005 raft_consensus.cc:2272] T 0ff5557a61fd4c41885144bd05bc9bb8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.772636  7005 tablet_replica.cc:333] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.773133  7005 raft_consensus.cc:2243] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.773624  7005 raft_consensus.cc:2272] T 23f507402c5f47dab63dc0d6cc423e45 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.775493  7005 tablet_replica.cc:333] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.776283  7005 raft_consensus.cc:2243] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.776769  7005 raft_consensus.cc:2272] T 12e17887ea2648f790f2eea586a10f68 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.779006  7005 tablet_replica.cc:333] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.779650  7005 raft_consensus.cc:2243] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.780097  7005 raft_consensus.cc:2272] T 01b854989a274b4691e05ab9aa845495 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.781941  7005 tablet_replica.cc:333] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.782428  7005 raft_consensus.cc:2243] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.783206  7005 raft_consensus.cc:2272] T 356bbe8ee6554693b1a545b2da7051c8 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.784922  7005 tablet_replica.cc:333] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.785422  7005 raft_consensus.cc:2243] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.786134  7005 raft_consensus.cc:2272] T 4e8a7d306e3949bbb6b1b8b5e4a53bf0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.788161  7005 tablet_replica.cc:333] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.788712  7005 raft_consensus.cc:2243] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.789139  7005 raft_consensus.cc:2272] T c1bac898ef214078a9abf3e595a27520 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.791461  7005 tablet_replica.cc:333] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.792114  7005 raft_consensus.cc:2243] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.792649  7005 raft_consensus.cc:2272] T d27a48fa215640848445056cdc9dc61f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.795085  7005 tablet_replica.cc:333] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.795789  7005 raft_consensus.cc:2243] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.796224  7005 raft_consensus.cc:2272] T 5d41095708f541448eba428743f63659 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.798656  7005 tablet_replica.cc:333] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.799181  7005 raft_consensus.cc:2243] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.799592  7005 raft_consensus.cc:2272] T f3a56c1b19f64f2a8eaff792c37d79b0 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.801697  7005 tablet_replica.cc:333] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.802353  7005 raft_consensus.cc:2243] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.802799  7005 raft_consensus.cc:2272] T 963b71519e2643fb8a5312cb09636126 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.804728  7005 tablet_replica.cc:333] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.805200  7005 raft_consensus.cc:2243] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.805655  7005 raft_consensus.cc:2272] T dbe49d815dee48d3b45b9c3275a9aba5 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.807480  7005 tablet_replica.cc:333] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.807942  7005 raft_consensus.cc:2243] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.808316  7005 raft_consensus.cc:2272] T 8911b4d6ee99489799d587b29247fe1c P d54b0718d36f4f72ac7cef2358fbe6b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.810119  7005 tablet_replica.cc:333] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.810555  7005 raft_consensus.cc:2243] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.811305  7005 raft_consensus.cc:2272] T 31e27211ed824a3d8fd174e10c30a832 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.813267  7005 tablet_replica.cc:333] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.814009  7005 raft_consensus.cc:2243] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.814986  7005 raft_consensus.cc:2272] T 2666ab9efa994f198f2fb2f02c70df8f P d54b0718d36f4f72ac7cef2358fbe6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.817003  7005 tablet_replica.cc:333] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.817579  7005 raft_consensus.cc:2243] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.818035  7005 raft_consensus.cc:2272] T 959e66f7e7ea4430b66b08c75d3f8a3d P d54b0718d36f4f72ac7cef2358fbe6b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.820209  7005 tablet_replica.cc:333] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6: stopping tablet replica
I20260709 13:07:07.820648  7005 raft_consensus.cc:2243] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:07.821058  7005 raft_consensus.cc:2272] T 0db6fbac587a4051b87b0763a5cb6546 P d54b0718d36f4f72ac7cef2358fbe6b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.889178  7005 tablet_server.cc:196] TabletServer@127.6.215.68:0 shutdown complete.
I20260709 13:07:07.953688  7005 master.cc:562] Master@127.6.215.126:37295 shutting down...
I20260709 13:07:07.978794  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.979645  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.979985  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1fd259ba3d9648998b521c980ba1db9d: stopping tablet replica
I20260709 13:07:08.001922  7005 master.cc:584] Master@127.6.215.126:37295 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39128 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:07:08.094910  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:45777
I20260709 13:07:08.096087  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:08.101877 15934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.102205 15935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.103018 15937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.104278  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:08.105530  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:08.105707  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:08.105854  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602428105836 us; error 0 us; skew 500 ppm
I20260709 13:07:08.106388  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:08.108680  7005 webserver.cc:533] Webserver started at http://127.6.215.126:43273/ using document root <none> and password file <none>
I20260709 13:07:08.109124  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:08.109277  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:08.109608  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:08.110674  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "6f8361f456c54bc788265d7d687084ab"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.116007  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:08.120046 15942 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.121009  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:08.121376  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "6f8361f456c54bc788265d7d687084ab"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.121809  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:08.136221  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:08.137831  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:08.179129  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:45777
I20260709 13:07:08.179313 15993 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:45777 every 8 connection(s)
I20260709 13:07:08.182909 15994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.195251 15994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab: Bootstrap starting.
I20260709 13:07:08.199774 15994 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:08.203739 15994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab: No bootstrap required, opened a new log
I20260709 13:07:08.205775 15994 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f8361f456c54bc788265d7d687084ab" member_type: VOTER }
I20260709 13:07:08.206120 15994 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:08.206297 15994 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f8361f456c54bc788265d7d687084ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:08.206818 15994 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f8361f456c54bc788265d7d687084ab" member_type: VOTER }
I20260709 13:07:08.207221 15994 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:08.207412 15994 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:08.207616 15994 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:08.211920 15994 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f8361f456c54bc788265d7d687084ab" member_type: VOTER }
I20260709 13:07:08.212360 15994 leader_election.cc:304] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f8361f456c54bc788265d7d687084ab; no voters: 
I20260709 13:07:08.213486 15994 leader_election.cc:290] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:08.213860 15997 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:08.215276 15997 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 1 LEADER]: Becoming Leader. State: Replica: 6f8361f456c54bc788265d7d687084ab, State: Running, Role: LEADER
I20260709 13:07:08.216068 15997 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f8361f456c54bc788265d7d687084ab" member_type: VOTER }
I20260709 13:07:08.216228 15994 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:08.220579 15999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f8361f456c54bc788265d7d687084ab. Latest consensus state: current_term: 1 leader_uuid: "6f8361f456c54bc788265d7d687084ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f8361f456c54bc788265d7d687084ab" member_type: VOTER } }
I20260709 13:07:08.220682 15998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f8361f456c54bc788265d7d687084ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f8361f456c54bc788265d7d687084ab" member_type: VOTER } }
I20260709 13:07:08.221172 15999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:08.221383 15998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:08.224264 16005 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:08.228989 16005 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:08.232539  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:08.238078 16005 catalog_manager.cc:1383] Generated new cluster ID: 5051c003c99d4051ab30afbb7c367508
I20260709 13:07:08.238364 16005 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:08.253742 16005 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:08.254984 16005 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:08.269373 16005 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab: Generated new TSK 0
I20260709 13:07:08.269965 16005 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:08.299317  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:08.305795 16015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.306183 16016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.308132 16018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.309360  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:08.310357  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:08.310534  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:08.310650  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602428310640 us; error 0 us; skew 500 ppm
I20260709 13:07:08.311105  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:08.313499  7005 webserver.cc:533] Webserver started at http://127.6.215.65:32797/ using document root <none> and password file <none>
I20260709 13:07:08.313946  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:08.314105  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:08.314327  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:08.315790  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "18f9b347f31942f58fd4e20983181c5b"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.320668  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:07:08.324122 16023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.325028  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:08.325337  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "18f9b347f31942f58fd4e20983181c5b"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.325628  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:08.339130  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:08.340342  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:08.341764  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:08.343878  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:08.344058  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.344277  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:08.344442  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.387181  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:40143
I20260709 13:07:08.387362 16085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:40143 every 8 connection(s)
I20260709 13:07:08.392010  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:08.401547 16090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.402732 16091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.404862  7005 server_base.cc:1061] running on GCE node
W20260709 13:07:08.405673 16093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.406765  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:08.407040  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:08.407212  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602428407197 us; error 0 us; skew 500 ppm
I20260709 13:07:08.407680  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:08.409740  7005 webserver.cc:533] Webserver started at http://127.6.215.66:38367/ using document root <none> and password file <none>
I20260709 13:07:08.410163  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:08.410315  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:08.410519  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:08.412329  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "fc91c555675945c89d3a9c2005e28780"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.414469 16086 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45777
I20260709 13:07:08.415128 16086 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:08.416188 16086 heartbeater.cc:507] Master 127.6.215.126:45777 requested a full tablet report, sending...
I20260709 13:07:08.418697 15959 ts_manager.cc:194] Registered new tserver with Master: 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143)
I20260709 13:07:08.418962  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:07:08.421118 15959 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49304
I20260709 13:07:08.423768 16098 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.424657  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:08.425137  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "fc91c555675945c89d3a9c2005e28780"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.425539  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:08.447044  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:08.448288  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:08.449783  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:08.452582  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:08.452875  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.453141  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:08.453464  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.494887  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:33355
I20260709 13:07:08.495023 16160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:33355 every 8 connection(s)
I20260709 13:07:08.499462  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:08.506125 16164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.506951 16165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.508787 16167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.509914  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:08.510850  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:08.511080  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:08.511284 16161 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45777
I20260709 13:07:08.511291  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602428511274 us; error 0 us; skew 500 ppm
I20260709 13:07:08.511744 16161 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:08.512110  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:08.512496 16161 heartbeater.cc:507] Master 127.6.215.126:45777 requested a full tablet report, sending...
I20260709 13:07:08.515031  7005 webserver.cc:533] Webserver started at http://127.6.215.67:43857/ using document root <none> and password file <none>
I20260709 13:07:08.515202 15959 ts_manager.cc:194] Registered new tserver with Master: fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:08.515573  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:08.515817  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:08.516047  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:08.516911 15959 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49318
I20260709 13:07:08.517084  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "d2a38bc6f8b3422ca8e1642264076361"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.521554  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:07:08.524720 16172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.525508  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:08.525786  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "d2a38bc6f8b3422ca8e1642264076361"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:08.526038  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:08.539947  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:08.541113  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:08.542567  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:08.544668  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:08.544837  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.545064  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:08.545217  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.583725  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:36993
I20260709 13:07:08.583873 16234 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:36993 every 8 connection(s)
I20260709 13:07:08.597419 16235 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45777
I20260709 13:07:08.597981 16235 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:08.598757 16235 heartbeater.cc:507] Master 127.6.215.126:45777 requested a full tablet report, sending...
I20260709 13:07:08.600639 15959 ts_manager.cc:194] Registered new tserver with Master: d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:08.601398  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014829308s
I20260709 13:07:08.602092 15959 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49328
I20260709 13:07:08.627417 15959 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49338:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:08.630308 15959 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:08.707980 16051 tablet_service.cc:1511] Processing CreateTablet for tablet 15a19020a29345b0aa3bac362b2d2ce0 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:08.709383 16051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a19020a29345b0aa3bac362b2d2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.714552 16200 tablet_service.cc:1511] Processing CreateTablet for tablet 15a19020a29345b0aa3bac362b2d2ce0 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:08.715934 16200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a19020a29345b0aa3bac362b2d2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.717517 16199 tablet_service.cc:1511] Processing CreateTablet for tablet d2e875ab0f164f41b5782ac64b22fba1 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:08.717732 16050 tablet_service.cc:1511] Processing CreateTablet for tablet d2e875ab0f164f41b5782ac64b22fba1 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:08.718870 16199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e875ab0f164f41b5782ac64b22fba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.719043 16050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e875ab0f164f41b5782ac64b22fba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.723021 16198 tablet_service.cc:1511] Processing CreateTablet for tablet f4cb251260424b4fa016bdb23ff121f9 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:08.724520 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cb251260424b4fa016bdb23ff121f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.724655 16196 tablet_service.cc:1511] Processing CreateTablet for tablet d22e76e4ae414b0fbb5732e50fd49791 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:08.725883 16197 tablet_service.cc:1511] Processing CreateTablet for tablet 6a680c3bab3e4588b4b95e2c6d0b691f (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:08.726856 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 750d64cebae14cad96278a638cad1f66 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:08.728832 16049 tablet_service.cc:1511] Processing CreateTablet for tablet f4cb251260424b4fa016bdb23ff121f9 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:08.729661 16194 tablet_service.cc:1511] Processing CreateTablet for tablet e1c93f1544d7480d9c0158168975f639 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:08.732173 16048 tablet_service.cc:1511] Processing CreateTablet for tablet 6a680c3bab3e4588b4b95e2c6d0b691f (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:08.732627 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 65adb23f5ac145f3b32a1564983cf21a (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:08.733945 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65adb23f5ac145f3b32a1564983cf21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.734153 16047 tablet_service.cc:1511] Processing CreateTablet for tablet d22e76e4ae414b0fbb5732e50fd49791 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:08.737334 16126 tablet_service.cc:1511] Processing CreateTablet for tablet 15a19020a29345b0aa3bac362b2d2ce0 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:08.734516 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22e76e4ae414b0fbb5732e50fd49791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.738554 16126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a19020a29345b0aa3bac362b2d2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.738705 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 750d64cebae14cad96278a638cad1f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.739593 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a680c3bab3e4588b4b95e2c6d0b691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.740219 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c93f1544d7480d9c0158168975f639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.741639 16125 tablet_service.cc:1511] Processing CreateTablet for tablet d2e875ab0f164f41b5782ac64b22fba1 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:08.742901 16125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e875ab0f164f41b5782ac64b22fba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.746466 16124 tablet_service.cc:1511] Processing CreateTablet for tablet f4cb251260424b4fa016bdb23ff121f9 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:08.747807 16124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cb251260424b4fa016bdb23ff121f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.751039 16123 tablet_service.cc:1511] Processing CreateTablet for tablet 6a680c3bab3e4588b4b95e2c6d0b691f (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:08.752326 16123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a680c3bab3e4588b4b95e2c6d0b691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.754966 16122 tablet_service.cc:1511] Processing CreateTablet for tablet d22e76e4ae414b0fbb5732e50fd49791 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:08.755210 16121 tablet_service.cc:1511] Processing CreateTablet for tablet 750d64cebae14cad96278a638cad1f66 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:08.756340 16122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22e76e4ae414b0fbb5732e50fd49791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.757289 16120 tablet_service.cc:1511] Processing CreateTablet for tablet e1c93f1544d7480d9c0158168975f639 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:08.757938 16121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 750d64cebae14cad96278a638cad1f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.758543 16120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c93f1544d7480d9c0158168975f639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.761555 16046 tablet_service.cc:1511] Processing CreateTablet for tablet 750d64cebae14cad96278a638cad1f66 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:08.763737 16045 tablet_service.cc:1511] Processing CreateTablet for tablet e1c93f1544d7480d9c0158168975f639 (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:08.765983 16044 tablet_service.cc:1511] Processing CreateTablet for tablet 65adb23f5ac145f3b32a1564983cf21a (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:08.730170 16049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cb251260424b4fa016bdb23ff121f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.769927 16047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22e76e4ae414b0fbb5732e50fd49791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.773686 16048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a680c3bab3e4588b4b95e2c6d0b691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.773518 16192 tablet_service.cc:1511] Processing CreateTablet for tablet b3bc568c3ebc4468a027c7d3df5a82cd (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:08.775177 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bc568c3ebc4468a027c7d3df5a82cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.777763 16045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c93f1544d7480d9c0158168975f639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.778923 16044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65adb23f5ac145f3b32a1564983cf21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.781692 16046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 750d64cebae14cad96278a638cad1f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.786031 16043 tablet_service.cc:1511] Processing CreateTablet for tablet b3bc568c3ebc4468a027c7d3df5a82cd (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:08.787581 16043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bc568c3ebc4468a027c7d3df5a82cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.787906 16251 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:08.794054 16042 tablet_service.cc:1511] Processing CreateTablet for tablet 1d23f8a2034b446a90403292115ff97d (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:08.796062 16042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d23f8a2034b446a90403292115ff97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.811880 16119 tablet_service.cc:1511] Processing CreateTablet for tablet 65adb23f5ac145f3b32a1564983cf21a (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:08.814855 16118 tablet_service.cc:1511] Processing CreateTablet for tablet b3bc568c3ebc4468a027c7d3df5a82cd (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:08.815735 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 1d23f8a2034b446a90403292115ff97d (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:08.816497 16119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65adb23f5ac145f3b32a1564983cf21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.817566 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d23f8a2034b446a90403292115ff97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.819253 16118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bc568c3ebc4468a027c7d3df5a82cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.820777 16251 tablet_bootstrap.cc:654] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:08.844887 16121 tablet_service.cc:1511] Processing CreateTablet for tablet 1d23f8a2034b446a90403292115ff97d (DEFAULT_TABLE table=test-workload [id=98bc16b467a1430eac1e457642d9f9be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:08.846438 16121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d23f8a2034b446a90403292115ff97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.884290 16251 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:08.885016 16251 ts_tablet_manager.cc:1403] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.004s
I20260709 13:07:08.888198 16251 raft_consensus.cc:359] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:08.893883 16251 raft_consensus.cc:385] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:08.894423 16251 raft_consensus.cc:740] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:08.898926 16251 consensus_queue.cc:260] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:08.906101 16251 ts_tablet_manager.cc:1434] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.008s
I20260709 13:07:08.910223 16086 heartbeater.cc:499] Master 127.6.215.126:45777 was elected leader, sending a full tablet report...
I20260709 13:07:08.941620 16251 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:08.970671 16250 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:08.972421 16252 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:08.978737 16251 tablet_bootstrap.cc:654] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:08.979144 16250 tablet_bootstrap.cc:654] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:08.980381 16252 tablet_bootstrap.cc:654] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:08.990754 16250 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:08.991344 16250 ts_tablet_manager.cc:1403] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:07:08.994634 16250 raft_consensus.cc:359] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:08.995422 16250 raft_consensus.cc:385] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:08.995723 16250 raft_consensus.cc:740] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:08.997225 16250 consensus_queue.cc:260] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:08.999423 16252 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.000065 16252 ts_tablet_manager.cc:1403] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.018s
I20260709 13:07:09.004364 16252 raft_consensus.cc:359] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.005257 16252 raft_consensus.cc:385] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.005587 16252 raft_consensus.cc:740] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.006085 16235 heartbeater.cc:499] Master 127.6.215.126:45777 was elected leader, sending a full tablet report...
I20260709 13:07:09.006456 16250 ts_tablet_manager.cc:1434] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.008s
I20260709 13:07:09.006739 16251 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.006435 16252 consensus_queue.cc:260] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.007527 16251 ts_tablet_manager.cc:1403] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.000s
I20260709 13:07:09.007954 16250 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.010617 16251 raft_consensus.cc:359] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.011605 16251 raft_consensus.cc:385] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.012004 16251 raft_consensus.cc:740] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.012696 16251 consensus_queue.cc:260] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.014778 16251 ts_tablet_manager.cc:1434] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:09.015801 16251 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.016319 16252 ts_tablet_manager.cc:1434] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:07:09.017112 16161 heartbeater.cc:499] Master 127.6.215.126:45777 was elected leader, sending a full tablet report...
I20260709 13:07:09.017495 16252 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.021967 16251 tablet_bootstrap.cc:654] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.022810 16250 tablet_bootstrap.cc:654] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.024451 16252 tablet_bootstrap.cc:654] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.034268 16250 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.034794 16250 ts_tablet_manager.cc:1403] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 13:07:09.035998 16252 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.036579 16252 ts_tablet_manager.cc:1403] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 13:07:09.036621 16251 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.037552 16250 raft_consensus.cc:359] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.037685 16251 ts_tablet_manager.cc:1403] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:07:09.038306 16250 raft_consensus.cc:385] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.038662 16250 raft_consensus.cc:740] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.039558 16250 consensus_queue.cc:260] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.039817 16252 raft_consensus.cc:359] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.040609 16252 raft_consensus.cc:385] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.040940 16252 raft_consensus.cc:740] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.041103 16251 raft_consensus.cc:359] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.041850 16251 raft_consensus.cc:385] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.041942 16250 ts_tablet_manager.cc:1434] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:07:09.042165 16251 raft_consensus.cc:740] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.041960 16252 consensus_queue.cc:260] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.043030 16250 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.044443 16252 ts_tablet_manager.cc:1434] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:09.043043 16251 consensus_queue.cc:260] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.046919 16252 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.047755 16251 ts_tablet_manager.cc:1434] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:07:09.048767 16251 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.049103 16250 tablet_bootstrap.cc:654] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.054044 16252 tablet_bootstrap.cc:654] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.055481 16251 tablet_bootstrap.cc:654] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.065263 16251 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.065853 16251 ts_tablet_manager.cc:1403] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.002s
I20260709 13:07:09.068734 16251 raft_consensus.cc:359] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.070109 16251 raft_consensus.cc:385] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.070510 16251 raft_consensus.cc:740] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.071235 16251 consensus_queue.cc:260] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.072608 16252 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.073182 16252 ts_tablet_manager.cc:1403] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:07:09.073371 16251 ts_tablet_manager.cc:1434] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:07:09.076407 16252 raft_consensus.cc:359] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.077239 16252 raft_consensus.cc:385] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.077584 16252 raft_consensus.cc:740] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.077854 16251 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.078415 16252 consensus_queue.cc:260] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.080965 16252 ts_tablet_manager.cc:1434] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:09.081904 16252 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.085805 16251 tablet_bootstrap.cc:654] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.087641 16252 tablet_bootstrap.cc:654] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:09.087723 16236 tablet.cc:2406] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:09.103354 16250 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.103781 16250 ts_tablet_manager.cc:1403] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.036s
I20260709 13:07:09.104089 16251 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.104102 16252 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.104823 16251 ts_tablet_manager.cc:1403] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.008s
I20260709 13:07:09.104889 16252 ts_tablet_manager.cc:1403] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:07:09.106109 16250 raft_consensus.cc:359] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.106664 16250 raft_consensus.cc:385] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.106886 16250 raft_consensus.cc:740] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.107389 16254 raft_consensus.cc:493] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.107570 16250 consensus_queue.cc:260] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.107869 16254 raft_consensus.cc:515] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.108568 16252 raft_consensus.cc:359] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.109161 16252 raft_consensus.cc:385] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.109390 16252 raft_consensus.cc:740] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.109699 16250 ts_tablet_manager.cc:1434] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:07:09.110006 16252 consensus_queue.cc:260] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.110903 16250 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.114562 16254 leader_election.cc:290] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.107911 16251 raft_consensus.cc:359] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.115180 16251 raft_consensus.cc:385] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.115501 16251 raft_consensus.cc:740] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.116171 16251 consensus_queue.cc:260] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.118964 16251 ts_tablet_manager.cc:1434] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:07:09.119678 16250 tablet_bootstrap.cc:654] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.120175 16252 ts_tablet_manager.cc:1434] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:09.121302 16252 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.128041 16251 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.133477 16252 tablet_bootstrap.cc:654] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.134439 16250 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.135005 16250 ts_tablet_manager.cc:1403] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:07:09.137744 16250 raft_consensus.cc:359] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.138505 16250 raft_consensus.cc:385] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.138873 16250 raft_consensus.cc:740] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.139747 16250 consensus_queue.cc:260] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.141769 16250 ts_tablet_manager.cc:1434] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:07:09.142704 16250 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.143921 16252 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.138183 16251 tablet_bootstrap.cc:654] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.144517 16252 ts_tablet_manager.cc:1403] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:07:09.147524 16252 raft_consensus.cc:359] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.148309 16252 raft_consensus.cc:385] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.148633 16252 raft_consensus.cc:740] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.149542 16252 consensus_queue.cc:260] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.152866 16250 tablet_bootstrap.cc:654] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.157179 16259 raft_consensus.cc:493] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.157743 16259 raft_consensus.cc:515] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.163568 16259 leader_election.cc:290] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.167053 16251 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.176211 16251 ts_tablet_manager.cc:1403] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 13:07:09.179198 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
W20260709 13:07:09.180773 16027 leader_election.cc:343] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.182430 16252 ts_tablet_manager.cc:1434] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:07:09.183579 16250 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.184108 16250 ts_tablet_manager.cc:1403] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.013s
I20260709 13:07:09.179642 16251 raft_consensus.cc:359] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.188103 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.186304 16252 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.188813 16136 raft_consensus.cc:2468] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.186918 16250 raft_consensus.cc:359] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.189433 16250 raft_consensus.cc:385] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.189795 16250 raft_consensus.cc:740] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.190232 16025 leader_election.cc:304] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.191504 16254 raft_consensus.cc:2804] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.191248 16250 consensus_queue.cc:260] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.191913 16254 raft_consensus.cc:493] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.192284 16254 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.192956 16251 raft_consensus.cc:385] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.193336 16251 raft_consensus.cc:740] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.194101 16251 consensus_queue.cc:260] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.194211 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b" is_pre_election: true
I20260709 13:07:09.196287 16250 ts_tablet_manager.cc:1434] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:09.197320 16250 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
W20260709 13:07:09.198015 16100 leader_election.cc:343] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.201314 16254 raft_consensus.cc:515] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.202790 16250 tablet_bootstrap.cc:654] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.205133 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.206704 16251 ts_tablet_manager.cc:1434] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:07:09.207125 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:09.207647 16136 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.203639 16254 leader_election.cc:290] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.207720 16251 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.216315 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.217024 16210 raft_consensus.cc:2468] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 0.
W20260709 13:07:09.206632 16027 leader_election.cc:343] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.218080 16102 leader_election.cc:304] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:09.218802 16259 raft_consensus.cc:2804] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.219161 16259 raft_consensus.cc:493] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.219509 16259 raft_consensus.cc:3060] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.221716 16251 tablet_bootstrap.cc:654] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.224028 16136 raft_consensus.cc:2468] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.221697 16252 tablet_bootstrap.cc:654] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.225291 16254 raft_consensus.cc:493] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.225811 16254 raft_consensus.cc:515] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
W20260709 13:07:09.226658 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:09.226394 16259 raft_consensus.cc:515] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.227766 16277 raft_consensus.cc:493] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.228248 16277 raft_consensus.cc:515] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.229063 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:09.229811 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.230382 16210 raft_consensus.cc:3060] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.231123 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
W20260709 13:07:09.232972 16025 leader_election.cc:343] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:09.233597 16100 leader_election.cc:343] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.234068 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
W20260709 13:07:09.235581 16027 leader_election.cc:343] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.236388 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.236984 16135 raft_consensus.cc:2468] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.237589 16259 leader_election.cc:290] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.238165 16025 leader_election.cc:304] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.238857 16210 raft_consensus.cc:2468] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:09.239292 16250 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.239778 16250 ts_tablet_manager.cc:1403] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.016s
I20260709 13:07:09.240182 16102 leader_election.cc:304] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:09.240483 16281 raft_consensus.cc:2804] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.240883 16281 raft_consensus.cc:493] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.241008 16259 raft_consensus.cc:2804] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.241226 16281 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.242079 16025 leader_election.cc:304] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.242602 16250 raft_consensus.cc:359] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.243377 16250 raft_consensus.cc:385] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.243666 16250 raft_consensus.cc:740] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.240235 16254 leader_election.cc:290] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.244457 16250 consensus_queue.cc:260] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.244860 16254 raft_consensus.cc:2804] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.247394 16251 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.247701 16277 leader_election.cc:290] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.248111 16251 ts_tablet_manager.cc:1403] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 13:07:09.247877 16250 ts_tablet_manager.cc:1434] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:09.249758 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.250357 16210 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.251602 16027 leader_election.cc:304] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.251643 16251 raft_consensus.cc:359] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.248349 16254 raft_consensus.cc:697] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.252631 16251 raft_consensus.cc:385] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.253458 16251 raft_consensus.cc:740] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.254364 16277 raft_consensus.cc:2804] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.254743 16277 raft_consensus.cc:493] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.255069 16277 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.255193 16251 consensus_queue.cc:260] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.257205 16254 consensus_queue.cc:237] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.263095 16251 ts_tablet_manager.cc:1434] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:07:09.264189 16251 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.257586 16281 raft_consensus.cc:515] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.270280 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:09.272133 16136 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.272994 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
W20260709 13:07:09.274411 16027 leader_election.cc:343] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.274945 16281 leader_election.cc:290] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.276101 16251 tablet_bootstrap.cc:654] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.271454 16252 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.280540 16277 raft_consensus.cc:515] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.270943 16259 raft_consensus.cc:697] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:09.282214 16252 ts_tablet_manager.cc:1403] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.011s
I20260709 13:07:09.282979 16284 raft_consensus.cc:493] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.283504 16284 raft_consensus.cc:515] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.283703 15958 catalog_manager.cc:5697] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.284888 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.281930 16250 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.285488 16210 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.286701 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.287038 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b" is_pre_election: true
I20260709 13:07:09.287400 16209 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 0.
I20260709 13:07:09.287640 16061 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 0.
I20260709 13:07:09.288714 16102 leader_election.cc:304] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:09.288632 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:09.281741 16136 raft_consensus.cc:2468] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.292200 16284 leader_election.cc:290] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.295687 16210 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.285411 16252 raft_consensus.cc:359] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.293432 16282 raft_consensus.cc:2804] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.297127 16025 leader_election.cc:304] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.292148 16277 leader_election.cc:290] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.296978 16252 raft_consensus.cc:385] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.293826 16250 tablet_bootstrap.cc:654] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.298184 16027 leader_election.cc:304] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:09.298732 16254 raft_consensus.cc:2804] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.299820 16252 raft_consensus.cc:740] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.300257 16254 raft_consensus.cc:697] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.300860 16252 consensus_queue.cc:260] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.301194 16254 consensus_queue.cc:237] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.301877 16135 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.297128 16282 raft_consensus.cc:493] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.303546 16282 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.305048 16281 raft_consensus.cc:2804] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.305788 16281 raft_consensus.cc:697] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.299018 16259 consensus_queue.cc:237] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.306697 16281 consensus_queue.cc:237] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.310673 16135 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.316357 16252 ts_tablet_manager.cc:1434] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:07:09.320511 16252 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.321655 16251 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.322232 16251 ts_tablet_manager.cc:1403] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.012s
I20260709 13:07:09.328723 16252 tablet_bootstrap.cc:654] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.329164 16250 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.329676 16250 ts_tablet_manager.cc:1403] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.004s
I20260709 13:07:09.330078 16282 raft_consensus.cc:515] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.332547 16250 raft_consensus.cc:359] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.333112 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:09.333299 16250 raft_consensus.cc:385] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.333705 16061 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.333628 16281 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.334474 16281 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.336907 16281 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:09.337606 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.338186 16210 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.338560 16251 raft_consensus.cc:359] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.339224 16251 raft_consensus.cc:385] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.339469 16251 raft_consensus.cc:740] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.339632 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.340065 16282 leader_election.cc:290] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.341084 16027 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:09.342128 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.339879 16250 raft_consensus.cc:740] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.342803 16210 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.343223 16250 consensus_queue.cc:260] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.345430 16250 ts_tablet_manager.cc:1434] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:07:09.346400 16250 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
W20260709 13:07:09.346705 16025 leader_election.cc:343] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.352135 16250 tablet_bootstrap.cc:654] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.352249 16210 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:09.352777 16061 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:09.352535 16281 raft_consensus.cc:2804] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.352845 16251 consensus_queue.cc:260] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.353648 16102 leader_election.cc:304] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:09.354363 16281 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.354751 16259 raft_consensus.cc:2804] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.356422 16259 raft_consensus.cc:697] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:09.356003 16251 ts_tablet_manager.cc:1434] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:07:09.356472 16254 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.356472 16281 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.357200 16254 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.358206 16251 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.360745 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
W20260709 13:07:09.362248 16025 leader_election.cc:343] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.361634 15956 catalog_manager.cc:5697] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.363907 16251 tablet_bootstrap.cc:654] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.364058 16254 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.364864 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.365489 16210 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.357393 16259 consensus_queue.cc:237] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.366587 16027 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.367599 16254 raft_consensus.cc:2804] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.367950 16254 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.368443 16254 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.375267 16281 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.378468 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.379057 16210 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.380622 16254 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.386585 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
W20260709 13:07:09.388128 16025 leader_election.cc:343] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.388674 16281 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:09.392964 16210 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.394362 16027 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.395435 16281 raft_consensus.cc:2804] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.396068 16281 raft_consensus.cc:697] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.398756 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:09.399621 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
W20260709 13:07:09.400242 16025 leader_election.cc:343] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.400049 16254 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.401278 16210 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.404599 16252 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.405102 16252 ts_tablet_manager.cc:1403] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.022s
I20260709 13:07:09.396869 16281 consensus_queue.cc:237] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.407927 16252 raft_consensus.cc:359] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.408612 16252 raft_consensus.cc:385] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.408937 16252 raft_consensus.cc:740] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.409986 16250 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.409842 16252 consensus_queue.cc:260] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.410480 16250 ts_tablet_manager.cc:1403] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.064s	user 0.005s	sys 0.005s
I20260709 13:07:09.410566 16210 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.412204 16252 ts_tablet_manager.cc:1434] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:07:09.412135 16027 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.412678 16251 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.413130 16251 ts_tablet_manager.cc:1403] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.005s
I20260709 13:07:09.413225 16252 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.413286 16254 raft_consensus.cc:2804] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.414882 16254 raft_consensus.cc:697] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.408421 15956 catalog_manager.cc:5697] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.415815 16254 consensus_queue.cc:237] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.416541 15956 catalog_manager.cc:5697] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.416951 16251 raft_consensus.cc:359] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.417764 16251 raft_consensus.cc:385] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.418126 16251 raft_consensus.cc:740] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.413064 16250 raft_consensus.cc:359] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.419044 16251 consensus_queue.cc:260] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.421411 16252 tablet_bootstrap.cc:654] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.421500 16251 ts_tablet_manager.cc:1434] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:07:09.422474 16251 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:09.419680 16250 raft_consensus.cc:385] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.425060 16250 raft_consensus.cc:740] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.425923 16250 consensus_queue.cc:260] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.429893 16277 raft_consensus.cc:493] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.430506 16277 raft_consensus.cc:515] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.436335 16254 raft_consensus.cc:493] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.436957 16254 raft_consensus.cc:515] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.445262 16251 tablet_bootstrap.cc:654] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.446334 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.448417 16252 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.448876 16252 ts_tablet_manager.cc:1403] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.010s
I20260709 13:07:09.449581 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.449896 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.450435 16210 raft_consensus.cc:2393] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f9b347f31942f58fd4e20983181c5b in current term 1: Already voted for candidate fc91c555675945c89d3a9c2005e28780 in this term.
I20260709 13:07:09.450577 16250 ts_tablet_manager.cc:1434] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
W20260709 13:07:09.451213 16025 leader_election.cc:343] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.451511 16250 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.451720 16027 leader_election.cc:304] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b; no voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.451432 16252 raft_consensus.cc:359] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.452191 16277 leader_election.cc:290] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.452454 16252 raft_consensus.cc:385] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.452760 16252 raft_consensus.cc:740] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.452771 16277 raft_consensus.cc:3060] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.453809 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.453640 16252 consensus_queue.cc:260] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.454417 16210 raft_consensus.cc:2468] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.455832 16252 ts_tablet_manager.cc:1434] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:07:09.455966 16027 leader_election.cc:304] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.456745 16252 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.457244 16281 raft_consensus.cc:2804] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.457726 16281 raft_consensus.cc:493] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.458101 16281 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.465276 15957 catalog_manager.cc:5697] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.467247 16250 tablet_bootstrap.cc:654] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.467273 16252 tablet_bootstrap.cc:654] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.468148 16254 leader_election.cc:290] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.473263 16281 raft_consensus.cc:515] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.476334 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
W20260709 13:07:09.477705 16025 leader_election.cc:343] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.478173 16250 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.478528 16251 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: No bootstrap required, opened a new log
I20260709 13:07:09.478622 16250 ts_tablet_manager.cc:1403] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:07:09.478601 16254 raft_consensus.cc:493] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.479099 16251 ts_tablet_manager.cc:1403] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.004s
I20260709 13:07:09.479449 16254 raft_consensus.cc:515] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.481467 16250 raft_consensus.cc:359] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.481861 16251 raft_consensus.cc:359] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.482126 16250 raft_consensus.cc:385] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.482159 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.482473 16252 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.482595 16250 raft_consensus.cc:740] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.483034 16135 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.483193 16252 ts_tablet_manager.cc:1403] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:07:09.483529 16250 consensus_queue.cc:260] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.484279 16025 leader_election.cc:304] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:09.485750 16252 raft_consensus.cc:359] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.486086 16281 leader_election.cc:290] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.486433 16252 raft_consensus.cc:385] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.485618 16283 raft_consensus.cc:2804] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.487142 16252 raft_consensus.cc:740] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.485631 16254 leader_election.cc:290] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.487522 16283 raft_consensus.cc:493] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.487934 16283 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.488188 16252 consensus_queue.cc:260] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.489781 16250 ts_tablet_manager.cc:1434] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:09.490139 16252 ts_tablet_manager.cc:1434] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:09.490715 16250 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361: Bootstrap starting.
I20260709 13:07:09.491109 16252 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780: Bootstrap starting.
I20260709 13:07:09.490348 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.491999 16210 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 0.
I20260709 13:07:09.496754 16252 tablet_bootstrap.cc:654] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.496842 16257 raft_consensus.cc:493] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.497677 16257 raft_consensus.cc:515] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.490816 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.500391 16209 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.502619 16257 leader_election.cc:290] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:09.508445 16209 raft_consensus.cc:2468] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.514168 16027 leader_election.cc:304] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.514340 16277 raft_consensus.cc:2749] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.515175 16254 raft_consensus.cc:2804] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.515575 16254 raft_consensus.cc:697] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.516230 16254 consensus_queue.cc:237] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.482545 16251 raft_consensus.cc:385] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.517693 16251 raft_consensus.cc:740] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.518494 16251 consensus_queue.cc:260] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.520501 16251 ts_tablet_manager.cc:1434] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:07:09.508782 16250 tablet_bootstrap.cc:654] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.512246 16283 raft_consensus.cc:515] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.522089 15958 catalog_manager.cc:5697] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.523370 16257 raft_consensus.cc:493] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.523986 16257 raft_consensus.cc:515] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.524422 15958 catalog_manager.cc:5697] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.525568 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:09.525915 16257 leader_election.cc:290] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:09.526242 16135 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.533923 16250 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361: No bootstrap required, opened a new log
I20260709 13:07:09.534456 16250 ts_tablet_manager.cc:1403] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:07:09.536139 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "18f9b347f31942f58fd4e20983181c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.536902 16209 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.537125 16250 raft_consensus.cc:359] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.537936 16250 raft_consensus.cc:385] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.538232 16250 raft_consensus.cc:740] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.538888 16250 consensus_queue.cc:260] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.541124 16250 ts_tablet_manager.cc:1434] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:09.550354 16252 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780: No bootstrap required, opened a new log
I20260709 13:07:09.550243 16209 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.550885 16252 ts_tablet_manager.cc:1403] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780: Time spent bootstrapping tablet: real 0.060s	user 0.031s	sys 0.020s
I20260709 13:07:09.550743 15956 catalog_manager.cc:5697] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.551460 16027 leader_election.cc:304] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:09.553448 16283 leader_election.cc:290] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [CANDIDATE]: Term 1 election: Requested vote from peers fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.553603 16252 raft_consensus.cc:359] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.553984 16283 raft_consensus.cc:2804] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.554229 16252 raft_consensus.cc:385] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.554505 16283 raft_consensus.cc:697] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Becoming Leader. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Running, Role: LEADER
I20260709 13:07:09.554641 16252 raft_consensus.cc:740] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.555348 16252 consensus_queue.cc:260] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.557653 16252 ts_tablet_manager.cc:1434] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:09.558525 16259 raft_consensus.cc:493] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.558724 16135 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f9b347f31942f58fd4e20983181c5b in term 1.
I20260709 13:07:09.559103 16259 raft_consensus.cc:515] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.559680 16283 consensus_queue.cc:237] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.561041 16259 leader_election.cc:290] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.561810 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b" is_pre_election: true
I20260709 13:07:09.562430 16061 raft_consensus.cc:2468] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 0.
I20260709 13:07:09.564358 16100 leader_election.cc:304] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:09.564782 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b" is_pre_election: true
I20260709 13:07:09.565441 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.566126 16209 raft_consensus.cc:2468] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 0.
I20260709 13:07:09.567562 16259 raft_consensus.cc:2804] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.567961 16259 raft_consensus.cc:493] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.568284 16259 raft_consensus.cc:3060] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.573844 16259 raft_consensus.cc:515] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.574743 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b" is_pre_election: true
I20260709 13:07:09.575361 16061 raft_consensus.cc:2468] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 0.
I20260709 13:07:09.576691 16174 leader_election.cc:304] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:09.577469 16257 raft_consensus.cc:2804] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.577803 16257 raft_consensus.cc:493] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.578120 16257 raft_consensus.cc:3060] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.582355 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.582862 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.583281 16135 raft_consensus.cc:2393] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a38bc6f8b3422ca8e1642264076361 in current term 1: Already voted for candidate 18f9b347f31942f58fd4e20983181c5b in this term.
I20260709 13:07:09.583655 16136 raft_consensus.cc:2393] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a38bc6f8b3422ca8e1642264076361 in current term 1: Already voted for candidate fc91c555675945c89d3a9c2005e28780 in this term.
I20260709 13:07:09.584637 16174 leader_election.cc:304] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361; no voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.586063 16312 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.586614 16061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:09.587177 16061 raft_consensus.cc:3060] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.584851 16257 raft_consensus.cc:515] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.589800 16257 leader_election.cc:290] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:09.591508 16060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:09.592003 16259 leader_election.cc:290] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.592095 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:09.592867 16136 raft_consensus.cc:2393] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a38bc6f8b3422ca8e1642264076361 in current term 1: Already voted for candidate fc91c555675945c89d3a9c2005e28780 in this term.
I20260709 13:07:09.593492 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:09.594224 16209 raft_consensus.cc:2393] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc91c555675945c89d3a9c2005e28780 in current term 1: Already voted for candidate d2a38bc6f8b3422ca8e1642264076361 in this term.
I20260709 13:07:09.590453 15958 catalog_manager.cc:5697] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f9b347f31942f58fd4e20983181c5b (127.6.215.65). New cstate: current_term: 1 leader_uuid: "18f9b347f31942f58fd4e20983181c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.592684 16312 raft_consensus.cc:2749] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.596130 16061 raft_consensus.cc:2468] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:09.594213 16174 leader_election.cc:304] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361; no voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.597075 16312 raft_consensus.cc:2749] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.597437 16100 leader_election.cc:304] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.598099 16259 raft_consensus.cc:2804] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:09.598542 16259 raft_consensus.cc:697] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:09.599273 16259 consensus_queue.cc:237] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.606743 15958 catalog_manager.cc:5697] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.623721  7005 ts_manager.cc:295] Set tserver state for 18f9b347f31942f58fd4e20983181c5b to MAINTENANCE_MODE
I20260709 13:07:09.624331  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
I20260709 13:07:09.643030  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:09.643833  7005 tablet_replica.cc:333] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.644688  7005 raft_consensus.cc:2243] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.645334  7005 pending_rounds.cc:70] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.645592  7005 pending_rounds.cc:77] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635551306694656 op_type: NO_OP noop_request { }
I20260709 13:07:09.645959  7005 raft_consensus.cc:2889] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.646191  7005 raft_consensus.cc:2272] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.648295  7005 tablet_replica.cc:333] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.648768  7005 raft_consensus.cc:2243] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.649252  7005 pending_rounds.cc:70] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.649501  7005 pending_rounds.cc:77] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635551485931520 op_type: NO_OP noop_request { }
I20260709 13:07:09.649709  7005 raft_consensus.cc:2889] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.649912  7005 raft_consensus.cc:2272] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.652006  7005 tablet_replica.cc:333] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.652484  7005 raft_consensus.cc:2243] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.652997  7005 pending_rounds.cc:70] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.653139  7005 pending_rounds.cc:77] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635550450741248 op_type: NO_OP noop_request { }
I20260709 13:07:09.653390  7005 raft_consensus.cc:2889] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.653617  7005 raft_consensus.cc:2272] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.655822  7005 tablet_replica.cc:333] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.656368  7005 raft_consensus.cc:2243] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.656868  7005 pending_rounds.cc:70] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.657012  7005 pending_rounds.cc:77] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635550437650432 op_type: NO_OP noop_request { }
I20260709 13:07:09.657204  7005 raft_consensus.cc:2889] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.657459  7005 raft_consensus.cc:2272] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.659214  7005 tablet_replica.cc:333] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.659694  7005 raft_consensus.cc:2243] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.660182  7005 pending_rounds.cc:70] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.660332  7005 pending_rounds.cc:77] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635550897307648 op_type: NO_OP noop_request { }
I20260709 13:07:09.660523  7005 raft_consensus.cc:2889] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.660741  7005 raft_consensus.cc:2272] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.662719  7005 tablet_replica.cc:333] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.663162  7005 raft_consensus.cc:2243] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:09.663462  7005 raft_consensus.cc:2272] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.665132  7005 tablet_replica.cc:333] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.665629  7005 raft_consensus.cc:2243] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:09.665925  7005 raft_consensus.cc:2272] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.667520  7005 tablet_replica.cc:333] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.667937  7005 raft_consensus.cc:2243] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:09.668224  7005 raft_consensus.cc:2272] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.669831  7005 tablet_replica.cc:333] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.670253  7005 raft_consensus.cc:2243] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.670732  7005 pending_rounds.cc:70] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.670884  7005 pending_rounds.cc:77] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635550261342208 op_type: NO_OP noop_request { }
I20260709 13:07:09.671085  7005 raft_consensus.cc:2889] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.671303  7005 raft_consensus.cc:2272] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.673134  7005 tablet_replica.cc:333] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: stopping tablet replica
I20260709 13:07:09.673581  7005 raft_consensus.cc:2243] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:09.674047  7005 pending_rounds.cc:70] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Trying to abort 1 pending ops.
I20260709 13:07:09.674187  7005 pending_rounds.cc:77] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635550853369856 op_type: NO_OP noop_request { }
I20260709 13:07:09.674394  7005 raft_consensus.cc:2889] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:09.674592  7005 raft_consensus.cc:2272] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.693894  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
I20260709 13:07:09.718858 16259 raft_consensus.cc:493] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.719362 16259 raft_consensus.cc:515] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.720994 16259 leader_election.cc:290] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.722067 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.722865 16209 raft_consensus.cc:2393] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc91c555675945c89d3a9c2005e28780 in current term 1: Already voted for candidate 18f9b347f31942f58fd4e20983181c5b in this term.
W20260709 13:07:09.724941 16100 leader_election.cc:336] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:09.725248 16100 leader_election.cc:304] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.725826 16259 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.730610 16259 raft_consensus.cc:2749] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.755553 16312 raft_consensus.cc:493] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.756026 16312 raft_consensus.cc:515] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.757750 16312 leader_election.cc:290] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:09.759249 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:09.760043 16136 raft_consensus.cc:2393] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a38bc6f8b3422ca8e1642264076361 in current term 1: Already voted for candidate 18f9b347f31942f58fd4e20983181c5b in this term.
W20260709 13:07:09.762106 16174 leader_election.cc:336] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:09.762518 16174 leader_election.cc:304] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361; no voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780
I20260709 13:07:09.763096 16312 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.767616 16312 raft_consensus.cc:2749] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.804095 16259 consensus_queue.cc:1048] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:09.805840 16259 consensus_queue.cc:1048] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:09.819597 16100 consensus_peers.cc:597] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:09.820068 16100 consensus_peers.cc:597] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:09.827893 16286 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.828397 16286 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:09.830574 16286 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.834916 16210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.835667 16210 raft_consensus.cc:2393] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc91c555675945c89d3a9c2005e28780 in current term 1: Already voted for candidate 18f9b347f31942f58fd4e20983181c5b in this term.
W20260709 13:07:09.835803 16100 leader_election.cc:336] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:09.840018 16102 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.840826 16259 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.846900 16259 raft_consensus.cc:2749] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.852757 16259 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.853152 16259 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:09.855352 16259 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:09.856302 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:09.856972 16209 raft_consensus.cc:2393] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc91c555675945c89d3a9c2005e28780 in current term 1: Already voted for candidate 18f9b347f31942f58fd4e20983181c5b in this term.
W20260709 13:07:09.859542 16100 leader_election.cc:336] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:09.859930 16100 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:09.860641 16259 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.865377 16259 raft_consensus.cc:2749] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:09.995967 16259 consensus_queue.cc:1048] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:10.009475 16100 consensus_peers.cc:597] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:10.227843 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:10.808538 16259 raft_consensus.cc:493] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.809206 16259 raft_consensus.cc:515] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:10.811204 16259 leader_election.cc:290] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:10.812271 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:10.812896 16209 raft_consensus.cc:2468] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:10.814030 16102 leader_election.cc:304] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:10.814708 16259 raft_consensus.cc:2804] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:10.814821 16100 leader_election.cc:336] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:10.815017 16259 raft_consensus.cc:493] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.815368 16259 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.820633 16259 raft_consensus.cc:515] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:10.822178 16259 leader_election.cc:290] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:10.823184 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:10.823696 16209 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:10.825434 16100 leader_election.cc:336] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:10.828706 16323 raft_consensus.cc:493] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.828925 16209 raft_consensus.cc:2468] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 2.
I20260709 13:07:10.829151 16323 raft_consensus.cc:515] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:10.830013 16102 leader_election.cc:304] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:10.830757 16259 raft_consensus.cc:2804] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:10.831135 16323 leader_election.cc:290] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:10.831769 16259 raft_consensus.cc:697] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:10.832749 16259 consensus_queue.cc:237] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:10.833906 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:10.834479 16136 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 1.
I20260709 13:07:10.835949 16174 leader_election.cc:304] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:10.836714 16323 raft_consensus.cc:2804] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:10.837100 16323 raft_consensus.cc:493] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.837435 16323 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:10.838680 16174 leader_election.cc:336] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:10.841184 15956 catalog_manager.cc:5697] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.843479 16323 raft_consensus.cc:515] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:10.845614 16323 leader_election.cc:290] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:10.848455 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:10.849211 16136 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:10.850986 16174 leader_election.cc:336] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:10.856030 16136 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:10.857012 16174 leader_election.cc:304] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:10.857841 16323 raft_consensus.cc:2804] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:10.858880 16323 raft_consensus.cc:697] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:10.859603 16323 consensus_queue.cc:237] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:10.868657 15956 catalog_manager.cc:5697] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:11.076946 16323 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.077438 16323 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.079109 16323 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:11.080488 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:11.081054 16136 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 1.
I20260709 13:07:11.082293 16174 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:11.082967 16323 raft_consensus.cc:2804] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:11.082978 16174 leader_election.cc:336] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.083320 16323 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.083619 16323 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.088481 16323 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.089996 16323 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:11.091490 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:11.092008 16136 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:11.093278 16174 leader_election.cc:336] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.097005 16136 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:11.097998 16174 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:11.098632 16323 raft_consensus.cc:2804] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.098973 16323 raft_consensus.cc:697] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:11.099747 16323 consensus_queue.cc:237] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.106737 15956 catalog_manager.cc:5697] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:11.228744 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:11.240206 16209 raft_consensus.cc:1275] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:11.241436 16324 consensus_queue.cc:1048] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:11.247435 16100 consensus_peers.cc:597] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.312700 16323 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.313213 16323 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:11.314811 16323 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:11.316377 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:11.317013 16136 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 1.
I20260709 13:07:11.317939 16174 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:11.318670 16323 raft_consensus.cc:2804] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:11.318668 16174 leader_election.cc:336] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.319058 16323 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.319366 16323 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.323948 16323 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:11.325685 16323 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:11.327764 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:11.328366 16136 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:11.329826 16174 leader_election.cc:336] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.333539 16136 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:11.334457 16174 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:11.335042 16323 raft_consensus.cc:2804] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.335431 16323 raft_consensus.cc:697] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:11.336215 16323 consensus_queue.cc:237] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:11.337779 16136 raft_consensus.cc:1275] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:11.339217 16332 consensus_queue.cc:1048] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.344710 15958 catalog_manager.cc:5697] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:11.353132 16174 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111) [suppressed 133 similar messages]
W20260709 13:07:11.357332 16174 consensus_peers.cc:597] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.519104 16324 raft_consensus.cc:493] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.519632 16324 raft_consensus.cc:515] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.521422 16324 leader_election.cc:290] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:11.522500 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:11.523090 16209 raft_consensus.cc:2468] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:11.524251 16102 leader_election.cc:304] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:11.525012 16324 raft_consensus.cc:2804] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:11.525038 16100 leader_election.cc:336] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.525564 16324 raft_consensus.cc:493] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.525949 16324 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.530792 16324 raft_consensus.cc:515] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.532298 16324 leader_election.cc:290] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:11.533319 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:11.533927 16209 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:11.535454 16100 leader_election.cc:336] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.539925 16209 raft_consensus.cc:2468] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 2.
I20260709 13:07:11.540824 16102 leader_election.cc:304] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:11.541491 16324 raft_consensus.cc:2804] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.541868 16324 raft_consensus.cc:697] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:11.542624 16324 consensus_queue.cc:237] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.549055 15956 catalog_manager.cc:5697] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:11.620754 16174 consensus_peers.cc:597] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.652917 16324 raft_consensus.cc:493] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.653443 16324 raft_consensus.cc:515] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.655753 16324 leader_election.cc:290] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:11.656672 16136 raft_consensus.cc:1275] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:11.656824 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361" is_pre_election: true
I20260709 13:07:11.657433 16209 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 1.
I20260709 13:07:11.658068 16340 consensus_queue.cc:1048] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.658497 16102 leader_election.cc:304] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:11.659209 16324 raft_consensus.cc:2804] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:11.659514 16324 raft_consensus.cc:493] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.659834 16324 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.660248 16340 raft_consensus.cc:493] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.660601 16100 leader_election.cc:336] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.660705 16340 raft_consensus.cc:515] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.663129 16340 leader_election.cc:290] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:11.666416 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780" is_pre_election: true
I20260709 13:07:11.667196 16135 raft_consensus.cc:2468] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 1.
I20260709 13:07:11.666977 16324 raft_consensus.cc:515] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.669039 16324 leader_election.cc:290] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
W20260709 13:07:11.669070 16174 leader_election.cc:336] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.670770 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:11.671325 16209 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.672542 16174 leader_election.cc:304] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:11.673214 16340 raft_consensus.cc:2804] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:11.673580 16340 raft_consensus.cc:493] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.673898 16340 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:11.678419 16100 leader_election.cc:336] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.678463 16209 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 2.
I20260709 13:07:11.679729 16102 leader_election.cc:304] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:11.680781 16324 raft_consensus.cc:2804] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.681245 16324 raft_consensus.cc:697] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:11.682037 16324 consensus_queue.cc:237] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.682204 16340 raft_consensus.cc:515] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.685020 16340 leader_election.cc:290] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:11.687094 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:11.687762 16135 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:11.689026 16174 leader_election.cc:336] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111)
I20260709 13:07:11.691237 15958 catalog_manager.cc:5697] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.694528 16135 raft_consensus.cc:2468] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:11.695619 16174 leader_election.cc:304] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 18f9b347f31942f58fd4e20983181c5b
I20260709 13:07:11.696363 16340 raft_consensus.cc:2804] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.696735 16340 raft_consensus.cc:697] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:11.698019 16340 consensus_queue.cc:237] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:11.705665 15958 catalog_manager.cc:5697] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from 18f9b347f31942f58fd4e20983181c5b (127.6.215.65) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:11.739873 16174 consensus_peers.cc:597] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.859004 16135 raft_consensus.cc:1275] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:11.860152 16340 consensus_queue.cc:1048] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:12.075975 16100 consensus_peers.cc:597] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:12.081614 16209 raft_consensus.cc:1275] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:12.082818 16324 consensus_queue.cc:1048] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:12.095278 16100 consensus_peers.cc:597] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:12.194957 16100 consensus_peers.cc:597] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:12.215418 16209 raft_consensus.cc:1275] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:12.217228 16348 consensus_queue.cc:1048] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:12.229640 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:12.275378 16100 consensus_peers.cc:597] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:12.308212 16135 raft_consensus.cc:1275] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:12.309796 16340 consensus_queue.cc:1048] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:12.321800 16174 consensus_peers.cc:597] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:12.519896 16100 consensus_peers.cc:597] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:13.230511 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:13.850931 16100 consensus_peers.cc:597] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:13.896636 16174 consensus_peers.cc:597] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:13.952031 16174 consensus_peers.cc:597] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:14.205574 16174 consensus_peers.cc:597] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:14.231388 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:14.425668 16174 consensus_peers.cc:597] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:14.455123 16100 consensus_peers.cc:597] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:14.475414 16100 consensus_peers.cc:597] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:14.515970 16100 consensus_peers.cc:597] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:14.600225 16100 consensus_peers.cc:597] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:14.710765  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:14.716439 16353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:14.716619 16354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:14.717787 16356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:14.719475  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:14.721549  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:14.721753  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:14.721925  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602434721908 us; error 0 us; skew 500 ppm
I20260709 13:07:14.722425  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:14.724717  7005 webserver.cc:533] Webserver started at http://127.6.215.65:32797/ using document root <none> and password file <none>
I20260709 13:07:14.725148  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:14.725416  7005 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:07:14.728879  7005 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:14.732362 16361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:14.733065  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:07:14.733431  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "18f9b347f31942f58fd4e20983181c5b"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-r31z"
I20260709 13:07:14.733709  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:14.759910  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:14.760861  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:14.762490  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:14.766606 16368 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:07:14.812467  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:07:14.812778  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.047s	user 0.002s	sys 0.000s
I20260709 13:07:14.812994  7005 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:07:14.817162 16368 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.829807 16368 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:14.830526 16368 tablet_bootstrap.cc:492] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.831015 16368 ts_tablet_manager.cc:1403] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 13:07:14.832808 16368 raft_consensus.cc:359] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.833462 16368 raft_consensus.cc:740] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.834055 16368 consensus_queue.cc:260] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.836153 16368 ts_tablet_manager.cc:1434] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:07:14.836860 16368 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.847712 16368 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:14.848395 16368 tablet_bootstrap.cc:492] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.848716  7005 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:07:14.848879 16368 ts_tablet_manager.cc:1403] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:07:14.849049  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.036s	user 0.033s	sys 0.000s
I20260709 13:07:14.851311 16368 raft_consensus.cc:359] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:14.852185 16368 raft_consensus.cc:740] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.852986 16368 consensus_queue.cc:260] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:14.854669 16368 ts_tablet_manager.cc:1434] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:14.855360 16368 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.866516 16368 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:14.867300 16368 tablet_bootstrap.cc:492] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.867920 16368 ts_tablet_manager.cc:1403] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:07:14.869832 16368 raft_consensus.cc:359] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.870460 16368 raft_consensus.cc:740] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.871011 16368 consensus_queue.cc:260] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.872495 16368 ts_tablet_manager.cc:1434] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:14.873070 16368 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.881278 16368 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:14.882025 16368 tablet_bootstrap.cc:492] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.882511 16368 ts_tablet_manager.cc:1403] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:14.884455 16368 raft_consensus.cc:359] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.885051 16368 raft_consensus.cc:740] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.885630 16368 consensus_queue.cc:260] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.887537 16368 ts_tablet_manager.cc:1434] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:07:14.888307 16368 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.902076  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:40143
I20260709 13:07:14.902150 16430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:40143 every 8 connection(s)
I20260709 13:07:14.902328 16368 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:14.903268 16368 tablet_bootstrap.cc:492] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.903839 16368 ts_tablet_manager.cc:1403] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:07:14.906246 16368 raft_consensus.cc:359] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.907025  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:14.907099 16368 raft_consensus.cc:740] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.909405 16368 consensus_queue.cc:260] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.911473 16368 ts_tablet_manager.cc:1434] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:14.912249 16368 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.932440 16368 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:14.933290 16368 tablet_bootstrap.cc:492] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.934266 16368 ts_tablet_manager.cc:1403] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:07:14.937480 16368 raft_consensus.cc:359] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.937952 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "750d64cebae14cad96278a638cad1f66"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:14.939260 16368 raft_consensus.cc:740] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.939276 16135 raft_consensus.cc:606] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:14.940171 16368 consensus_queue.cc:260] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.942543 16431 heartbeater.cc:344] Connected to a master server at 127.6.215.126:45777
I20260709 13:07:14.942605 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:14.943116 16431 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:14.943411 16135 raft_consensus.cc:606] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:14.944164 16368 ts_tablet_manager.cc:1434] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:07:14.944326 16431 heartbeater.cc:507] Master 127.6.215.126:45777 requested a full tablet report, sending...
I20260709 13:07:14.944802  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:14.944952 16368 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.945425  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:14.946113  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:14.950433 15958 ts_manager.cc:194] Re-registered known tserver with Master: 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143)
I20260709 13:07:14.954591 16368 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:14.955170 16368 tablet_bootstrap.cc:492] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.955677 16368 ts_tablet_manager.cc:1403] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:07:14.957285 16368 raft_consensus.cc:359] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.957764 16368 raft_consensus.cc:740] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.958261 16368 consensus_queue.cc:260] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.959563 16368 ts_tablet_manager.cc:1434] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:14.959651 15958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35080
I20260709 13:07:14.960136 16368 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.962190 16431 heartbeater.cc:499] Master 127.6.215.126:45777 was elected leader, sending a full tablet report...
I20260709 13:07:14.967295 16405 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:14.969872 16368 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:14.970695 16368 tablet_bootstrap.cc:492] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.971331 16368 ts_tablet_manager.cc:1403] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:07:14.973629 16368 raft_consensus.cc:359] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.974571 16405 pending_rounds.cc:85] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:14.974748 16368 raft_consensus.cc:740] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.974954 16405 pending_rounds.cc:107] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:14.975740 16405 raft_consensus.cc:2889] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.975960 16368 consensus_queue.cc:260] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.978195 16368 ts_tablet_manager.cc:1434] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:07:14.979050 16368 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:14.994025 16368 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:14.994724 16368 tablet_bootstrap.cc:492] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:14.995290 16368 ts_tablet_manager.cc:1403] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:07:14.996799 16368 raft_consensus.cc:359] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.997362 16368 raft_consensus.cc:740] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.997926 16368 consensus_queue.cc:260] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:14.999311 16368 ts_tablet_manager.cc:1434] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:14.999878 16368 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap starting.
I20260709 13:07:15.009708 16368 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:15.010483 16368 tablet_bootstrap.cc:492] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Bootstrap complete.
I20260709 13:07:15.010998 16368 ts_tablet_manager.cc:1403] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:07:15.012805 16368 raft_consensus.cc:359] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.013339 16368 raft_consensus.cc:740] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f9b347f31942f58fd4e20983181c5b, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.013865 16368 consensus_queue.cc:260] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.015180 16368 ts_tablet_manager.cc:1434] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:07:15.017047 16405 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.022607 16405 pending_rounds.cc:85] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:15.022815 16405 pending_rounds.cc:107] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:15.023001 16405 raft_consensus.cc:2889] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.060926 16405 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.065858 16405 pending_rounds.cc:85] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:15.066061 16405 pending_rounds.cc:107] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:15.066272 16405 raft_consensus.cc:2889] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.214841 16405 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.220999 16405 pending_rounds.cc:85] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:15.221210 16405 pending_rounds.cc:107] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:15.221449 16405 raft_consensus.cc:2889] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:15.232295 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:15.333240 16450 raft_consensus.cc:993] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:15.333891 16450 raft_consensus.cc:1081] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:15.335117 16210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "750d64cebae14cad96278a638cad1f66"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:15.335582 16210 raft_consensus.cc:493] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.335868 16210 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.339628 16451 raft_consensus.cc:993] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:15.340098 16450 raft_consensus.cc:1081] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:15.341054 16210 raft_consensus.cc:515] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.341692 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:15.342166 16209 raft_consensus.cc:493] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.342447 16209 raft_consensus.cc:3060] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.342877 16210 leader_election.cc:290] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:15.343600 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:15.344180 16405 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.344180 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:15.344910 16135 raft_consensus.cc:3055] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.345202 16135 raft_consensus.cc:740] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:15.345993 16135 consensus_queue.cc:260] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.347180 16135 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.348604 16209 raft_consensus.cc:515] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.350419 16209 leader_election.cc:290] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:15.350950 16405 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:15.351377 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:15.351858 16136 raft_consensus.cc:3055] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.352061 16136 raft_consensus.cc:740] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:15.352766 16136 consensus_queue.cc:260] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.353147 16135 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:15.354038 16136 raft_consensus.cc:3060] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.354403 16174 leader_election.cc:304] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:15.354537 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22e76e4ae414b0fbb5732e50fd49791" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:15.355159 16340 raft_consensus.cc:2804] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.356038 16340 raft_consensus.cc:697] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:15.356715 16340 consensus_queue.cc:237] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.359213 16405 raft_consensus.cc:3060] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.359526 16136 raft_consensus.cc:2468] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:15.361585 16174 leader_election.cc:304] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:15.362283 16340 raft_consensus.cc:2804] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.362736 16340 raft_consensus.cc:697] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:15.363500 16340 consensus_queue.cc:237] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:15.364769 16405 raft_consensus.cc:2468] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:15.364988 15958 catalog_manager.cc:5697] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.379099 15958 catalog_manager.cc:5697] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.487511 16405 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.493083 16405 pending_rounds.cc:85] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:15.493366 16405 pending_rounds.cc:107] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:15.493613 16405 raft_consensus.cc:2889] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.537526 16405 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.550451 16404 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.553406 16405 pending_rounds.cc:85] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:15.553889 16405 pending_rounds.cc:107] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:15.554316 16405 raft_consensus.cc:2889] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.563922 16404 pending_rounds.cc:85] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Aborting all ops after (but not including) 0
I20260709 13:07:15.564604 16404 pending_rounds.cc:107] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:15.565021 16404 raft_consensus.cc:2889] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.761999 16136 raft_consensus.cc:1275] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.763280 16459 consensus_queue.cc:1048] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.773891 16405 raft_consensus.cc:1275] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.775732 16459 consensus_queue.cc:1048] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.829638 16405 raft_consensus.cc:1275] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.830811 16459 consensus_queue.cc:1048] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.843727 16136 raft_consensus.cc:1275] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.845661 16340 consensus_queue.cc:1048] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.955996  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:15.974721 16209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
mode: GRACEFUL
new_leader_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:51988
I20260709 13:07:15.975323 16209 raft_consensus.cc:606] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Received request to transfer leadership to TS fc91c555675945c89d3a9c2005e28780
I20260709 13:07:15.978019 16209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "750d64cebae14cad96278a638cad1f66"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
mode: GRACEFUL
new_leader_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:51988
I20260709 13:07:15.978536 16209 raft_consensus.cc:606] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Received request to transfer leadership to TS fc91c555675945c89d3a9c2005e28780
I20260709 13:07:15.980834 16136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:15.981293 16136 raft_consensus.cc:606] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:15.982594  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:15.983054  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:15.983693  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:16.144598 16459 raft_consensus.cc:993] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: : Instructing follower fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:16.145118 16468 raft_consensus.cc:1081] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Signalling peer fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:16.146657 16135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:35210
I20260709 13:07:16.147221 16135 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.147500 16135 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.154022 16135 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.155705 16135 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:16.156585 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:16.156752 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:16.157222 16405 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.157280 16209 raft_consensus.cc:3055] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.157698 16209 raft_consensus.cc:740] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:16.158411 16209 consensus_queue.cc:260] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.159368 16209 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.162492 16405 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:16.163606 16100 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:16.164450 16450 raft_consensus.cc:2804] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.164896 16450 raft_consensus.cc:697] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:16.165163 16209 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:16.165894 16450 consensus_queue.cc:237] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.173079 15956 catalog_manager.cc:5697] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 2 to 3, leader changed from d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.233283 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:16.375253 16468 raft_consensus.cc:993] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: : Instructing follower fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:16.375722 16452 raft_consensus.cc:1081] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Signalling peer fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:16.377043 16135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "750d64cebae14cad96278a638cad1f66"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:35210
I20260709 13:07:16.377521 16135 raft_consensus.cc:493] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.377789 16135 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.383123 16135 raft_consensus.cc:515] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.384779 16135 leader_election.cc:290] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:16.385416 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:16.385749 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750d64cebae14cad96278a638cad1f66" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:16.385985 16405 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.386220 16209 raft_consensus.cc:3055] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.386487 16209 raft_consensus.cc:740] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:16.387159 16209 consensus_queue.cc:260] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.387964 16209 raft_consensus.cc:3060] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.390743 16405 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:16.391750 16100 leader_election.cc:304] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:16.392216 16209 raft_consensus.cc:2468] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:16.392325 16450 raft_consensus.cc:2804] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.392792 16450 raft_consensus.cc:697] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:16.393685 16450 consensus_queue.cc:237] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.399159 15956 catalog_manager.cc:5697] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 2 to 3, leader changed from d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.510578 16352 raft_consensus.cc:993] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:16.511018 16450 raft_consensus.cc:1081] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:16.512388 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:16.512815 16209 raft_consensus.cc:493] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.513065 16209 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.519090 16209 raft_consensus.cc:515] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.520573 16209 leader_election.cc:290] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:16.521504 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:16.521930 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:16.522676 16405 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.522831 16135 raft_consensus.cc:3055] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.523334 16135 raft_consensus.cc:740] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:16.524526 16135 consensus_queue.cc:260] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.526163 16135 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.531044 16405 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 3.
I20260709 13:07:16.532668 16174 leader_election.cc:304] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:16.533334 16452 raft_consensus.cc:2804] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.533390 16135 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 3.
I20260709 13:07:16.534129 16452 raft_consensus.cc:697] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:16.535279 16452 consensus_queue.cc:237] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:16.542092 15956 catalog_manager.cc:5697] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 2 to 3, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.632062 16209 raft_consensus.cc:1275] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:16.633176 16450 consensus_queue.cc:1048] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.644114 16405 raft_consensus.cc:1275] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:16.645376 16352 consensus_queue.cc:1048] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.793025 16405 raft_consensus.cc:1275] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.794261 16352 consensus_queue.cc:1048] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:16.802917 16209 raft_consensus.cc:1275] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.805081 16484 consensus_queue.cc:1048] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:16.936373 16405 raft_consensus.cc:1275] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:16.937412 16452 consensus_queue.cc:1048] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.945492 16135 raft_consensus.cc:1275] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:16.946952 16487 consensus_queue.cc:1048] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.989761  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:16.996975 16209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
mode: GRACEFUL
new_leader_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:51988
I20260709 13:07:16.997483 16209 raft_consensus.cc:606] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Received request to transfer leadership to TS fc91c555675945c89d3a9c2005e28780
I20260709 13:07:16.999966 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:17.000409 16135 raft_consensus.cc:606] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:17.003265 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:17.003701 16135 raft_consensus.cc:606] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:17.005105  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:17.006096  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:17.006639  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:17.035641 16484 raft_consensus.cc:993] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:17.036149 16450 raft_consensus.cc:1081] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:17.037776 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:17.038187 16209 raft_consensus.cc:493] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.038472 16209 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.043049 16209 raft_consensus.cc:515] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:17.044339 16209 leader_election.cc:290] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:17.045109 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:17.045396 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d23f8a2034b446a90403292115ff97d" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:17.045763 16405 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.045944 16135 raft_consensus.cc:3055] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.046344 16135 raft_consensus.cc:740] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:17.047205 16135 consensus_queue.cc:260] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:17.048496 16135 raft_consensus.cc:3060] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.052448 16405 raft_consensus.cc:2468] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 3.
I20260709 13:07:17.053521 16174 leader_election.cc:304] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:17.054272 16487 raft_consensus.cc:2804] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.054713 16487 raft_consensus.cc:697] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:17.055133 16135 raft_consensus.cc:2468] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 3.
I20260709 13:07:17.055483 16487 consensus_queue.cc:237] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:17.062858 15958 catalog_manager.cc:5697] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 2 to 3, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:17.199419 16484 raft_consensus.cc:993] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:17.199862 16450 raft_consensus.cc:1081] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:17.201265 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:17.201741 16209 raft_consensus.cc:493] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.201977 16209 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.206552 16209 raft_consensus.cc:515] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:17.207913 16209 leader_election.cc:290] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 4 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:17.208698 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:17.209009 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a680c3bab3e4588b4b95e2c6d0b691f" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:17.209259 16405 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.209599 16135 raft_consensus.cc:3055] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:17.209867 16135 raft_consensus.cc:740] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:17.210611 16135 consensus_queue.cc:260] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:17.211550 16135 raft_consensus.cc:3060] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.213817 16405 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 4.
I20260709 13:07:17.214695 16174 leader_election.cc:304] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:17.215406 16487 raft_consensus.cc:2804] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:17.215802 16487 raft_consensus.cc:697] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 4 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:17.216195 16135 raft_consensus.cc:2468] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 4.
I20260709 13:07:17.216573 16487 consensus_queue.cc:237] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:17.222409 15958 catalog_manager.cc:5697] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 3 to 4, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:17.234195 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:17.235816 16452 raft_consensus.cc:993] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: : Instructing follower fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:17.236284 16487 raft_consensus.cc:1081] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Signalling peer fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:17.237651 16135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:35210
I20260709 13:07:17.238063 16135 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.238297 16135 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.244138 16135 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:17.245558 16135 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:17.246220 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:17.246572 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:17.246945 16405 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.247176 16209 raft_consensus.cc:3055] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.247565 16209 raft_consensus.cc:740] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:17.248317 16209 consensus_queue.cc:260] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:17.249581 16209 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.253654 16405 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:17.254679 16100 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:17.255285 16450 raft_consensus.cc:2804] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.255556 16209 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:17.255645 16450 raft_consensus.cc:697] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:17.256747 16450 consensus_queue.cc:237] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:17.265003 15958 catalog_manager.cc:5697] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 2 to 3, leader changed from d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:17.469118 16135 raft_consensus.cc:1275] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.470286 16487 consensus_queue.cc:1048] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.478483 16405 raft_consensus.cc:1275] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.480008 16487 consensus_queue.cc:1048] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.771036 16405 raft_consensus.cc:1275] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:17.772130 16487 consensus_queue.cc:1048] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.774657 16135 raft_consensus.cc:1275] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:17.775743 16452 consensus_queue.cc:1048] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.789969 16405 raft_consensus.cc:1275] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.792266 16450 consensus_queue.cc:1048] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.802698 16209 raft_consensus.cc:1275] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.804842 16450 consensus_queue.cc:1048] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:18.013279  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.020252 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:18.020715 16135 raft_consensus.cc:606] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:18.022933 16209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
mode: GRACEFUL
new_leader_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:51988
I20260709 13:07:18.023367 16209 raft_consensus.cc:606] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Received request to transfer leadership to TS fc91c555675945c89d3a9c2005e28780
I20260709 13:07:18.025516 16209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
mode: GRACEFUL
new_leader_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:51988
I20260709 13:07:18.025904 16209 raft_consensus.cc:606] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Received request to transfer leadership to TS fc91c555675945c89d3a9c2005e28780
I20260709 13:07:18.026821  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:18.027256  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:18.027848  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.068575 16452 raft_consensus.cc:993] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: : Instructing follower fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:18.069001 16487 raft_consensus.cc:1081] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Signalling peer fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:18.070266 16135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:35210
I20260709 13:07:18.070688 16135 raft_consensus.cc:493] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.070940 16135 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.075610 16135 raft_consensus.cc:515] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.076886 16135 leader_election.cc:290] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:18.077732 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:18.077900 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c93f1544d7480d9c0158168975f639" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:18.078243 16405 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.078399 16209 raft_consensus.cc:3055] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.078716 16209 raft_consensus.cc:740] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:18.079459 16209 consensus_queue.cc:260] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.080332 16209 raft_consensus.cc:3060] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.082996 16405 raft_consensus.cc:2468] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:18.083933 16100 leader_election.cc:304] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:18.084527 16502 raft_consensus.cc:2804] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.084975 16502 raft_consensus.cc:697] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:18.085041 16209 raft_consensus.cc:2468] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:18.085913 16502 consensus_queue.cc:237] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.092507 15956 catalog_manager.cc:5697] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 2 to 3, leader changed from d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:18.235152 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:18.321790 16450 raft_consensus.cc:993] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:18.322331 16502 raft_consensus.cc:1081] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:18.324329 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:18.324790 16209 raft_consensus.cc:493] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.325069 16209 raft_consensus.cc:3060] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.329806 16209 raft_consensus.cc:515] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.331125 16209 leader_election.cc:290] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:18.332088 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:18.332334 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65adb23f5ac145f3b32a1564983cf21a" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:18.332698 16405 raft_consensus.cc:3060] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.332834 16135 raft_consensus.cc:3055] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:18.333470 16135 raft_consensus.cc:740] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:18.334532 16135 consensus_queue.cc:260] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.336009 16135 raft_consensus.cc:3060] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.341068 16405 raft_consensus.cc:2468] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:18.342568 16174 leader_election.cc:304] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:18.342625 16135 raft_consensus.cc:2468] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 2.
I20260709 13:07:18.343401 16487 raft_consensus.cc:2804] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.343818 16487 raft_consensus.cc:697] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:18.344666 16487 consensus_queue.cc:237] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.351240 15956 catalog_manager.cc:5697] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 1 to 2, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.568737 16209 raft_consensus.cc:1275] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:18.569319 16487 raft_consensus.cc:993] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: : Instructing follower fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:18.569934 16452 raft_consensus.cc:1081] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Signalling peer fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:18.570045 16502 consensus_queue.cc:1048] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.571359 16135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:35210
I20260709 13:07:18.571748 16135 raft_consensus.cc:493] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.572028 16135 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.579909 16405 raft_consensus.cc:1275] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:18.581547 16505 consensus_queue.cc:1048] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.585338 16135 raft_consensus.cc:515] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.588181 16135 leader_election.cc:290] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:18.588984 16404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:18.590210 16404 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.596215 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e875ab0f164f41b5782ac64b22fba1" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:18.596863 16209 raft_consensus.cc:3055] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.597105 16209 raft_consensus.cc:740] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:18.597843 16209 consensus_queue.cc:260] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.598740 16209 raft_consensus.cc:3060] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.598636 16404 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:18.600344 16100 leader_election.cc:304] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:18.601118 16502 raft_consensus.cc:2804] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.601603 16502 raft_consensus.cc:697] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:18.602507 16502 consensus_queue.cc:237] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:18.605013 16209 raft_consensus.cc:2468] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 3.
I20260709 13:07:18.609746 15956 catalog_manager.cc:5697] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 2 to 3, leader changed from d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.739420 16405 raft_consensus.cc:1275] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.741052 16452 consensus_queue.cc:1048] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.749426 16135 raft_consensus.cc:1275] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.751030 16487 consensus_queue.cc:1048] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.008503 16405 raft_consensus.cc:1275] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:19.009778 16502 consensus_queue.cc:1048] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.018056 16209 raft_consensus.cc:1275] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:19.019919 16450 consensus_queue.cc:1048] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.033740  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.040433 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:19.040926 16135 raft_consensus.cc:606] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:19.043118 16209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
mode: GRACEFUL
new_leader_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:51988
I20260709 13:07:19.043512 16209 raft_consensus.cc:606] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Received request to transfer leadership to TS fc91c555675945c89d3a9c2005e28780
I20260709 13:07:19.046211 16135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
mode: GRACEFUL
new_leader_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:38068
I20260709 13:07:19.046663 16135 raft_consensus.cc:606] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Received request to transfer leadership to TS d2a38bc6f8b3422ca8e1642264076361
I20260709 13:07:19.047773  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:19.048224  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:19.048758  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.137679 16450 raft_consensus.cc:993] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:19.138283 16505 raft_consensus.cc:1081] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:19.140112 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:19.140664 16209 raft_consensus.cc:493] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.140987 16209 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.145812 16511 raft_consensus.cc:993] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: : Instructing follower fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:19.146346 16511 raft_consensus.cc:1081] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Signalling peer fc91c555675945c89d3a9c2005e28780 to start an election
I20260709 13:07:19.146112 16209 raft_consensus.cc:515] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:19.147846 16135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd"
dest_uuid: "fc91c555675945c89d3a9c2005e28780"
 from {username='slave'} at 127.0.0.1:35210
I20260709 13:07:19.148358 16135 raft_consensus.cc:493] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.147925 16209 leader_election.cc:290] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 3 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
I20260709 13:07:19.148553 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:19.148707 16135 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.148932 16136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4cb251260424b4fa016bdb23ff121f9" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:19.149212 16405 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.149674 16136 raft_consensus.cc:3055] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.149948 16136 raft_consensus.cc:740] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:19.150676 16136 consensus_queue.cc:260] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:19.151700 16136 raft_consensus.cc:3060] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.155608 16405 raft_consensus.cc:2468] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 3.
I20260709 13:07:19.156168 16135 raft_consensus.cc:515] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:19.156726 16174 leader_election.cc:304] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:19.157068 16136 raft_consensus.cc:2468] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 3.
I20260709 13:07:19.157516 16511 raft_consensus.cc:2804] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.157944 16135 leader_election.cc:290] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 4 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67:36993)
I20260709 13:07:19.157992 16511 raft_consensus.cc:697] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:19.158914 16209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
I20260709 13:07:19.159427 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bc568c3ebc4468a027c7d3df5a82cd" candidate_uuid: "fc91c555675945c89d3a9c2005e28780" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:19.159433 16209 raft_consensus.cc:3055] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.159282 16511 consensus_queue.cc:237] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:19.160059 16405 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.160111 16209 raft_consensus.cc:740] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:19.160964 16209 consensus_queue.cc:260] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:19.162002 16209 raft_consensus.cc:3060] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.166292 16209 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 4.
I20260709 13:07:19.166335 16405 raft_consensus.cc:2468] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc91c555675945c89d3a9c2005e28780 in term 4.
I20260709 13:07:19.167680 16102 leader_election.cc:304] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2a38bc6f8b3422ca8e1642264076361, fc91c555675945c89d3a9c2005e28780; no voters: 
I20260709 13:07:19.168524 16523 raft_consensus.cc:2804] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.168897 16523 raft_consensus.cc:697] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 4 LEADER]: Becoming Leader. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:19.169593 16523 consensus_queue.cc:237] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } }
I20260709 13:07:19.169816 15958 catalog_manager.cc:5697] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 2 to 3, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.176748 15956 catalog_manager.cc:5697] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 reported cstate change: term changed from 3 to 4, leader changed from d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67) to fc91c555675945c89d3a9c2005e28780 (127.6.215.66). New cstate: current_term: 4 leader_uuid: "fc91c555675945c89d3a9c2005e28780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.227800 16502 raft_consensus.cc:993] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: : Instructing follower d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:19.228276 16523 raft_consensus.cc:1081] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Signalling peer d2a38bc6f8b3422ca8e1642264076361 to start an election
I20260709 13:07:19.229692 16209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0"
dest_uuid: "d2a38bc6f8b3422ca8e1642264076361"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:07:19.230118 16209 raft_consensus.cc:493] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.230358 16209 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.234622 16209 raft_consensus.cc:515] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:19.235893 16209 leader_election.cc:290] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 4 election: Requested vote from peers 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143), fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355)
W20260709 13:07:19.236050 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:19.236683 16405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "18f9b347f31942f58fd4e20983181c5b"
I20260709 13:07:19.236970 16135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a19020a29345b0aa3bac362b2d2ce0" candidate_uuid: "d2a38bc6f8b3422ca8e1642264076361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fc91c555675945c89d3a9c2005e28780"
I20260709 13:07:19.237112 16405 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.237443 16135 raft_consensus.cc:3055] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.237686 16135 raft_consensus.cc:740] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc91c555675945c89d3a9c2005e28780, State: Running, Role: LEADER
I20260709 13:07:19.238284 16135 consensus_queue.cc:260] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:19.239066 16135 raft_consensus.cc:3060] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.241303 16405 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 4.
I20260709 13:07:19.242199 16174 leader_election.cc:304] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f9b347f31942f58fd4e20983181c5b, d2a38bc6f8b3422ca8e1642264076361; no voters: 
I20260709 13:07:19.242863 16511 raft_consensus.cc:2804] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.243220 16511 raft_consensus.cc:697] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 4 LEADER]: Becoming Leader. State: Replica: d2a38bc6f8b3422ca8e1642264076361, State: Running, Role: LEADER
I20260709 13:07:19.243716 16135 raft_consensus.cc:2468] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a38bc6f8b3422ca8e1642264076361 in term 4.
I20260709 13:07:19.244124 16511 consensus_queue.cc:237] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } }
I20260709 13:07:19.251415 15956 catalog_manager.cc:5697] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 reported cstate change: term changed from 3 to 4, leader changed from fc91c555675945c89d3a9c2005e28780 (127.6.215.66) to d2a38bc6f8b3422ca8e1642264076361 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "d2a38bc6f8b3422ca8e1642264076361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.549055 16405 raft_consensus.cc:1275] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.550189 16523 consensus_queue.cc:1048] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.559046 16209 raft_consensus.cc:1275] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Refusing update from remote peer fc91c555675945c89d3a9c2005e28780: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.560766 16502 consensus_queue.cc:1048] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a38bc6f8b3422ca8e1642264076361" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.733731 16405 raft_consensus.cc:1275] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:19.734752 16511 consensus_queue.cc:1048] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.743768 16135 raft_consensus.cc:1275] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:19.745079 16511 consensus_queue.cc:1048] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.772851 16135 raft_consensus.cc:1275] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.774034 16511 consensus_queue.cc:1048] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc91c555675945c89d3a9c2005e28780" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 33355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.785225 16405 raft_consensus.cc:1275] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Refusing update from remote peer d2a38bc6f8b3422ca8e1642264076361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:19.786581 16487 consensus_queue.cc:1048] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f9b347f31942f58fd4e20983181c5b" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.054955  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:20.082132  7005 tablet_server.cc:179] TabletServer@127.6.215.65:40143 shutting down...
I20260709 13:07:20.103895  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:20.104672  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.105546  7005 raft_consensus.cc:2243] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.106003  7005 raft_consensus.cc:2272] T d22e76e4ae414b0fbb5732e50fd49791 P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.108341  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.109136  7005 raft_consensus.cc:2243] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.109649  7005 raft_consensus.cc:2272] T 750d64cebae14cad96278a638cad1f66 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:20.110489 16100 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 72 similar messages]
I20260709 13:07:20.112187  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.112905  7005 raft_consensus.cc:2243] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:20.113307 16100 consensus_peers.cc:597] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.113328  7005 raft_consensus.cc:2272] T 1d23f8a2034b446a90403292115ff97d P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.115815  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.116290  7005 raft_consensus.cc:2243] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.116663  7005 raft_consensus.cc:2272] T 65adb23f5ac145f3b32a1564983cf21a P 18f9b347f31942f58fd4e20983181c5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.119705  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.120571  7005 raft_consensus.cc:2243] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.121099  7005 raft_consensus.cc:2272] T e1c93f1544d7480d9c0158168975f639 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.123315  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.123871  7005 raft_consensus.cc:2243] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.124295  7005 raft_consensus.cc:2272] T 15a19020a29345b0aa3bac362b2d2ce0 P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.126839  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.127365  7005 raft_consensus.cc:2243] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.127833  7005 raft_consensus.cc:2272] T f4cb251260424b4fa016bdb23ff121f9 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.130318  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.130821  7005 raft_consensus.cc:2243] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.131206  7005 raft_consensus.cc:2272] T d2e875ab0f164f41b5782ac64b22fba1 P 18f9b347f31942f58fd4e20983181c5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.133234  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.133793  7005 raft_consensus.cc:2243] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.134207  7005 raft_consensus.cc:2272] T b3bc568c3ebc4468a027c7d3df5a82cd P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.136837  7005 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:20.137308  7005 raft_consensus.cc:2243] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.137815  7005 raft_consensus.cc:2272] T 6a680c3bab3e4588b4b95e2c6d0b691f P 18f9b347f31942f58fd4e20983181c5b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.168363  7005 tablet_server.cc:196] TabletServer@127.6.215.65:40143 shutdown complete.
W20260709 13:07:20.191412 16174 consensus_peers.cc:597] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.198125  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
W20260709 13:07:20.218047 16174 consensus_peers.cc:597] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 -> Peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Couldn't send request to peer fc91c555675945c89d3a9c2005e28780. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.225891  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:20.226745  7005 tablet_replica.cc:333] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.227877  7005 raft_consensus.cc:2243] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.228677  7005 raft_consensus.cc:2272] T e1c93f1544d7480d9c0158168975f639 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:20.230953 16174 consensus_peers.cc:597] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 -> Peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Couldn't send request to peer fc91c555675945c89d3a9c2005e28780. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.231564  7005 tablet_replica.cc:333] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.232270  7005 raft_consensus.cc:2243] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.232671  7005 raft_consensus.cc:2272] T 15a19020a29345b0aa3bac362b2d2ce0 P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.235983  7005 tablet_replica.cc:333] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
W20260709 13:07:20.237190 16007 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:20.237159  7005 raft_consensus.cc:2243] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.238550  7005 raft_consensus.cc:2272] T b3bc568c3ebc4468a027c7d3df5a82cd P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:20.240569 16174 consensus_peers.cc:597] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.241777  7005 tablet_replica.cc:333] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.242378  7005 raft_consensus.cc:2243] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.242769  7005 raft_consensus.cc:2272] T 6a680c3bab3e4588b4b95e2c6d0b691f P fc91c555675945c89d3a9c2005e28780 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.244724  7005 tablet_replica.cc:333] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.245246  7005 raft_consensus.cc:2243] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.245985  7005 raft_consensus.cc:2272] T d2e875ab0f164f41b5782ac64b22fba1 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.247819  7005 tablet_replica.cc:333] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.248276  7005 raft_consensus.cc:2243] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.248649  7005 raft_consensus.cc:2272] T f4cb251260424b4fa016bdb23ff121f9 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.250914  7005 tablet_replica.cc:333] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.251420  7005 raft_consensus.cc:2243] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.251796  7005 raft_consensus.cc:2272] T 1d23f8a2034b446a90403292115ff97d P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.253724  7005 tablet_replica.cc:333] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.254192  7005 raft_consensus.cc:2243] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.254565  7005 raft_consensus.cc:2272] T 65adb23f5ac145f3b32a1564983cf21a P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.256806  7005 tablet_replica.cc:333] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.257277  7005 raft_consensus.cc:2243] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.258113  7005 raft_consensus.cc:2272] T 750d64cebae14cad96278a638cad1f66 P fc91c555675945c89d3a9c2005e28780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.260465  7005 tablet_replica.cc:333] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780: stopping tablet replica
I20260709 13:07:20.261103  7005 raft_consensus.cc:2243] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.261672  7005 raft_consensus.cc:2272] T d22e76e4ae414b0fbb5732e50fd49791 P fc91c555675945c89d3a9c2005e28780 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:20.289722 16174 consensus_peers.cc:597] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 -> Peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Couldn't send request to peer fc91c555675945c89d3a9c2005e28780. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:33355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.296792  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
I20260709 13:07:20.323267  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
W20260709 13:07:20.324352 16174 consensus_peers.cc:597] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:20.354471 16174 consensus_peers.cc:597] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 -> Peer fc91c555675945c89d3a9c2005e28780 (127.6.215.66:33355): Couldn't send request to peer fc91c555675945c89d3a9c2005e28780. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:33355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:20.355082 16174 consensus_peers.cc:597] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 -> Peer 18f9b347f31942f58fd4e20983181c5b (127.6.215.65:40143): Couldn't send request to peer 18f9b347f31942f58fd4e20983181c5b. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.356469  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:20.357501  7005 tablet_replica.cc:333] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.358335  7005 raft_consensus.cc:2243] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.358950  7005 raft_consensus.cc:2272] T b3bc568c3ebc4468a027c7d3df5a82cd P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.362372  7005 tablet_replica.cc:333] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.363009  7005 raft_consensus.cc:2243] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.363777  7005 raft_consensus.cc:2272] T f4cb251260424b4fa016bdb23ff121f9 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.366174  7005 tablet_replica.cc:333] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.366719  7005 raft_consensus.cc:2243] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.367424  7005 raft_consensus.cc:2272] T 6a680c3bab3e4588b4b95e2c6d0b691f P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.369326  7005 tablet_replica.cc:333] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.369874  7005 raft_consensus.cc:2243] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.370226  7005 raft_consensus.cc:2272] T d2e875ab0f164f41b5782ac64b22fba1 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.372089  7005 tablet_replica.cc:333] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.372606  7005 raft_consensus.cc:2243] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.373256  7005 raft_consensus.cc:2272] T 1d23f8a2034b446a90403292115ff97d P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.375473  7005 tablet_replica.cc:333] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.375962  7005 raft_consensus.cc:2243] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.376649  7005 raft_consensus.cc:2272] T 65adb23f5ac145f3b32a1564983cf21a P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.378522  7005 tablet_replica.cc:333] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.379120  7005 raft_consensus.cc:2243] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.379664  7005 raft_consensus.cc:2272] T 750d64cebae14cad96278a638cad1f66 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.382081  7005 tablet_replica.cc:333] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.382531  7005 raft_consensus.cc:2243] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.383203  7005 raft_consensus.cc:2272] T d22e76e4ae414b0fbb5732e50fd49791 P d2a38bc6f8b3422ca8e1642264076361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.385030  7005 tablet_replica.cc:333] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.385527  7005 raft_consensus.cc:2243] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:20.385882  7005 raft_consensus.cc:2272] T e1c93f1544d7480d9c0158168975f639 P d2a38bc6f8b3422ca8e1642264076361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.387768  7005 tablet_replica.cc:333] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361: stopping tablet replica
I20260709 13:07:20.388154  7005 raft_consensus.cc:2243] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.388832  7005 raft_consensus.cc:2272] T 15a19020a29345b0aa3bac362b2d2ce0 P d2a38bc6f8b3422ca8e1642264076361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.410645  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
I20260709 13:07:20.432755  7005 master.cc:562] Master@127.6.215.126:45777 shutting down...
I20260709 13:07:20.453281  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:20.453819  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:20.454092  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6f8361f456c54bc788265d7d687084ab: stopping tablet replica
I20260709 13:07:20.474586  7005 master.cc:584] Master@127.6.215.126:45777 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12425 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:07:20.519266  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:34047
I20260709 13:07:20.520501  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:20.526276 16548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.526311 16547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.526871 16550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:20.528059  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:20.528898  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:20.529070  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:20.529217  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602440529185 us; error 0 us; skew 500 ppm
I20260709 13:07:20.529757  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:20.531921  7005 webserver.cc:533] Webserver started at http://127.6.215.126:35169/ using document root <none> and password file <none>
I20260709 13:07:20.532477  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:20.532812  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:20.533252  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:20.534511  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "dc0b18b10fa24f668e1ff6e9a952c80f"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.539608  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:20.543157 16555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.543880  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:20.544168  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "dc0b18b10fa24f668e1ff6e9a952c80f"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.544435  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:20.556814  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:20.558003  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:20.596481  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:34047
I20260709 13:07:20.596556 16606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:34047 every 8 connection(s)
I20260709 13:07:20.600200 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:20.610986 16607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f: Bootstrap starting.
I20260709 13:07:20.616099 16607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:20.620431 16607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f: No bootstrap required, opened a new log
I20260709 13:07:20.622555 16607 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" member_type: VOTER }
I20260709 13:07:20.622908 16607 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:20.623112 16607 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0b18b10fa24f668e1ff6e9a952c80f, State: Initialized, Role: FOLLOWER
I20260709 13:07:20.623709 16607 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" member_type: VOTER }
I20260709 13:07:20.624130 16607 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:20.624328 16607 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:20.624583 16607 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:20.629029 16607 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" member_type: VOTER }
I20260709 13:07:20.629508 16607 leader_election.cc:304] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc0b18b10fa24f668e1ff6e9a952c80f; no voters: 
I20260709 13:07:20.630528 16607 leader_election.cc:290] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:20.630813 16610 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:20.632409 16610 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 1 LEADER]: Becoming Leader. State: Replica: dc0b18b10fa24f668e1ff6e9a952c80f, State: Running, Role: LEADER
I20260709 13:07:20.633044 16610 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" member_type: VOTER }
I20260709 13:07:20.633498 16607 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:20.637482 16612 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc0b18b10fa24f668e1ff6e9a952c80f. Latest consensus state: current_term: 1 leader_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" member_type: VOTER } }
I20260709 13:07:20.637821 16611 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0b18b10fa24f668e1ff6e9a952c80f" member_type: VOTER } }
I20260709 13:07:20.638094 16612 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:20.638332 16611 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:20.641878 16617 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:20.648058 16617 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:20.649248  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:20.656544 16617 catalog_manager.cc:1383] Generated new cluster ID: 2a1267f032694e6393b6c0aebacf0fb9
I20260709 13:07:20.656826 16617 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:20.673046 16617 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:20.674273 16617 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:20.690212 16617 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f: Generated new TSK 0
I20260709 13:07:20.690765 16617 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:20.716033  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:20.722440 16628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.722762 16629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:20.724800  7005 server_base.cc:1061] running on GCE node
W20260709 13:07:20.725098 16632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:20.725989  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:20.726182  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:20.726346  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602440726330 us; error 0 us; skew 500 ppm
I20260709 13:07:20.726856  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:20.728878  7005 webserver.cc:533] Webserver started at http://127.6.215.65:33273/ using document root <none> and password file <none>
I20260709 13:07:20.729318  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:20.729562  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:20.729812  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:20.730824  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "3c01c878707640e590a27a5e31b45d60"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.735139  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:20.738216 16636 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.738989  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:07:20.739235  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "3c01c878707640e590a27a5e31b45d60"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.739491  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:20.771116  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:20.772275  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:20.773809  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:20.776011  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:20.776190  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.776394  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:20.776551  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.816327  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:35441
I20260709 13:07:20.816514 16698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:35441 every 8 connection(s)
I20260709 13:07:20.821108  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:20.827664 16703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.829141 16704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.831568 16706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:20.832573  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:20.833684  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:20.833774 16699 heartbeater.cc:344] Connected to a master server at 127.6.215.126:34047
W20260709 13:07:20.833959  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:20.834165  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602440834149 us; error 0 us; skew 500 ppm
I20260709 13:07:20.834203 16699 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:20.834980  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:20.835122 16699 heartbeater.cc:507] Master 127.6.215.126:34047 requested a full tablet report, sending...
I20260709 13:07:20.837419 16572 ts_manager.cc:194] Registered new tserver with Master: 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441)
I20260709 13:07:20.837788  7005 webserver.cc:533] Webserver started at http://127.6.215.66:40687/ using document root <none> and password file <none>
I20260709 13:07:20.838271  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:20.838455  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:20.838681  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:20.839744  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "d21c8167e65e4fbd8b92afeb49447296"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.839787 16572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48032
I20260709 13:07:20.844169  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:07:20.847571 16711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.848291  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:20.848565  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "d21c8167e65e4fbd8b92afeb49447296"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.848816  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:20.860463  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:20.861665  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:20.863015  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:20.865011  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:20.865190  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.865438  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:20.865587  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.904768  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:38461
I20260709 13:07:20.904884 16773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:38461 every 8 connection(s)
I20260709 13:07:20.909236  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:20.915503 16777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.915977 16778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.918861 16780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:20.919289  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:20.919987 16774 heartbeater.cc:344] Connected to a master server at 127.6.215.126:34047
I20260709 13:07:20.920361 16774 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:20.920444  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:20.920717  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:20.920881  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602440920864 us; error 0 us; skew 500 ppm
I20260709 13:07:20.921064 16774 heartbeater.cc:507] Master 127.6.215.126:34047 requested a full tablet report, sending...
I20260709 13:07:20.921553  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:20.923172 16572 ts_manager.cc:194] Registered new tserver with Master: d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:20.923954  7005 webserver.cc:533] Webserver started at http://127.6.215.67:43153/ using document root <none> and password file <none>
I20260709 13:07:20.924467  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:20.924471 16572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48048
I20260709 13:07:20.924975  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:20.925331  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:20.926555  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "1055cfdc4e484e97afd91e81eed5ec90"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.930665  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:07:20.933655 16785 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.934322  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:20.934597  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "1055cfdc4e484e97afd91e81eed5ec90"
format_stamp: "Formatted at 2026-07-09 13:07:20 on dist-test-slave-r31z"
I20260709 13:07:20.934901  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:20.956491  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:20.958014  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:20.959826  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:20.962492  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:20.962670  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:20.962924  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:20.963085  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:21.002988  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:36251
I20260709 13:07:21.003098 16847 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:36251 every 8 connection(s)
I20260709 13:07:21.016284 16848 heartbeater.cc:344] Connected to a master server at 127.6.215.126:34047
I20260709 13:07:21.016776 16848 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:21.017573 16848 heartbeater.cc:507] Master 127.6.215.126:34047 requested a full tablet report, sending...
I20260709 13:07:21.019351 16572 ts_manager.cc:194] Registered new tserver with Master: 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:21.019493  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013513078s
I20260709 13:07:21.020921 16572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48052
I20260709 13:07:21.043331 16572 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48066:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:21.045576 16572 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:21.085625 16738 tablet_service.cc:1511] Processing CreateTablet for tablet ed2de62d5a1d4a46a4c3fa38cac38fe8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8b2826d6e3664e5fb7f8a31aabb45057]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:21.085717 16739 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3de903bde9453a8ca84a93c7fc2881 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8b2826d6e3664e5fb7f8a31aabb45057]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:21.087093 16738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2de62d5a1d4a46a4c3fa38cac38fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.087693 16739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3de903bde9453a8ca84a93c7fc2881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.095535 16813 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3de903bde9453a8ca84a93c7fc2881 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8b2826d6e3664e5fb7f8a31aabb45057]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:21.096246 16812 tablet_service.cc:1511] Processing CreateTablet for tablet ed2de62d5a1d4a46a4c3fa38cac38fe8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8b2826d6e3664e5fb7f8a31aabb45057]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:21.096935 16813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3de903bde9453a8ca84a93c7fc2881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.096614 16664 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3de903bde9453a8ca84a93c7fc2881 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8b2826d6e3664e5fb7f8a31aabb45057]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:21.097522 16812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2de62d5a1d4a46a4c3fa38cac38fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.098140 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3de903bde9453a8ca84a93c7fc2881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.095546 16663 tablet_service.cc:1511] Processing CreateTablet for tablet ed2de62d5a1d4a46a4c3fa38cac38fe8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8b2826d6e3664e5fb7f8a31aabb45057]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:21.101111 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2de62d5a1d4a46a4c3fa38cac38fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.118145 16863 tablet_bootstrap.cc:492] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: Bootstrap starting.
I20260709 13:07:21.118856 16864 tablet_bootstrap.cc:492] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: Bootstrap starting.
I20260709 13:07:21.129396 16863 tablet_bootstrap.cc:654] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.133037 16864 tablet_bootstrap.cc:654] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.134209 16863 tablet_bootstrap.cc:492] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: No bootstrap required, opened a new log
I20260709 13:07:21.134632 16863 ts_tablet_manager.cc:1403] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:07:21.136433 16865 tablet_bootstrap.cc:492] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: Bootstrap starting.
I20260709 13:07:21.137300 16863 raft_consensus.cc:359] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.137897 16863 raft_consensus.cc:385] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.138192 16863 raft_consensus.cc:740] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.140367 16863 consensus_queue.cc:260] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.142352 16864 tablet_bootstrap.cc:492] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: No bootstrap required, opened a new log
I20260709 13:07:21.142881 16864 ts_tablet_manager.cc:1403] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:07:21.143077 16865 tablet_bootstrap.cc:654] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.142890 16848 heartbeater.cc:499] Master 127.6.215.126:34047 was elected leader, sending a full tablet report...
I20260709 13:07:21.143563 16868 raft_consensus.cc:493] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.144142 16868 raft_consensus.cc:515] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.146220 16864 raft_consensus.cc:359] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.147001 16864 raft_consensus.cc:385] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.147308 16864 raft_consensus.cc:740] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.148023 16864 consensus_queue.cc:260] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.150846 16868 leader_election.cc:290] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:21.153136 16863 ts_tablet_manager.cc:1434] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.008s
I20260709 13:07:21.156522 16865 tablet_bootstrap.cc:492] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: No bootstrap required, opened a new log
I20260709 13:07:21.156848 16863 tablet_bootstrap.cc:492] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90: Bootstrap starting.
I20260709 13:07:21.157205 16865 ts_tablet_manager.cc:1403] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:07:21.159292 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60" is_pre_election: true
W20260709 13:07:21.160853 16787 leader_election.cc:343] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:21.162074 16774 heartbeater.cc:499] Master 127.6.215.126:34047 was elected leader, sending a full tablet report...
I20260709 13:07:21.162564 16864 ts_tablet_manager.cc:1434] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:07:21.163488 16864 tablet_bootstrap.cc:492] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: Bootstrap starting.
I20260709 13:07:21.160782 16865 raft_consensus.cc:359] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.164603 16865 raft_consensus.cc:385] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.164891 16865 raft_consensus.cc:740] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.165633 16865 consensus_queue.cc:260] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.167994 16699 heartbeater.cc:499] Master 127.6.215.126:34047 was elected leader, sending a full tablet report...
I20260709 13:07:21.168464 16865 ts_tablet_manager.cc:1434] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:07:21.169734 16864 tablet_bootstrap.cc:654] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.176570 16863 tablet_bootstrap.cc:654] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.181137 16865 tablet_bootstrap.cc:492] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60: Bootstrap starting.
I20260709 13:07:21.188561 16865 tablet_bootstrap.cc:654] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.194563 16864 tablet_bootstrap.cc:492] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: No bootstrap required, opened a new log
I20260709 13:07:21.195135 16864 ts_tablet_manager.cc:1403] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.023s
I20260709 13:07:21.195286 16863 tablet_bootstrap.cc:492] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90: No bootstrap required, opened a new log
I20260709 13:07:21.195804 16863 ts_tablet_manager.cc:1403] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.007s
I20260709 13:07:21.196583 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21c8167e65e4fbd8b92afeb49447296" is_pre_election: true
I20260709 13:07:21.198513 16864 raft_consensus.cc:359] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
W20260709 13:07:21.198984 16789 leader_election.cc:343] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:21.199235 16864 raft_consensus.cc:385] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.199564 16864 raft_consensus.cc:740] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.199514 16789 leader_election.cc:304] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90; no voters: 3c01c878707640e590a27a5e31b45d60, d21c8167e65e4fbd8b92afeb49447296
I20260709 13:07:21.200515 16864 consensus_queue.cc:260] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.201355 16863 raft_consensus.cc:359] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.201263 16869 raft_consensus.cc:2749] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:21.202924 16864 ts_tablet_manager.cc:1434] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:21.202103 16863 raft_consensus.cc:385] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.203873 16863 raft_consensus.cc:740] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.204114 16865 tablet_bootstrap.cc:492] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60: No bootstrap required, opened a new log
I20260709 13:07:21.204631 16865 ts_tablet_manager.cc:1403] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:07:21.204459 16863 consensus_queue.cc:260] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.206357 16863 ts_tablet_manager.cc:1434] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:21.207046 16865 raft_consensus.cc:359] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.207561 16865 raft_consensus.cc:385] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.207777 16865 raft_consensus.cc:740] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.208381 16865 consensus_queue.cc:260] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.210194 16865 ts_tablet_manager.cc:1434] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:07:21.276885 16870 raft_consensus.cc:493] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.277477 16870 raft_consensus.cc:515] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.279654 16870 leader_election.cc:290] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:21.287977 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60" is_pre_election: true
I20260709 13:07:21.288579 16674 raft_consensus.cc:2468] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 0.
I20260709 13:07:21.289323 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90" is_pre_election: true
I20260709 13:07:21.289675 16713 leader_election.cc:304] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c01c878707640e590a27a5e31b45d60, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:21.290135 16823 raft_consensus.cc:2468] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 0.
I20260709 13:07:21.290544 16870 raft_consensus.cc:2804] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:21.290982 16870 raft_consensus.cc:493] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.291265 16870 raft_consensus.cc:3060] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.297516 16870 raft_consensus.cc:515] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.298955 16870 leader_election.cc:290] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 election: Requested vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:21.300048 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60"
I20260709 13:07:21.300228 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
I20260709 13:07:21.300712 16674 raft_consensus.cc:3060] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.300783 16823 raft_consensus.cc:3060] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.306259 16823 raft_consensus.cc:2468] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 1.
I20260709 13:07:21.306497 16674 raft_consensus.cc:2468] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 1.
I20260709 13:07:21.307399 16714 leader_election.cc:304] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:21.308334 16870 raft_consensus.cc:2804] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:21.309247 16870 raft_consensus.cc:697] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Becoming Leader. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Running, Role: LEADER
I20260709 13:07:21.310006 16870 consensus_queue.cc:237] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.316555 16572 catalog_manager.cc:5697] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 reported cstate change: term changed from 0 to 1, leader changed from <none> to d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "d21c8167e65e4fbd8b92afeb49447296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.372232 16870 raft_consensus.cc:493] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.372694 16870 raft_consensus.cc:515] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.374433 16870 leader_election.cc:290] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251), 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441)
I20260709 13:07:21.375515 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90" is_pre_election: true
I20260709 13:07:21.375694 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60" is_pre_election: true
I20260709 13:07:21.376355 16823 raft_consensus.cc:2468] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 0.
I20260709 13:07:21.376418 16674 raft_consensus.cc:2468] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 0.
I20260709 13:07:21.377952 16713 leader_election.cc:304] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c01c878707640e590a27a5e31b45d60, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:21.378624 16870 raft_consensus.cc:2804] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:21.378980 16870 raft_consensus.cc:493] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.379277 16870 raft_consensus.cc:3060] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.384104 16870 raft_consensus.cc:515] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.385545 16870 leader_election.cc:290] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 election: Requested vote from peers 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251), 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441)
I20260709 13:07:21.386385 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
I20260709 13:07:21.386409 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60"
I20260709 13:07:21.386925 16823 raft_consensus.cc:3060] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.386987 16674 raft_consensus.cc:3060] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.391469 16823 raft_consensus.cc:2468] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 1.
I20260709 13:07:21.391649 16674 raft_consensus.cc:2468] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 1.
I20260709 13:07:21.392401 16714 leader_election.cc:304] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:21.393116 16870 raft_consensus.cc:2804] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:21.393639 16870 raft_consensus.cc:697] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Becoming Leader. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Running, Role: LEADER
I20260709 13:07:21.394495 16870 consensus_queue.cc:237] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:21.401254 16572 catalog_manager.cc:5697] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 reported cstate change: term changed from 0 to 1, leader changed from <none> to d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "d21c8167e65e4fbd8b92afeb49447296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.495417 16572 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48080:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:21.497265 16572 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:21.518404 16664 tablet_service.cc:1511] Processing CreateTablet for tablet 1e5b4c450bb94c019615170617fa4921 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7646e82782714e538617be642e14f42e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:21.519647 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e5b4c450bb94c019615170617fa4921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.519719 16738 tablet_service.cc:1511] Processing CreateTablet for tablet 1e5b4c450bb94c019615170617fa4921 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7646e82782714e538617be642e14f42e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:21.520887 16738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e5b4c450bb94c019615170617fa4921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.522189 16813 tablet_service.cc:1511] Processing CreateTablet for tablet 1e5b4c450bb94c019615170617fa4921 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7646e82782714e538617be642e14f42e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:21.522436 16663 tablet_service.cc:1511] Processing CreateTablet for tablet c5d7a5b80a1949c39a75276026d91b84 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7646e82782714e538617be642e14f42e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:21.523367 16813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e5b4c450bb94c019615170617fa4921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.523662 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d7a5b80a1949c39a75276026d91b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.524057 16739 tablet_service.cc:1511] Processing CreateTablet for tablet c5d7a5b80a1949c39a75276026d91b84 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7646e82782714e538617be642e14f42e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:21.525223 16739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d7a5b80a1949c39a75276026d91b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.527534 16812 tablet_service.cc:1511] Processing CreateTablet for tablet c5d7a5b80a1949c39a75276026d91b84 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7646e82782714e538617be642e14f42e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:21.528642 16812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d7a5b80a1949c39a75276026d91b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:21.540902 16865 tablet_bootstrap.cc:492] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Bootstrap starting.
I20260709 13:07:21.547161 16864 tablet_bootstrap.cc:492] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: Bootstrap starting.
I20260709 13:07:21.547945 16865 tablet_bootstrap.cc:654] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.553380 16864 tablet_bootstrap.cc:654] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.554100 16863 tablet_bootstrap.cc:492] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: Bootstrap starting.
I20260709 13:07:21.562803 16863 tablet_bootstrap.cc:654] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.565161 16864 tablet_bootstrap.cc:492] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: No bootstrap required, opened a new log
I20260709 13:07:21.565373 16865 tablet_bootstrap.cc:492] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: No bootstrap required, opened a new log
I20260709 13:07:21.565748 16864 ts_tablet_manager.cc:1403] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:07:21.565954 16865 ts_tablet_manager.cc:1403] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:07:21.568639 16864 raft_consensus.cc:359] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.569168 16864 raft_consensus.cc:385] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.569501 16864 raft_consensus.cc:740] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.569020 16865 raft_consensus.cc:359] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.569658 16863 tablet_bootstrap.cc:492] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: No bootstrap required, opened a new log
I20260709 13:07:21.569911 16865 raft_consensus.cc:385] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.570163 16863 ts_tablet_manager.cc:1403] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 13:07:21.570225 16865 raft_consensus.cc:740] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.570194 16864 consensus_queue.cc:260] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.572254 16864 ts_tablet_manager.cc:1434] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:07:21.571332 16865 consensus_queue.cc:260] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.573655 16864 tablet_bootstrap.cc:492] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296: Bootstrap starting.
I20260709 13:07:21.575618 16865 ts_tablet_manager.cc:1434] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:21.575133 16863 raft_consensus.cc:359] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.581578 16863 raft_consensus.cc:385] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.581941 16865 tablet_bootstrap.cc:492] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: Bootstrap starting.
I20260709 13:07:21.581925 16863 raft_consensus.cc:740] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.582924 16863 consensus_queue.cc:260] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.585398 16863 ts_tablet_manager.cc:1434] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:07:21.588229 16865 tablet_bootstrap.cc:654] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.593079 16864 tablet_bootstrap.cc:654] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.594134 16865 tablet_bootstrap.cc:492] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: No bootstrap required, opened a new log
I20260709 13:07:21.594710 16865 ts_tablet_manager.cc:1403] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:07:21.597950 16863 tablet_bootstrap.cc:492] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: Bootstrap starting.
I20260709 13:07:21.597651 16865 raft_consensus.cc:359] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.598637 16865 raft_consensus.cc:385] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.598845 16864 tablet_bootstrap.cc:492] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296: No bootstrap required, opened a new log
I20260709 13:07:21.599097 16865 raft_consensus.cc:740] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.599463 16864 ts_tablet_manager.cc:1403] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:07:21.600041 16865 consensus_queue.cc:260] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.602274 16865 ts_tablet_manager.cc:1434] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:21.602746 16864 raft_consensus.cc:359] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.603376 16864 raft_consensus.cc:385] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.603638 16864 raft_consensus.cc:740] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.604346 16864 consensus_queue.cc:260] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.605494 16863 tablet_bootstrap.cc:654] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:21.606482 16864 ts_tablet_manager.cc:1434] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:21.614333 16863 tablet_bootstrap.cc:492] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: No bootstrap required, opened a new log
I20260709 13:07:21.614977 16863 ts_tablet_manager.cc:1403] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:07:21.617671 16863 raft_consensus.cc:359] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.618162 16863 raft_consensus.cc:385] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:21.618393 16863 raft_consensus.cc:740] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Initialized, Role: FOLLOWER
I20260709 13:07:21.618971 16863 consensus_queue.cc:260] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.620869 16863 ts_tablet_manager.cc:1434] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
W20260709 13:07:21.644402 16620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:21.665228 16869 raft_consensus.cc:493] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.665771 16869 raft_consensus.cc:515] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.667454 16869 leader_election.cc:290] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:21.668262 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60" is_pre_election: true
I20260709 13:07:21.668488 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21c8167e65e4fbd8b92afeb49447296" is_pre_election: true
I20260709 13:07:21.668824 16674 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 0.
I20260709 13:07:21.669092 16749 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 0.
I20260709 13:07:21.669796 16787 leader_election.cc:304] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, 3c01c878707640e590a27a5e31b45d60; no voters: 
I20260709 13:07:21.670536 16869 raft_consensus.cc:2804] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:21.670864 16869 raft_consensus.cc:493] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.671129 16869 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.677609 16869 raft_consensus.cc:515] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.679507 16869 leader_election.cc:290] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 election: Requested vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:21.680378 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60"
I20260709 13:07:21.680549 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
I20260709 13:07:21.680985 16674 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.681099 16749 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.687355 16674 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 1.
I20260709 13:07:21.687482 16749 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 1.
I20260709 13:07:21.688566 16787 leader_election.cc:304] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, 3c01c878707640e590a27a5e31b45d60; no voters: 
I20260709 13:07:21.689288 16869 raft_consensus.cc:2804] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:21.690300 16869 raft_consensus.cc:697] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Becoming Leader. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Running, Role: LEADER
I20260709 13:07:21.691093 16869 consensus_queue.cc:237] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.698057 16572 catalog_manager.cc:5697] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "1055cfdc4e484e97afd91e81eed5ec90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.826967 16870 consensus_queue.cc:1048] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:21.827867 16877 consensus_queue.cc:1048] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:21.896019 16897 consensus_queue.cc:1048] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:21.907521 16897 consensus_queue.cc:1048] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:21.942263 16869 raft_consensus.cc:493] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.942755 16869 raft_consensus.cc:515] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.944631 16869 leader_election.cc:290] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:21.945766 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60" is_pre_election: true
I20260709 13:07:21.945843 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21c8167e65e4fbd8b92afeb49447296" is_pre_election: true
I20260709 13:07:21.946554 16674 raft_consensus.cc:2468] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 0.
I20260709 13:07:21.946677 16749 raft_consensus.cc:2468] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 0.
I20260709 13:07:21.948045 16787 leader_election.cc:304] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, 3c01c878707640e590a27a5e31b45d60; no voters: 
I20260709 13:07:21.948807 16869 raft_consensus.cc:2804] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:21.949156 16869 raft_consensus.cc:493] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.949467 16869 raft_consensus.cc:3060] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.954288 16869 raft_consensus.cc:515] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.955861 16869 leader_election.cc:290] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 election: Requested vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:21.956911 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c01c878707640e590a27a5e31b45d60"
I20260709 13:07:21.956907 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
I20260709 13:07:21.957830 16674 raft_consensus.cc:3060] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.957867 16749 raft_consensus.cc:3060] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:21.964831 16749 raft_consensus.cc:2468] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 1.
I20260709 13:07:21.964831 16674 raft_consensus.cc:2468] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 1.
I20260709 13:07:21.966192 16789 leader_election.cc:304] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:21.966878 16869 raft_consensus.cc:2804] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:21.967245 16869 raft_consensus.cc:697] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Becoming Leader. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Running, Role: LEADER
I20260709 13:07:21.967939 16869 consensus_queue.cc:237] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:21.974784 16572 catalog_manager.cc:5697] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "1055cfdc4e484e97afd91e81eed5ec90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.025450 16749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881"
dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
mode: GRACEFUL
new_leader_uuid: "3c01c878707640e590a27a5e31b45d60"
 from {username='slave'} at 127.0.0.1:57702
I20260709 13:07:22.025949 16749 raft_consensus.cc:606] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Received request to transfer leadership to TS 3c01c878707640e590a27a5e31b45d60
I20260709 13:07:22.031898 16749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8"
dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
mode: GRACEFUL
new_leader_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
 from {username='slave'} at 127.0.0.1:57702
I20260709 13:07:22.032367 16749 raft_consensus.cc:606] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Received request to transfer leadership to TS 1055cfdc4e484e97afd91e81eed5ec90
I20260709 13:07:22.047293 16823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921"
dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
mode: GRACEFUL
new_leader_uuid: "3c01c878707640e590a27a5e31b45d60"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:07:22.047907 16823 raft_consensus.cc:606] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Received request to transfer leadership to TS 3c01c878707640e590a27a5e31b45d60
I20260709 13:07:22.053571 16823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84"
dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
mode: GRACEFUL
new_leader_uuid: "3c01c878707640e590a27a5e31b45d60"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:07:22.054105 16823 raft_consensus.cc:606] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Received request to transfer leadership to TS 3c01c878707640e590a27a5e31b45d60
I20260709 13:07:22.144052 16869 consensus_queue.cc:1048] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:22.157924 16869 consensus_queue.cc:1048] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:22.166294 16869 raft_consensus.cc:993] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: : Instructing follower 3c01c878707640e590a27a5e31b45d60 to start an election
I20260709 13:07:22.167043 16869 raft_consensus.cc:1081] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Signalling peer 3c01c878707640e590a27a5e31b45d60 to start an election
I20260709 13:07:22.168887 16674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921"
dest_uuid: "3c01c878707640e590a27a5e31b45d60"
 from {username='slave'} at 127.0.0.1:57876
I20260709 13:07:22.169682 16674 raft_consensus.cc:493] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:22.170071 16674 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.175630 16674 raft_consensus.cc:515] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.178181 16674 leader_election.cc:290] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [CANDIDATE]: Term 2 election: Requested vote from peers d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461), 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:22.188805 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "3c01c878707640e590a27a5e31b45d60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
I20260709 13:07:22.189288 16749 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.189960 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "3c01c878707640e590a27a5e31b45d60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
I20260709 13:07:22.190608 16823 raft_consensus.cc:3055] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:22.191015 16823 raft_consensus.cc:740] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Running, Role: LEADER
I20260709 13:07:22.191920 16823 consensus_queue.cc:260] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.193337 16823 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.196619 16749 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c01c878707640e590a27a5e31b45d60 in term 2.
I20260709 13:07:22.197768 16640 leader_election.cc:304] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c01c878707640e590a27a5e31b45d60, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:22.198568 16872 raft_consensus.cc:2804] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:22.200095 16872 raft_consensus.cc:697] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Becoming Leader. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Running, Role: LEADER
I20260709 13:07:22.200294 16823 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c01c878707640e590a27a5e31b45d60 in term 2.
I20260709 13:07:22.201112 16872 consensus_queue.cc:237] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.207655 16571 catalog_manager.cc:5697] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 reported cstate change: term changed from 1 to 2, leader changed from 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67) to 3c01c878707640e590a27a5e31b45d60 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "3c01c878707640e590a27a5e31b45d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.229887 16870 raft_consensus.cc:993] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: : Instructing follower 1055cfdc4e484e97afd91e81eed5ec90 to start an election
I20260709 13:07:22.230435 16897 raft_consensus.cc:1081] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Signalling peer 1055cfdc4e484e97afd91e81eed5ec90 to start an election
I20260709 13:07:22.232159 16823 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8"
dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
 from {username='slave'} at 127.0.0.1:33962
I20260709 13:07:22.232657 16823 raft_consensus.cc:493] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:22.232905 16823 raft_consensus.cc:3060] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.238137 16823 raft_consensus.cc:515] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.239595 16823 leader_election.cc:290] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 2 election: Requested vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461)
I20260709 13:07:22.240507 16674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c01c878707640e590a27a5e31b45d60"
I20260709 13:07:22.240630 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2de62d5a1d4a46a4c3fa38cac38fe8" candidate_uuid: "1055cfdc4e484e97afd91e81eed5ec90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
I20260709 13:07:22.241158 16674 raft_consensus.cc:3060] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.241247 16749 raft_consensus.cc:3055] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:22.241747 16749 raft_consensus.cc:740] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Running, Role: LEADER
I20260709 13:07:22.242388 16749 consensus_queue.cc:260] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.243257 16749 raft_consensus.cc:3060] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.246176 16674 raft_consensus.cc:2468] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 2.
I20260709 13:07:22.247291 16787 leader_election.cc:304] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, 3c01c878707640e590a27a5e31b45d60; no voters: 
I20260709 13:07:22.248107 16906 raft_consensus.cc:2804] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:22.248185 16749 raft_consensus.cc:2468] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1055cfdc4e484e97afd91e81eed5ec90 in term 2.
I20260709 13:07:22.248667 16906 raft_consensus.cc:697] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 LEADER]: Becoming Leader. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Running, Role: LEADER
I20260709 13:07:22.249503 16906 consensus_queue.cc:237] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.256871 16570 catalog_manager.cc:5697] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 reported cstate change: term changed from 1 to 2, leader changed from d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66) to 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "1055cfdc4e484e97afd91e81eed5ec90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.362627 16870 raft_consensus.cc:993] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: : Instructing follower 3c01c878707640e590a27a5e31b45d60 to start an election
I20260709 13:07:22.363070 16897 raft_consensus.cc:1081] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Signalling peer 3c01c878707640e590a27a5e31b45d60 to start an election
I20260709 13:07:22.364549 16674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881"
dest_uuid: "3c01c878707640e590a27a5e31b45d60"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:07:22.365025 16674 raft_consensus.cc:493] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:22.365335 16674 raft_consensus.cc:3060] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.371843 16674 raft_consensus.cc:515] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:22.373494 16906 consensus_queue.cc:1048] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:22.374571 16674 leader_election.cc:290] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [CANDIDATE]: Term 2 election: Requested vote from peers d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461), 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:22.375358 16749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881" candidate_uuid: "3c01c878707640e590a27a5e31b45d60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
I20260709 13:07:22.375663 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3de903bde9453a8ca84a93c7fc2881" candidate_uuid: "3c01c878707640e590a27a5e31b45d60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
I20260709 13:07:22.376068 16749 raft_consensus.cc:3055] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:22.376199 16823 raft_consensus.cc:3060] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.376487 16749 raft_consensus.cc:740] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Running, Role: LEADER
I20260709 13:07:22.377328 16749 consensus_queue.cc:260] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:22.378686 16749 raft_consensus.cc:3060] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.380877 16869 raft_consensus.cc:993] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: : Instructing follower 3c01c878707640e590a27a5e31b45d60 to start an election
I20260709 13:07:22.381319 16869 raft_consensus.cc:1081] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Signalling peer 3c01c878707640e590a27a5e31b45d60 to start an election
I20260709 13:07:22.383064 16674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84"
dest_uuid: "3c01c878707640e590a27a5e31b45d60"
 from {username='slave'} at 127.0.0.1:57876
I20260709 13:07:22.383376 16823 raft_consensus.cc:2468] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c01c878707640e590a27a5e31b45d60 in term 2.
I20260709 13:07:22.383569 16674 raft_consensus.cc:493] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:22.384562 16674 raft_consensus.cc:3060] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.384860 16639 leader_election.cc:304] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, 3c01c878707640e590a27a5e31b45d60; no voters: 
I20260709 13:07:22.385764 16872 raft_consensus.cc:2804] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:22.386018 16749 raft_consensus.cc:2468] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c01c878707640e590a27a5e31b45d60 in term 2.
I20260709 13:07:22.386214 16872 raft_consensus.cc:697] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Becoming Leader. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Running, Role: LEADER
I20260709 13:07:22.387144 16872 consensus_queue.cc:237] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } }
I20260709 13:07:22.391479 16891 consensus_queue.cc:1048] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:22.391495 16674 raft_consensus.cc:515] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.392946 16673 raft_consensus.cc:1240] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Rejecting Update request from peer 1055cfdc4e484e97afd91e81eed5ec90 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:22.395548 16674 leader_election.cc:290] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [CANDIDATE]: Term 2 election: Requested vote from peers d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461), 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:22.395627 16748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84" candidate_uuid: "3c01c878707640e590a27a5e31b45d60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
I20260709 13:07:22.396122 16571 catalog_manager.cc:5697] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 reported cstate change: term changed from 1 to 2, leader changed from d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66) to 3c01c878707640e590a27a5e31b45d60 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "3c01c878707640e590a27a5e31b45d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.398161 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d7a5b80a1949c39a75276026d91b84" candidate_uuid: "3c01c878707640e590a27a5e31b45d60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
I20260709 13:07:22.398736 16823 raft_consensus.cc:3055] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:22.399040 16823 raft_consensus.cc:740] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1055cfdc4e484e97afd91e81eed5ec90, State: Running, Role: LEADER
I20260709 13:07:22.399502 16891 consensus_queue.cc:1059] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:22.400516 16823 consensus_queue.cc:260] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.401835 16823 raft_consensus.cc:3060] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.408998 16823 raft_consensus.cc:2468] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c01c878707640e590a27a5e31b45d60 in term 2.
I20260709 13:07:22.409868 16639 leader_election.cc:304] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, 3c01c878707640e590a27a5e31b45d60; no voters: d21c8167e65e4fbd8b92afeb49447296
I20260709 13:07:22.410851 16872 raft_consensus.cc:2804] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:22.411300 16872 raft_consensus.cc:697] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Becoming Leader. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Running, Role: LEADER
I20260709 13:07:22.412002 16872 consensus_queue.cc:237] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.418294 16570 catalog_manager.cc:5697] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 reported cstate change: term changed from 1 to 2, leader changed from 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67) to 3c01c878707640e590a27a5e31b45d60 (127.6.215.65). New cstate: current_term: 2 leader_uuid: "3c01c878707640e590a27a5e31b45d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.505205  7005 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:07:22.506779  7005 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:07:22.507117  7005 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:07:22.518788 16673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921"
dest_uuid: "3c01c878707640e590a27a5e31b45d60"
mode: GRACEFUL
new_leader_uuid: "d21c8167e65e4fbd8b92afeb49447296"
 from {username='slave'} at 127.0.0.1:41312
I20260709 13:07:22.519295 16673 raft_consensus.cc:606] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Received request to transfer leadership to TS d21c8167e65e4fbd8b92afeb49447296
I20260709 13:07:22.520272  7005 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:07:22.606979 16749 raft_consensus.cc:1275] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Refusing update from remote peer 3c01c878707640e590a27a5e31b45d60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:22.608348 16872 consensus_queue.cc:1048] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.613190 16910 raft_consensus.cc:993] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: : Instructing follower d21c8167e65e4fbd8b92afeb49447296 to start an election
I20260709 13:07:22.613817 16872 raft_consensus.cc:1081] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Signalling peer d21c8167e65e4fbd8b92afeb49447296 to start an election
I20260709 13:07:22.615789 16748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921"
dest_uuid: "d21c8167e65e4fbd8b92afeb49447296"
 from {username='slave'} at 127.0.0.1:57718
I20260709 13:07:22.617046 16748 raft_consensus.cc:493] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:22.617455 16748 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.620096 16823 raft_consensus.cc:1275] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Refusing update from remote peer 3c01c878707640e590a27a5e31b45d60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:22.621423 16910 consensus_queue.cc:1048] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.623914 16748 raft_consensus.cc:515] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.629426 16673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c01c878707640e590a27a5e31b45d60"
I20260709 13:07:22.629760 16823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5b4c450bb94c019615170617fa4921" candidate_uuid: "d21c8167e65e4fbd8b92afeb49447296" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1055cfdc4e484e97afd91e81eed5ec90"
I20260709 13:07:22.630164 16673 raft_consensus.cc:3055] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:22.630578 16673 raft_consensus.cc:740] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c01c878707640e590a27a5e31b45d60, State: Running, Role: LEADER
I20260709 13:07:22.630683 16823 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.631557 16673 consensus_queue.cc:260] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.632869 16673 raft_consensus.cc:3060] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.637058 16748 leader_election.cc:290] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 3 election: Requested vote from peers 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441), 1055cfdc4e484e97afd91e81eed5ec90 (127.6.215.67:36251)
I20260709 13:07:22.638036 16823 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 3.
I20260709 13:07:22.639158 16714 leader_election.cc:304] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1055cfdc4e484e97afd91e81eed5ec90, d21c8167e65e4fbd8b92afeb49447296; no voters: 
I20260709 13:07:22.639914 16897 raft_consensus.cc:2804] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:22.640040 16673 raft_consensus.cc:2468] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d21c8167e65e4fbd8b92afeb49447296 in term 3.
I20260709 13:07:22.640370 16897 raft_consensus.cc:697] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 3 LEADER]: Becoming Leader. State: Replica: d21c8167e65e4fbd8b92afeb49447296, State: Running, Role: LEADER
I20260709 13:07:22.641191 16897 consensus_queue.cc:237] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } }
I20260709 13:07:22.648370 16571 catalog_manager.cc:5697] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 reported cstate change: term changed from 2 to 3, leader changed from 3c01c878707640e590a27a5e31b45d60 (127.6.215.65) to d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66). New cstate: current_term: 3 leader_uuid: "d21c8167e65e4fbd8b92afeb49447296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c01c878707640e590a27a5e31b45d60" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d21c8167e65e4fbd8b92afeb49447296" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 38461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1055cfdc4e484e97afd91e81eed5ec90" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 36251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.733726  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
I20260709 13:07:22.752476  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:22.753079  7005 tablet_replica.cc:333] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60: stopping tablet replica
I20260709 13:07:22.753641  7005 raft_consensus.cc:2243] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.754035  7005 raft_consensus.cc:2272] T 1e5b4c450bb94c019615170617fa4921 P 3c01c878707640e590a27a5e31b45d60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.756228  7005 tablet_replica.cc:333] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: stopping tablet replica
I20260709 13:07:22.756695  7005 raft_consensus.cc:2243] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.757212  7005 pending_rounds.cc:70] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Trying to abort 2 pending ops.
I20260709 13:07:22.757395  7005 pending_rounds.cc:77] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635604126380032 op_type: NO_OP noop_request { }
I20260709 13:07:22.757651  7005 raft_consensus.cc:2889] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:22.757830  7005 pending_rounds.cc:77] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635602307235840 op_type: NO_OP noop_request { }
I20260709 13:07:22.758014  7005 raft_consensus.cc:2889] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:22.758214  7005 raft_consensus.cc:2272] T c5d7a5b80a1949c39a75276026d91b84 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.760216  7005 tablet_replica.cc:333] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60: stopping tablet replica
I20260709 13:07:22.760661  7005 raft_consensus.cc:2243] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.761025  7005 raft_consensus.cc:2272] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.763053  7005 tablet_replica.cc:333] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: stopping tablet replica
I20260709 13:07:22.763476  7005 raft_consensus.cc:2243] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.763995  7005 pending_rounds.cc:70] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: Trying to abort 1 pending ops.
I20260709 13:07:22.764140  7005 pending_rounds.cc:77] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635604027809792 op_type: NO_OP noop_request { }
I20260709 13:07:22.764349  7005 raft_consensus.cc:2889] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:22.764917  7005 raft_consensus.cc:2272] T 0a3de903bde9453a8ca84a93c7fc2881 P 3c01c878707640e590a27a5e31b45d60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.791373  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
I20260709 13:07:22.802806  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
I20260709 13:07:22.820725  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:22.822265  7005 tablet_replica.cc:333] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296: stopping tablet replica
I20260709 13:07:22.823161  7005 raft_consensus.cc:2243] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:22.823176 16787 consensus_peers.cc:597] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 -> Peer 3c01c878707640e590a27a5e31b45d60 (127.6.215.65:35441): Couldn't send request to peer 3c01c878707640e590a27a5e31b45d60. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:35441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.823869  7005 raft_consensus.cc:2272] T c5d7a5b80a1949c39a75276026d91b84 P d21c8167e65e4fbd8b92afeb49447296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.826424  7005 tablet_replica.cc:333] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: stopping tablet replica
I20260709 13:07:22.826937  7005 raft_consensus.cc:2243] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.827517  7005 pending_rounds.cc:70] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: Trying to abort 1 pending ops.
I20260709 13:07:22.827670  7005 pending_rounds.cc:77] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305635605067186176 op_type: NO_OP noop_request { }
I20260709 13:07:22.827916  7005 raft_consensus.cc:2889] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:22.828164  7005 raft_consensus.cc:2272] T 1e5b4c450bb94c019615170617fa4921 P d21c8167e65e4fbd8b92afeb49447296 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.830485  7005 tablet_replica.cc:333] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296: stopping tablet replica
I20260709 13:07:22.830958  7005 raft_consensus.cc:2243] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.831298  7005 raft_consensus.cc:2272] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.833192  7005 tablet_replica.cc:333] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296: stopping tablet replica
I20260709 13:07:22.833710  7005 raft_consensus.cc:2243] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.834043  7005 raft_consensus.cc:2272] T 0a3de903bde9453a8ca84a93c7fc2881 P d21c8167e65e4fbd8b92afeb49447296 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.856451  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
I20260709 13:07:22.868062  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
W20260709 13:07:22.874867 16789 consensus_peers.cc:597] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 -> Peer d21c8167e65e4fbd8b92afeb49447296 (127.6.215.66:38461): Couldn't send request to peer d21c8167e65e4fbd8b92afeb49447296. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:38461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.885154  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:22.886078  7005 tablet_replica.cc:333] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90: stopping tablet replica
I20260709 13:07:22.886727  7005 raft_consensus.cc:2243] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.887238  7005 raft_consensus.cc:2272] T c5d7a5b80a1949c39a75276026d91b84 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.889698  7005 tablet_replica.cc:333] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90: stopping tablet replica
I20260709 13:07:22.890326  7005 raft_consensus.cc:2243] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.890744  7005 raft_consensus.cc:2272] T 1e5b4c450bb94c019615170617fa4921 P 1055cfdc4e484e97afd91e81eed5ec90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.892660  7005 tablet_replica.cc:333] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90: stopping tablet replica
I20260709 13:07:22.893110  7005 raft_consensus.cc:2243] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.893568  7005 raft_consensus.cc:2272] T 0a3de903bde9453a8ca84a93c7fc2881 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.895696  7005 tablet_replica.cc:333] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: stopping tablet replica
I20260709 13:07:22.896118  7005 raft_consensus.cc:2243] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.896751  7005 pending_rounds.cc:70] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: Trying to abort 1 pending ops.
I20260709 13:07:22.896911  7005 pending_rounds.cc:77] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635603463196672 op_type: NO_OP noop_request { }
I20260709 13:07:22.897133  7005 raft_consensus.cc:2889] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:22.897389  7005 raft_consensus.cc:2272] T ed2de62d5a1d4a46a4c3fa38cac38fe8 P 1055cfdc4e484e97afd91e81eed5ec90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.919792  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
I20260709 13:07:22.931401  7005 master.cc:562] Master@127.6.215.126:34047 shutting down...
I20260709 13:07:22.948405  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.948971  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.949262  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc0b18b10fa24f668e1ff6e9a952c80f: stopping tablet replica
I20260709 13:07:22.967700  7005 master.cc:584] Master@127.6.215.126:34047 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2478 ms)
[----------] 6 tests from LeaderRebalancerTest (310551 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:07:22.998268  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:39177
I20260709 13:07:22.999432  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.004412 16918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.004681 16919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.006072 16921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.007167  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:23.007905  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.008073  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.008183  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602443008172 us; error 0 us; skew 500 ppm
I20260709 13:07:23.008780  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.011426  7005 webserver.cc:533] Webserver started at http://127.6.215.126:40735/ using document root <none> and password file <none>
I20260709 13:07:23.011930  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.012094  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.012318  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.013553  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "d736dd9bdb644e238f7e18f4c4f74075"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.017721  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:07:23.020921 16926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.021759  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:23.022028  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "d736dd9bdb644e238f7e18f4c4f74075"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.022285  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.062759  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.063747  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.104427  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:39177
I20260709 13:07:23.104539 16977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:39177 every 8 connection(s)
I20260709 13:07:23.108528 16978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.119832 16978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075: Bootstrap starting.
I20260709 13:07:23.124899 16978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.128942 16978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075: No bootstrap required, opened a new log
I20260709 13:07:23.130877 16978 raft_consensus.cc:359] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d736dd9bdb644e238f7e18f4c4f74075" member_type: VOTER }
I20260709 13:07:23.131220 16978 raft_consensus.cc:385] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.131418 16978 raft_consensus.cc:740] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d736dd9bdb644e238f7e18f4c4f74075, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.132396 16978 consensus_queue.cc:260] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d736dd9bdb644e238f7e18f4c4f74075" member_type: VOTER }
I20260709 13:07:23.132876 16978 raft_consensus.cc:399] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:23.133077 16978 raft_consensus.cc:493] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:23.133507 16978 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.138435 16978 raft_consensus.cc:515] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d736dd9bdb644e238f7e18f4c4f74075" member_type: VOTER }
I20260709 13:07:23.138893 16978 leader_election.cc:304] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d736dd9bdb644e238f7e18f4c4f74075; no voters: 
I20260709 13:07:23.139923 16978 leader_election.cc:290] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:23.140215 16981 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:23.141487 16981 raft_consensus.cc:697] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 1 LEADER]: Becoming Leader. State: Replica: d736dd9bdb644e238f7e18f4c4f74075, State: Running, Role: LEADER
I20260709 13:07:23.142108 16981 consensus_queue.cc:237] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d736dd9bdb644e238f7e18f4c4f74075" member_type: VOTER }
I20260709 13:07:23.142699 16978 sys_catalog.cc:565] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:23.144688 16982 sys_catalog.cc:455] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d736dd9bdb644e238f7e18f4c4f74075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d736dd9bdb644e238f7e18f4c4f74075" member_type: VOTER } }
I20260709 13:07:23.144743 16983 sys_catalog.cc:455] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d736dd9bdb644e238f7e18f4c4f74075. Latest consensus state: current_term: 1 leader_uuid: "d736dd9bdb644e238f7e18f4c4f74075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d736dd9bdb644e238f7e18f4c4f74075" member_type: VOTER } }
I20260709 13:07:23.145493 16982 sys_catalog.cc:458] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:23.146303 16983 sys_catalog.cc:458] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:23.147987 16986 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:23.156121 16986 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:23.157840  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:23.164980 16986 catalog_manager.cc:1383] Generated new cluster ID: 63426e154c5b40b8aa27555d3ef3cf93
I20260709 13:07:23.165253 16986 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:23.189823 16986 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:23.191092 16986 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:23.208218 16986 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075: Generated new TSK 0
I20260709 13:07:23.208813 16986 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:23.224994  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.231360 16999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.232040 17000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.233803 17002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.234917  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:23.236047  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.236243  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.236418  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602443236392 us; error 0 us; skew 500 ppm
I20260709 13:07:23.236917  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.239552  7005 webserver.cc:533] Webserver started at http://127.6.215.65:41343/ using document root <none> and password file <none>
I20260709 13:07:23.240011  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.240171  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.240451  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.241632  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.246958  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:23.250784 17007 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.251595  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:07:23.251896  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.252173  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.268953  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.270174  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.271651  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:23.273949  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:23.274145  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.274369  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:23.274511  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.317251  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:42227
I20260709 13:07:23.317399 17069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:42227 every 8 connection(s)
I20260709 13:07:23.321841  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.329615 17074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.329792 17075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.333845  7005 server_base.cc:1061] running on GCE node
W20260709 13:07:23.334000 17077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.335595  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:23.335806 17070 heartbeater.cc:344] Connected to a master server at 127.6.215.126:39177
W20260709 13:07:23.335858  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.336208  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602443336186 us; error 0 us; skew 500 ppm
I20260709 13:07:23.336252 17070 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:23.336771  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.337055 17070 heartbeater.cc:507] Master 127.6.215.126:39177 requested a full tablet report, sending...
I20260709 13:07:23.339390 16943 ts_manager.cc:194] Registered new tserver with Master: f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227)
I20260709 13:07:23.339432  7005 webserver.cc:533] Webserver started at http://127.6.215.66:45429/ using document root <none> and password file <none>
I20260709 13:07:23.340175  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.340428  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.340730  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.341776 16943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52234
I20260709 13:07:23.342137  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "65640e19115147f8acf6f371a65a0214"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.347146  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:23.351030 17082 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.352025  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:07:23.352450  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "65640e19115147f8acf6f371a65a0214"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.352721  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.371114  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.372102  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.373612  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:23.376307  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:23.376520  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.376925  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:23.377110  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.419811  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:37943
I20260709 13:07:23.419853 17144 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:37943 every 8 connection(s)
I20260709 13:07:23.424784  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.431712 17148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.434270 17149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.434397 17151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.435113  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:23.436900  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.437148  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.437386  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602443437336 us; error 0 us; skew 500 ppm
I20260709 13:07:23.437418 17145 heartbeater.cc:344] Connected to a master server at 127.6.215.126:39177
I20260709 13:07:23.437991 17145 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:23.438238  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.438753 17145 heartbeater.cc:507] Master 127.6.215.126:39177 requested a full tablet report, sending...
I20260709 13:07:23.440725  7005 webserver.cc:533] Webserver started at http://127.6.215.67:44215/ using document root <none> and password file <none>
I20260709 13:07:23.441026 16943 ts_manager.cc:194] Registered new tserver with Master: 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:23.441419  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.441723  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.442040  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.442821 16943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52238
I20260709 13:07:23.443532  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "5dced28973c34f6692b20138fab8a2b8"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.448417  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:23.452477 17156 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.453502  7005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:23.453786  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "5dced28973c34f6692b20138fab8a2b8"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-r31z"
I20260709 13:07:23.454073  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.479051  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.480078  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.481591  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:23.483709  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:23.483899  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.484110  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:23.484268  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.527432  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:42655
I20260709 13:07:23.527522 17218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:42655 every 8 connection(s)
I20260709 13:07:23.541402 17219 heartbeater.cc:344] Connected to a master server at 127.6.215.126:39177
I20260709 13:07:23.541946 17219 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:23.542647 17219 heartbeater.cc:507] Master 127.6.215.126:39177 requested a full tablet report, sending...
I20260709 13:07:23.544489 16943 ts_manager.cc:194] Registered new tserver with Master: 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:23.545775 16943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52244
I20260709 13:07:23.545811  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015399362s
I20260709 13:07:23.572175 16943 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52254:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:23.575022 16943 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:23.634117 17035 tablet_service.cc:1511] Processing CreateTablet for tablet a52b1a2917524e118d30fc4813508883 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.635442 17035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1a2917524e118d30fc4813508883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.638592 17033 tablet_service.cc:1511] Processing CreateTablet for tablet 25ff3fc31eec4a4f81333e037b0d2f79 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.639953 17033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ff3fc31eec4a4f81333e037b0d2f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.640802 17110 tablet_service.cc:1511] Processing CreateTablet for tablet a52b1a2917524e118d30fc4813508883 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.642122 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1a2917524e118d30fc4813508883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.642359 17032 tablet_service.cc:1511] Processing CreateTablet for tablet 9584437fedc242cabbc93bc1021ba0bf (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.642531 17108 tablet_service.cc:1511] Processing CreateTablet for tablet 25ff3fc31eec4a4f81333e037b0d2f79 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.643698 17108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ff3fc31eec4a4f81333e037b0d2f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.644449 17031 tablet_service.cc:1511] Processing CreateTablet for tablet 2328239e139e464fb35d7d777c47b620 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.646575 17034 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea4f02a1ba5442c82b9ac472ea116d8 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.648489 17032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9584437fedc242cabbc93bc1021ba0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.649703 17031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2328239e139e464fb35d7d777c47b620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.649761 17106 tablet_service.cc:1511] Processing CreateTablet for tablet 2328239e139e464fb35d7d777c47b620 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.651023 17034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea4f02a1ba5442c82b9ac472ea116d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.646634 17109 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea4f02a1ba5442c82b9ac472ea116d8 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.647881 17107 tablet_service.cc:1511] Processing CreateTablet for tablet 9584437fedc242cabbc93bc1021ba0bf (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.651144 17106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2328239e139e464fb35d7d777c47b620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.654382 17109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea4f02a1ba5442c82b9ac472ea116d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.655622 17107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9584437fedc242cabbc93bc1021ba0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.667165 17184 tablet_service.cc:1511] Processing CreateTablet for tablet a52b1a2917524e118d30fc4813508883 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.668663 17184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1a2917524e118d30fc4813508883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.670367 17183 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea4f02a1ba5442c82b9ac472ea116d8 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.671162 17105 tablet_service.cc:1511] Processing CreateTablet for tablet eb013bfd9de94bc08f91498855cfbd1e (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.672449 17105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb013bfd9de94bc08f91498855cfbd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.672796 17179 tablet_service.cc:1511] Processing CreateTablet for tablet eb013bfd9de94bc08f91498855cfbd1e (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.673854 17181 tablet_service.cc:1511] Processing CreateTablet for tablet 9584437fedc242cabbc93bc1021ba0bf (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.670104 17180 tablet_service.cc:1511] Processing CreateTablet for tablet 2328239e139e464fb35d7d777c47b620 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.671617 17183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea4f02a1ba5442c82b9ac472ea116d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.676101 17179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb013bfd9de94bc08f91498855cfbd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.676695 17181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9584437fedc242cabbc93bc1021ba0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.677459 17029 tablet_service.cc:1511] Processing CreateTablet for tablet 4329a755f77247878e0d59db0e3be79b (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.668051 17030 tablet_service.cc:1511] Processing CreateTablet for tablet eb013bfd9de94bc08f91498855cfbd1e (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.672700 17182 tablet_service.cc:1511] Processing CreateTablet for tablet 25ff3fc31eec4a4f81333e037b0d2f79 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.678762 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4329a755f77247878e0d59db0e3be79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.680030 17182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ff3fc31eec4a4f81333e037b0d2f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.681660 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb013bfd9de94bc08f91498855cfbd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.681689 17180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2328239e139e464fb35d7d777c47b620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.692910 17234 tablet_bootstrap.cc:492] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:23.700350 17234 tablet_bootstrap.cc:654] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.745299 17108 tablet_service.cc:1511] Processing CreateTablet for tablet 4329a755f77247878e0d59db0e3be79b (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.746654 17108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4329a755f77247878e0d59db0e3be79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.749759 17178 tablet_service.cc:1511] Processing CreateTablet for tablet 4329a755f77247878e0d59db0e3be79b (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.751047 17178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4329a755f77247878e0d59db0e3be79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.761902 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 57e03d9f0d2741958a6827035af32691 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.763301 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e03d9f0d2741958a6827035af32691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.765089 17177 tablet_service.cc:1511] Processing CreateTablet for tablet 57e03d9f0d2741958a6827035af32691 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.766528 17177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e03d9f0d2741958a6827035af32691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.766462 17104 tablet_service.cc:1511] Processing CreateTablet for tablet 57e03d9f0d2741958a6827035af32691 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.770123 17104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e03d9f0d2741958a6827035af32691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.779376 17027 tablet_service.cc:1511] Processing CreateTablet for tablet cf321c9ca5c34ceb97c2b8a81a136e38 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.781085 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf321c9ca5c34ceb97c2b8a81a136e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.780912 17103 tablet_service.cc:1511] Processing CreateTablet for tablet cf321c9ca5c34ceb97c2b8a81a136e38 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.782431 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf321c9ca5c34ceb97c2b8a81a136e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.798113 17176 tablet_service.cc:1511] Processing CreateTablet for tablet cf321c9ca5c34ceb97c2b8a81a136e38 (DEFAULT_TABLE table=test-workload [id=ef006597a1bf437c9469c8cbd7688122]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.799965 17176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf321c9ca5c34ceb97c2b8a81a136e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.814741 17235 tablet_bootstrap.cc:492] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:23.838925 17234 tablet_bootstrap.cc:492] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:23.839486 17234 ts_tablet_manager.cc:1403] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.018s
I20260709 13:07:23.843101 17235 tablet_bootstrap.cc:654] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.845568 17234 raft_consensus.cc:359] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.850736 17237 tablet_bootstrap.cc:492] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:23.847601 17234 raft_consensus.cc:385] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.854856 17234 raft_consensus.cc:740] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.855986 17234 consensus_queue.cc:260] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.868340 17237 tablet_bootstrap.cc:654] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.874161 17235 tablet_bootstrap.cc:492] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:23.874689 17235 ts_tablet_manager.cc:1403] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.008s
I20260709 13:07:23.876021 17145 heartbeater.cc:499] Master 127.6.215.126:39177 was elected leader, sending a full tablet report...
I20260709 13:07:23.876106 17234 ts_tablet_manager.cc:1434] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.036s	user 0.015s	sys 0.011s
I20260709 13:07:23.877247 17234 tablet_bootstrap.cc:492] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:23.877592 17235 raft_consensus.cc:359] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.878335 17235 raft_consensus.cc:385] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.878619 17235 raft_consensus.cc:740] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.883826 17234 tablet_bootstrap.cc:654] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.884159 17235 consensus_queue.cc:260] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.885893 17237 tablet_bootstrap.cc:492] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:23.886416 17237 ts_tablet_manager.cc:1403] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.009s
I20260709 13:07:23.889407 17237 raft_consensus.cc:359] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.890149 17237 raft_consensus.cc:385] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.890439 17237 raft_consensus.cc:740] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.891274 17237 consensus_queue.cc:260] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.894451 17235 ts_tablet_manager.cc:1434] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:07:23.895200 17219 heartbeater.cc:499] Master 127.6.215.126:39177 was elected leader, sending a full tablet report...
I20260709 13:07:23.896938 17234 tablet_bootstrap.cc:492] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:23.897589 17234 ts_tablet_manager.cc:1403] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 13:07:23.900439 17234 raft_consensus.cc:359] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.901232 17234 raft_consensus.cc:385] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.901643 17234 raft_consensus.cc:740] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.902503 17234 consensus_queue.cc:260] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.903559 17235 tablet_bootstrap.cc:492] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:23.905170 17237 ts_tablet_manager.cc:1434] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:07:23.905490 17234 ts_tablet_manager.cc:1434] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:23.906704 17234 tablet_bootstrap.cc:492] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:23.909775 17070 heartbeater.cc:499] Master 127.6.215.126:39177 was elected leader, sending a full tablet report...
I20260709 13:07:23.910063 17235 tablet_bootstrap.cc:654] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.911971 17234 tablet_bootstrap.cc:654] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.915256 17237 tablet_bootstrap.cc:492] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:23.922508 17237 tablet_bootstrap.cc:654] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.946789 17235 tablet_bootstrap.cc:492] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:23.947306 17235 ts_tablet_manager.cc:1403] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.012s
I20260709 13:07:23.947647 17237 tablet_bootstrap.cc:492] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:23.948199 17237 ts_tablet_manager.cc:1403] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.014s
I20260709 13:07:23.948521 17234 tablet_bootstrap.cc:492] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:23.949007 17234 ts_tablet_manager.cc:1403] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.023s
I20260709 13:07:23.949579 17235 raft_consensus.cc:359] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.950222 17235 raft_consensus.cc:385] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.950446 17235 raft_consensus.cc:740] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.950719 17237 raft_consensus.cc:359] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.951447 17237 raft_consensus.cc:385] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.951059 17235 consensus_queue.cc:260] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.951802 17237 raft_consensus.cc:740] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.951671 17234 raft_consensus.cc:359] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.952425 17234 raft_consensus.cc:385] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.952698 17234 raft_consensus.cc:740] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.952780 17237 consensus_queue.cc:260] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.953670 17235 ts_tablet_manager.cc:1434] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:23.953554 17234 consensus_queue.cc:260] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.954933 17235 tablet_bootstrap.cc:492] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:23.955268 17237 ts_tablet_manager.cc:1434] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:23.956218 17237 tablet_bootstrap.cc:492] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:23.956769 17234 ts_tablet_manager.cc:1434] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:23.957749 17234 tablet_bootstrap.cc:492] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:23.961486 17235 tablet_bootstrap.cc:654] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.963047 17237 tablet_bootstrap.cc:654] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.963217 17234 tablet_bootstrap.cc:654] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.971010 17237 tablet_bootstrap.cc:492] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:23.971554 17237 ts_tablet_manager.cc:1403] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 13:07:23.975835 17237 raft_consensus.cc:359] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.976583 17237 raft_consensus.cc:385] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.976872 17237 raft_consensus.cc:740] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.978528 17237 consensus_queue.cc:260] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.981928 17237 ts_tablet_manager.cc:1434] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:07:23.981976 17234 tablet_bootstrap.cc:492] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:23.982537 17234 ts_tablet_manager.cc:1403] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.010s
I20260709 13:07:23.982955 17237 tablet_bootstrap.cc:492] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:23.985128 17235 tablet_bootstrap.cc:492] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:23.985780 17235 ts_tablet_manager.cc:1403] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.014s
I20260709 13:07:23.985172 17234 raft_consensus.cc:359] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.986152 17234 raft_consensus.cc:385] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.986469 17234 raft_consensus.cc:740] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.987366 17234 consensus_queue.cc:260] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.989100 17237 tablet_bootstrap.cc:654] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.989845 17234 ts_tablet_manager.cc:1434] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:07:23.990862 17234 tablet_bootstrap.cc:492] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:23.991745 17235 raft_consensus.cc:359] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.992475 17235 raft_consensus.cc:385] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.992753 17235 raft_consensus.cc:740] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.992908 17239 raft_consensus.cc:493] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.993602 17239 raft_consensus.cc:515] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:23.993660 17235 consensus_queue.cc:260] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.002807 17237 tablet_bootstrap.cc:492] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:24.003456 17237 ts_tablet_manager.cc:1403] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:07:24.004865 17239 leader_election.cc:290] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.011143 17237 raft_consensus.cc:359] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.011778 17234 tablet_bootstrap.cc:654] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.011941 17237 raft_consensus.cc:385] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.012516 17237 raft_consensus.cc:740] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.013325 17237 consensus_queue.cc:260] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.015478 17237 ts_tablet_manager.cc:1434] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:07:24.016587 17237 tablet_bootstrap.cc:492] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:24.018573 17239 raft_consensus.cc:493] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.019094 17239 raft_consensus.cc:515] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.021154 17239 leader_election.cc:290] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.022830 17237 tablet_bootstrap.cc:654] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.023531 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.023874 17234 tablet_bootstrap.cc:492] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:24.024210 17044 raft_consensus.cc:2468] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.024544 17234 ts_tablet_manager.cc:1403] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.007s
I20260709 13:07:24.025695 17083 leader_election.cc:304] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.026970 17239 raft_consensus.cc:2804] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.027314 17239 raft_consensus.cc:493] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.024590 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.027549 17234 raft_consensus.cc:359] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.028353 17234 raft_consensus.cc:385] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.028425 17237 tablet_bootstrap.cc:492] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:24.028700 17234 raft_consensus.cc:740] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.029110 17237 ts_tablet_manager.cc:1403] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
W20260709 13:07:24.029163 17083 leader_election.cc:343] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.027650 17239 raft_consensus.cc:3060] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.029515 17234 consensus_queue.cc:260] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.031941 17237 raft_consensus.cc:359] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.033506 17237 raft_consensus.cc:385] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.033784 17237 raft_consensus.cc:740] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.034490 17237 consensus_queue.cc:260] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.036248 17237 ts_tablet_manager.cc:1434] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:07:24.037115 17243 raft_consensus.cc:493] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.037560 17237 tablet_bootstrap.cc:492] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:24.037748 17243 raft_consensus.cc:515] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.011910 17235 ts_tablet_manager.cc:1434] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 13:07:24.050845 17239 raft_consensus.cc:515] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.051934 17235 tablet_bootstrap.cc:492] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:24.076850 17237 tablet_bootstrap.cc:654] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.077176 17235 tablet_bootstrap.cc:654] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.084447 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.085136 17045 raft_consensus.cc:3060] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.094178 17045 raft_consensus.cc:2468] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.095528 17083 leader_election.cc:304] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.096596 17243 leader_election.cc:290] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.105226 17241 raft_consensus.cc:493] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.105822 17241 raft_consensus.cc:515] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.106922 17261 raft_consensus.cc:2804] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.107410 17261 raft_consensus.cc:697] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.108439 17241 leader_election.cc:290] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:24.108186 17261 consensus_queue.cc:237] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.112140 17239 leader_election.cc:290] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.118690 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.119655 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.120201 17237 tablet_bootstrap.cc:492] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:24.120654 17237 ts_tablet_manager.cc:1403] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.083s	user 0.022s	sys 0.015s
I20260709 13:07:24.121011 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
W20260709 13:07:24.122424 17086 leader_election.cc:343] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.122854 17086 leader_election.cc:304] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65640e19115147f8acf6f371a65a0214; no voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.123278 17237 raft_consensus.cc:359] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
W20260709 13:07:24.124020 17086 leader_election.cc:343] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.124255 17237 raft_consensus.cc:385] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.124581 17237 raft_consensus.cc:740] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
W20260709 13:07:24.125029 17086 leader_election.cc:343] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.125283 17237 consensus_queue.cc:260] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.127511 17237 ts_tablet_manager.cc:1434] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:07:24.126034 17239 raft_consensus.cc:2749] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.128506 17237 tablet_bootstrap.cc:492] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:24.134572 17235 tablet_bootstrap.cc:492] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:24.135185 17235 ts_tablet_manager.cc:1403] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.017s
I20260709 13:07:24.136529 17237 tablet_bootstrap.cc:654] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.143327 17234 ts_tablet_manager.cc:1434] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.118s	user 0.026s	sys 0.030s
I20260709 13:07:24.144642 17234 tablet_bootstrap.cc:492] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:24.150637 17234 tablet_bootstrap.cc:654] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.151041 17237 tablet_bootstrap.cc:492] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:24.151598 17237 ts_tablet_manager.cc:1403] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
W20260709 13:07:24.153272 16991 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:24.154126 17243 raft_consensus.cc:493] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.154647 17243 raft_consensus.cc:515] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.155184 17237 raft_consensus.cc:359] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.150240 17235 raft_consensus.cc:359] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.157053 17243 leader_election.cc:290] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.155962 17237 raft_consensus.cc:385] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.159873 17237 raft_consensus.cc:740] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.160733 17237 consensus_queue.cc:260] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.161556 17235 raft_consensus.cc:385] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.162174 17235 raft_consensus.cc:740] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.164937 17235 consensus_queue.cc:260] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.167212 17235 ts_tablet_manager.cc:1434] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:07:24.164498 16939 catalog_manager.cc:5697] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.168239 17235 tablet_bootstrap.cc:492] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:24.170284 17241 raft_consensus.cc:493] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.170694 17261 raft_consensus.cc:493] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.170769 17241 raft_consensus.cc:515] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.171342 17261 raft_consensus.cc:515] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.172943 17241 leader_election.cc:290] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:24.164160 17237 ts_tablet_manager.cc:1434] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:24.174201 17237 tablet_bootstrap.cc:492] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:24.175223 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.175938 17192 raft_consensus.cc:2468] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.175679 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.177397 17086 leader_election.cc:304] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:24.178339 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.178483 17255 raft_consensus.cc:2804] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.178965 17255 raft_consensus.cc:493] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.179292 17255 raft_consensus.cc:3060] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:24.179586 17008 leader_election.cc:343] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.182180 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.182890 17045 raft_consensus.cc:2468] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.183630 17237 tablet_bootstrap.cc:654] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.187790 17235 tablet_bootstrap.cc:654] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.178977 17120 raft_consensus.cc:2468] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 0.
I20260709 13:07:24.183652 17261 leader_election.cc:290] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.193431 17234 tablet_bootstrap.cc:492] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:24.194247 17234 ts_tablet_manager.cc:1403] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.050s	user 0.034s	sys 0.012s
I20260709 13:07:24.197463 17234 raft_consensus.cc:359] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.198233 17234 raft_consensus.cc:385] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.198577 17234 raft_consensus.cc:740] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.199496 17255 raft_consensus.cc:515] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.199970 17234 consensus_queue.cc:260] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.201606 17008 leader_election.cc:304] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.201646 17241 raft_consensus.cc:493] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.202639 17234 ts_tablet_manager.cc:1434] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:24.202528 17241 raft_consensus.cc:515] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.203764 17234 tablet_bootstrap.cc:492] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:24.204460 17241 leader_election.cc:290] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:24.202534 17243 raft_consensus.cc:2804] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.205369 17243 raft_consensus.cc:493] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.205674 17243 raft_consensus.cc:3060] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.208823 17237 tablet_bootstrap.cc:492] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:24.208945 17261 raft_consensus.cc:493] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.209471 17261 raft_consensus.cc:515] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.209770 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.210340 17045 raft_consensus.cc:3060] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.210685 17234 tablet_bootstrap.cc:654] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.211311 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.211939 17044 raft_consensus.cc:2468] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:24.212987 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.213878 17237 ts_tablet_manager.cc:1403] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.008s
I20260709 13:07:24.214520 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.216212 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.216806 17261 leader_election.cc:290] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.216956 17237 raft_consensus.cc:359] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.217736 17237 raft_consensus.cc:385] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.218191 17237 raft_consensus.cc:740] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.218951 17237 consensus_queue.cc:260] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.219772 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4329a755f77247878e0d59db0e3be79b" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.220407 17042 raft_consensus.cc:2468] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.221385 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.226378 17192 raft_consensus.cc:3060] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.222694 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.217963 17255 leader_election.cc:290] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
W20260709 13:07:24.223721 17011 leader_election.cc:343] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.227761 17011 leader_election.cc:304] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214
I20260709 13:07:24.223928 17157 leader_election.cc:304] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.218849 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4329a755f77247878e0d59db0e3be79b" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.239543 17194 raft_consensus.cc:2468] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
W20260709 13:07:24.240197 17157 leader_election.cc:343] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.241199 17241 raft_consensus.cc:2804] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.242029 17241 raft_consensus.cc:493] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.242553 17241 raft_consensus.cc:3060] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.222432 17083 leader_election.cc:304] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.246240 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.246959 17120 raft_consensus.cc:2468] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:24.249558 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.252187 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.252437 17243 raft_consensus.cc:515] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.250664 17255 raft_consensus.cc:2804] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.255115 17120 raft_consensus.cc:2393] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dced28973c34f6692b20138fab8a2b8 in current term 1: Already voted for candidate 65640e19115147f8acf6f371a65a0214 in this term.
I20260709 13:07:24.251678 17261 raft_consensus.cc:493] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.259775 17011 leader_election.cc:343] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:24.260987 17157 leader_election.cc:343] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.261639 17157 leader_election.cc:304] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8; no voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.264645 17235 tablet_bootstrap.cc:492] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:24.265218 17235 ts_tablet_manager.cc:1403] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.015s
I20260709 13:07:24.265504 17192 raft_consensus.cc:2468] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.266610 17086 leader_election.cc:304] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:24.267323 17261 raft_consensus.cc:515] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.269084 17239 raft_consensus.cc:2804] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.258901 17255 raft_consensus.cc:493] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.270046 17235 raft_consensus.cc:359] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.271791 17255 raft_consensus.cc:3060] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.277977 17235 raft_consensus.cc:385] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.278698 17235 raft_consensus.cc:740] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.279707 17243 leader_election.cc:290] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.279431 17235 consensus_queue.cc:260] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.269536 17274 raft_consensus.cc:2749] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.280339 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:24.282325 17239 raft_consensus.cc:697] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.283272 17239 consensus_queue.cc:237] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.284667 17261 leader_election.cc:290] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.285709 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.291004 17275 raft_consensus.cc:2749] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.295490 17237 ts_tablet_manager.cc:1434] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.081s	user 0.026s	sys 0.013s
I20260709 13:07:24.296224 17237 tablet_bootstrap.cc:492] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:24.292995 17042 raft_consensus.cc:2468] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.299274 17083 leader_election.cc:304] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.300747 17261 raft_consensus.cc:2804] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.301188 17261 raft_consensus.cc:493] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.301570 17261 raft_consensus.cc:3060] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.301914 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
W20260709 13:07:24.303252 17086 leader_election.cc:343] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.293213 17274 raft_consensus.cc:493] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.293287 17120 raft_consensus.cc:3060] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.304100 17255 raft_consensus.cc:515] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.306593 17255 leader_election.cc:290] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
W20260709 13:07:24.309433 17157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37943, user_credentials={real_user=slave}} blocked reactor thread for 48482.5us
I20260709 13:07:24.304078 17274 raft_consensus.cc:515] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.310304 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4329a755f77247878e0d59db0e3be79b" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.310890 17192 raft_consensus.cc:3060] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.311652 17274 leader_election.cc:290] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.312676 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
W20260709 13:07:24.314711 17008 leader_election.cc:343] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.315809 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.316340 17194 raft_consensus.cc:3060] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.318534 17237 tablet_bootstrap.cc:654] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.318554 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4329a755f77247878e0d59db0e3be79b" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.320096 17042 raft_consensus.cc:3060] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.320181 17235 ts_tablet_manager.cc:1434] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.055s	user 0.022s	sys 0.016s
I20260709 13:07:24.322419 17235 tablet_bootstrap.cc:492] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:24.324522 17234 tablet_bootstrap.cc:492] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:24.325016 17234 ts_tablet_manager.cc:1403] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.121s	user 0.050s	sys 0.026s
I20260709 13:07:24.327872 17234 raft_consensus.cc:359] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.328591 17234 raft_consensus.cc:385] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.328929 17234 raft_consensus.cc:740] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.328934 17194 raft_consensus.cc:2468] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 1.
I20260709 13:07:24.330130 17045 raft_consensus.cc:2468] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.331362 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.331362 17157 leader_election.cc:304] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8; no voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d
W20260709 13:07:24.332965 17011 leader_election.cc:343] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.333408 17011 leader_election.cc:304] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214
I20260709 13:07:24.329869 17234 consensus_queue.cc:260] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.335278 17274 raft_consensus.cc:2749] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.337020 17278 raft_consensus.cc:2749] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.338104 17234 ts_tablet_manager.cc:1434] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:24.339234 17234 tablet_bootstrap.cc:492] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:24.339753 17042 raft_consensus.cc:2468] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.340410 17235 tablet_bootstrap.cc:654] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.341013 17083 leader_election.cc:304] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.339115 17120 raft_consensus.cc:2468] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 1.
I20260709 13:07:24.341974 17276 raft_consensus.cc:2804] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.342905 17276 raft_consensus.cc:697] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.342972 17011 leader_election.cc:304] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.328352 17192 raft_consensus.cc:2468] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.344221 17274 raft_consensus.cc:2804] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.343832 17276 consensus_queue.cc:237] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.344751 17274 raft_consensus.cc:697] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:24.347282 17274 consensus_queue.cc:237] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.351215 17234 tablet_bootstrap.cc:654] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.346099 17261 raft_consensus.cc:515] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.346797 17241 raft_consensus.cc:515] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.357887 17261 leader_election.cc:290] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.358952 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.359382 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.360311 17042 raft_consensus.cc:3060] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.363761 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.364418 17045 raft_consensus.cc:3060] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:24.365641 17086 leader_election.cc:343] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.372400 16939 catalog_manager.cc:5697] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.373966 17042 raft_consensus.cc:2468] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.375362 17083 leader_election.cc:304] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:24.375150 16939 catalog_manager.cc:5697] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.376647 17261 raft_consensus.cc:2804] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.377166 17261 raft_consensus.cc:697] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.378028 17261 consensus_queue.cc:237] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.379419 17045 raft_consensus.cc:2468] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:24.380681 17157 leader_election.cc:304] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.381588 17278 raft_consensus.cc:2804] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.382061 17278 raft_consensus.cc:697] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:24.382841 17278 consensus_queue.cc:237] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.389190 17234 tablet_bootstrap.cc:492] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:24.389708 17234 ts_tablet_manager.cc:1403] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.005s
I20260709 13:07:24.390885 17235 tablet_bootstrap.cc:492] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:24.391419 17235 ts_tablet_manager.cc:1403] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.069s	user 0.005s	sys 0.020s
I20260709 13:07:24.391821 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:24.389954 17241 leader_election.cc:290] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:24.392500 17120 raft_consensus.cc:3060] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.396293 17276 raft_consensus.cc:493] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.397260 17276 raft_consensus.cc:515] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.401960 17234 raft_consensus.cc:359] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.402702 17234 raft_consensus.cc:385] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.402958 17234 raft_consensus.cc:740] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.402228 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.403702 17276 leader_election.cc:290] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.403591 17234 consensus_queue.cc:260] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.403275 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.403345 16941 catalog_manager.cc:5697] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 0 to 1, leader changed from <none> to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 1 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.404907 17045 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.405900 17234 ts_tablet_manager.cc:1434] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:07:24.406314 17083 leader_election.cc:304] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.406797 17234 tablet_bootstrap.cc:492] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:24.407159 17255 raft_consensus.cc:2804] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.407522 17255 raft_consensus.cc:493] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.407819 17255 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.408349 17120 raft_consensus.cc:2468] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:24.411155 17237 tablet_bootstrap.cc:492] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:24.411631 17237 ts_tablet_manager.cc:1403] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.023s
I20260709 13:07:24.412947 17234 tablet_bootstrap.cc:654] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.413221 17276 raft_consensus.cc:493] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.413722 17276 raft_consensus.cc:515] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.419049 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.419721 17045 raft_consensus.cc:2468] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.420223 17237 raft_consensus.cc:359] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.420887 17237 raft_consensus.cc:385] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.401820 17235 raft_consensus.cc:359] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.421563 17235 raft_consensus.cc:385] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.421929 17235 raft_consensus.cc:740] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.422890 17235 consensus_queue.cc:260] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.421186 17237 raft_consensus.cc:740] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.423703 17083 leader_election.cc:304] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.424355 17237 consensus_queue.cc:260] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.424736 17239 raft_consensus.cc:2804] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.425202 17239 raft_consensus.cc:493] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.425658 17239 raft_consensus.cc:3060] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.426302 17237 ts_tablet_manager.cc:1434] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:24.426338 17235 ts_tablet_manager.cc:1434] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:07:24.427690 17235 tablet_bootstrap.cc:492] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:24.433694 17192 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:24.434221 16941 catalog_manager.cc:5697] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.436318 17235 tablet_bootstrap.cc:654] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.447847 17255 raft_consensus.cc:515] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.450846 17276 leader_election.cc:290] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.453279 17239 raft_consensus.cc:515] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.454650 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
W20260709 13:07:24.456243 17086 leader_election.cc:343] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.456415 17239 leader_election.cc:290] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.458047 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.458281 17255 leader_election.cc:290] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
W20260709 13:07:24.460984 17086 leader_election.cc:343] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.461553 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.464704 17194 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.463225 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.467334 17045 raft_consensus.cc:3060] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.467937 17234 tablet_bootstrap.cc:492] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:24.468436 17234 ts_tablet_manager.cc:1403] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.062s	user 0.044s	sys 0.015s
I20260709 13:07:24.463974 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:24.469524 17235 tablet_bootstrap.cc:492] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:24.470132 17235 ts_tablet_manager.cc:1403] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.014s
I20260709 13:07:24.471182 17234 raft_consensus.cc:359] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.471829 17234 raft_consensus.cc:385] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.471942 17194 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.472155 17234 raft_consensus.cc:740] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.469620 17042 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.472967 17234 consensus_queue.cc:260] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.473287 17235 raft_consensus.cc:359] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.474483 17235 raft_consensus.cc:385] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.474834 17235 raft_consensus.cc:740] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.474131 17086 leader_election.cc:304] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:24.475898 17234 ts_tablet_manager.cc:1434] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:24.475827 17235 consensus_queue.cc:260] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.479245 17255 raft_consensus.cc:2804] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.479739 17255 raft_consensus.cc:697] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.479032 16940 catalog_manager.cc:5697] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.479269 17235 ts_tablet_manager.cc:1434] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:07:24.480520 17255 consensus_queue.cc:237] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.479074 17045 raft_consensus.cc:2468] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.482558 17083 leader_election.cc:304] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:24.482769 17235 tablet_bootstrap.cc:492] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:24.483335 17261 raft_consensus.cc:2804] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.483850 17261 raft_consensus.cc:697] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.484537 17261 consensus_queue.cc:237] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.490433 17235 tablet_bootstrap.cc:654] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.492050 17042 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:24.495214 17235 tablet_bootstrap.cc:492] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:24.495788 17235 ts_tablet_manager.cc:1403] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:07:24.498095 17235 raft_consensus.cc:359] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.498571 17235 raft_consensus.cc:385] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.498773 17235 raft_consensus.cc:740] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.499285 17235 consensus_queue.cc:260] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.501809 17235 ts_tablet_manager.cc:1434] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:24.502733 17235 tablet_bootstrap.cc:492] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:24.506634 16942 catalog_manager.cc:5697] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.508033 17235 tablet_bootstrap.cc:654] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.508332 16942 catalog_manager.cc:5697] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.514204 17235 tablet_bootstrap.cc:492] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:24.514652 17235 ts_tablet_manager.cc:1403] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:07:24.517079 17235 raft_consensus.cc:359] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.517887 17235 raft_consensus.cc:385] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.518133 17235 raft_consensus.cc:740] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.518900 17235 consensus_queue.cc:260] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.520521 17235 ts_tablet_manager.cc:1434] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:24.563424 17194 raft_consensus.cc:3060] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.569769 17261 consensus_queue.cc:1048] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.581225 17261 consensus_queue.cc:1048] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.726168 17261 consensus_queue.cc:1048] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.738114 17261 consensus_queue.cc:1048] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.747428 17274 raft_consensus.cc:493] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.748045 17274 raft_consensus.cc:515] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.750097 17274 leader_election.cc:290] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.750756 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.751313 17120 raft_consensus.cc:2468] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 0.
I20260709 13:07:24.751246 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:24.752053 17194 raft_consensus.cc:2468] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 0.
I20260709 13:07:24.752619 17008 leader_election.cc:304] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.753425 17274 raft_consensus.cc:2804] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.753827 17274 raft_consensus.cc:493] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.754221 17274 raft_consensus.cc:3060] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.756395 17261 consensus_queue.cc:1048] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.760757 17274 raft_consensus.cc:515] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.765122 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:24.765791 17120 raft_consensus.cc:3060] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.773084 17255 consensus_queue.cc:1048] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.774055 17120 raft_consensus.cc:2468] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 1.
I20260709 13:07:24.775316 17008 leader_election.cc:304] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:24.776302 17274 leader_election.cc:290] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.777333 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:24.777918 17192 raft_consensus.cc:3060] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.778268 17194 raft_consensus.cc:3060] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.782114 17272 raft_consensus.cc:2804] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.784997 17272 raft_consensus.cc:697] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:24.785887 17272 consensus_queue.cc:237] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.786717 17194 raft_consensus.cc:2468] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 1.
I20260709 13:07:24.786875 17261 consensus_queue.cc:1048] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.798966 16940 catalog_manager.cc:5697] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 0 to 1, leader changed from <none> to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 1 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.811931 17272 consensus_queue.cc:1048] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.815743 17261 consensus_queue.cc:1048] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.829166 17274 consensus_queue.cc:1048] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.882740 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a52b1a2917524e118d30fc4813508883"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:56806
I20260709 13:07:24.883270 17120 raft_consensus.cc:606] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.897184 17194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:07:24.897994 17194 raft_consensus.cc:606] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.902967 17261 consensus_queue.cc:1048] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.904685 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:56806
I20260709 13:07:24.905387 17120 raft_consensus.cc:606] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.910306 17276 raft_consensus.cc:993] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:24.910545 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:56806
I20260709 13:07:24.910742 17276 raft_consensus.cc:1081] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:24.911207 17120 raft_consensus.cc:606] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.913175 17045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a52b1a2917524e118d30fc4813508883"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55814
I20260709 13:07:24.913851 17045 raft_consensus.cc:493] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.914243 17045 raft_consensus.cc:3060] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.916154 17194 raft_consensus.cc:3060] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.919446 17278 consensus_queue.cc:1048] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.923837 17278 consensus_queue.cc:1048] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.928146 17239 consensus_queue.cc:1048] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.938042 17278 raft_consensus.cc:493] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.938980 17278 raft_consensus.cc:515] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.942610 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:24.944550 17278 leader_election.cc:290] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227)
I20260709 13:07:24.944950 17239 consensus_queue.cc:1048] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.946677 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:24.947083 17045 raft_consensus.cc:515] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.948426 17042 raft_consensus.cc:1240] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Rejecting Update request from peer 65640e19115147f8acf6f371a65a0214 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:24.948834 17157 leader_election.cc:304] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8; no voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:24.951838 17239 consensus_queue.cc:1059] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.953336 17261 raft_consensus.cc:3055] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:24.953753 17261 raft_consensus.cc:740] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:24.954573 17261 consensus_queue.cc:260] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:24.955495 17261 raft_consensus.cc:3060] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.957412 17045 leader_election.cc:290] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:24.958578 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:24.963434 17045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2328239e139e464fb35d7d777c47b620"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
mode: GRACEFUL
new_leader_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:55828
I20260709 13:07:24.964105 17045 raft_consensus.cc:606] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Received request to transfer leadership to TS 65640e19115147f8acf6f371a65a0214
I20260709 13:07:25.000669 17255 consensus_queue.cc:1048] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.003234 17120 raft_consensus.cc:2468] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.005908 17241 raft_consensus.cc:2749] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:25.007138 17008 leader_election.cc:304] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:25.008221 17301 raft_consensus.cc:2804] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.008749 17301 raft_consensus.cc:697] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:25.009665 17301 consensus_queue.cc:237] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.012125 17317 raft_consensus.cc:993] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:25.013836 17317 raft_consensus.cc:1081] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:25.022444 17043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e03d9f0d2741958a6827035af32691"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
mode: GRACEFUL
new_leader_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:55828
I20260709 13:07:25.023057 17043 raft_consensus.cc:606] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Received request to transfer leadership to TS 65640e19115147f8acf6f371a65a0214
W20260709 13:07:25.025900 17157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:42227, user_credentials={real_user=slave}} blocked reactor thread for 46148.1us
I20260709 13:07:25.031675 17119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:56806
I20260709 13:07:25.033269 17119 raft_consensus.cc:606] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:25.034471 17043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:07:25.035153 17043 raft_consensus.cc:493] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.035588 17043 raft_consensus.cc:3060] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.037274 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1a2917524e118d30fc4813508883" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:25.038172 17192 raft_consensus.cc:3060] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.045816 17192 raft_consensus.cc:2468] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.046608 17043 raft_consensus.cc:515] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.047672 17042 raft_consensus.cc:1240] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Rejecting Update request from peer 5dced28973c34f6692b20138fab8a2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:25.050068 17261 raft_consensus.cc:993] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:25.050580 17261 raft_consensus.cc:1081] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:25.051723 17278 consensus_queue.cc:1059] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.052727 17321 raft_consensus.cc:3055] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.053079 17321 raft_consensus.cc:740] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:25.054028 17042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55814
I20260709 13:07:25.053663 16942 catalog_manager.cc:5697] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.055052 17042 raft_consensus.cc:493] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.054018 17321 consensus_queue.cc:260] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.055616 17042 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.056141 17321 raft_consensus.cc:3060] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.059552 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:25.060177 17119 raft_consensus.cc:3060] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.066064 17043 leader_election.cc:290] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:25.068035 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea4f02a1ba5442c82b9ac472ea116d8" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:25.068531 17119 raft_consensus.cc:2468] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.070214 17008 leader_election.cc:304] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:25.071313 17301 raft_consensus.cc:2804] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.072078 17301 raft_consensus.cc:697] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:25.073153 17301 consensus_queue.cc:237] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.075670 17194 raft_consensus.cc:2468] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.079916 17042 raft_consensus.cc:515] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.081836 17042 leader_election.cc:290] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:25.082662 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:25.083714 17119 raft_consensus.cc:3055] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.083994 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:25.084010 17119 raft_consensus.cc:740] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:25.085326 17119 consensus_queue.cc:260] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.086643 17119 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.086790 16942 catalog_manager.cc:5697] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.084661 17192 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.094244 17119 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.095590 17192 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.095610 17008 leader_election.cc:304] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:25.096679 17301 raft_consensus.cc:2804] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.097136 17301 raft_consensus.cc:697] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:25.097949 17301 consensus_queue.cc:237] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.110493 16942 catalog_manager.cc:5697] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.201808 17301 consensus_queue.cc:1048] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:25.209769 17307 raft_consensus.cc:993] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: : Instructing follower 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:25.210249 17274 raft_consensus.cc:1081] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Signalling peer 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:25.211822 17239 raft_consensus.cc:993] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:25.212555 17239 raft_consensus.cc:1081] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:25.212472 17120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e03d9f0d2741958a6827035af32691"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:56776
I20260709 13:07:25.214473 17120 raft_consensus.cc:493] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.214870 17120 raft_consensus.cc:3060] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.215233 17042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55814
I20260709 13:07:25.215821 17042 raft_consensus.cc:493] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.216200 17042 raft_consensus.cc:3060] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.219732 17301 consensus_queue.cc:1048] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.221921 17120 raft_consensus.cc:515] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.222947 17042 raft_consensus.cc:515] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.227535 17042 leader_election.cc:290] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:25.228710 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:25.228965 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ff3fc31eec4a4f81333e037b0d2f79" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:25.229496 17119 raft_consensus.cc:3055] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.229833 17194 raft_consensus.cc:3060] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.229861 17119 raft_consensus.cc:740] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:25.233196 17119 consensus_queue.cc:260] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.234726 17119 raft_consensus.cc:3060] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.237968 17194 raft_consensus.cc:2468] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.238813 17120 leader_election.cc:290] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:25.239545 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:25.240159 17042 raft_consensus.cc:3055] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.240475 17042 raft_consensus.cc:740] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:25.240161 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e03d9f0d2741958a6827035af32691" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:25.241406 17042 consensus_queue.cc:260] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.242074 17193 raft_consensus.cc:3060] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.242765 17042 raft_consensus.cc:3060] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.244261 17119 raft_consensus.cc:2468] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:25.241364 17011 leader_election.cc:304] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:25.245944 17301 raft_consensus.cc:2804] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.246918 17301 raft_consensus.cc:697] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:25.247962 17301 consensus_queue.cc:237] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.253202 17193 raft_consensus.cc:2468] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:25.254590 17086 leader_election.cc:304] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:25.254633 17042 raft_consensus.cc:2468] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:25.255580 17261 raft_consensus.cc:2804] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.256093 17261 raft_consensus.cc:697] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:25.256907 17261 consensus_queue.cc:237] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.257153 16941 catalog_manager.cc:5697] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.264303 16942 catalog_manager.cc:5697] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 1 to 2, leader changed from f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65) to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.268873 17255 raft_consensus.cc:993] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: : Instructing follower 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:25.269505 17261 raft_consensus.cc:1081] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:25.271467 17193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:07:25.272066 17193 raft_consensus.cc:493] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.272572 17193 raft_consensus.cc:3060] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.278432 17193 raft_consensus.cc:515] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.280074 17193 leader_election.cc:290] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:25.280803 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:25.281136 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf321c9ca5c34ceb97c2b8a81a136e38" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:25.281435 17042 raft_consensus.cc:3060] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.281700 17119 raft_consensus.cc:3055] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.282017 17119 raft_consensus.cc:740] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:25.282652 17119 consensus_queue.cc:260] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.283560 17119 raft_consensus.cc:3060] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.288151 17042 raft_consensus.cc:2468] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 2.
I20260709 13:07:25.288358 17119 raft_consensus.cc:2468] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 2.
I20260709 13:07:25.289561 17157 leader_election.cc:304] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:25.290213 17321 raft_consensus.cc:2804] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.290722 17321 raft_consensus.cc:697] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:25.291410 17321 consensus_queue.cc:237] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.297996 16942 catalog_manager.cc:5697] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.310047 17307 raft_consensus.cc:993] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: : Instructing follower 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:25.310573 17301 raft_consensus.cc:1081] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Signalling peer 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:25.312295 17119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2328239e139e464fb35d7d777c47b620"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:56776
I20260709 13:07:25.312983 17119 raft_consensus.cc:493] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.313262 17119 raft_consensus.cc:3060] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.318261 17119 raft_consensus.cc:515] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.319929 17119 leader_election.cc:290] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:25.320705 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:25.321002 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2328239e139e464fb35d7d777c47b620" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:25.321311 17042 raft_consensus.cc:3055] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.321651 17193 raft_consensus.cc:3060] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.321648 17042 raft_consensus.cc:740] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:25.322484 17042 consensus_queue.cc:260] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.323390 17042 raft_consensus.cc:3060] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.326864 17193 raft_consensus.cc:2468] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:25.327950 17086 leader_election.cc:304] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:25.328361 17042 raft_consensus.cc:2468] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:25.328600 17261 raft_consensus.cc:2804] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.329097 17261 raft_consensus.cc:697] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:25.329814 17261 consensus_queue.cc:237] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:25.336465 16942 catalog_manager.cc:5697] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 1 to 2, leader changed from f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65) to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.556161 17193 raft_consensus.cc:1275] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.594424 17307 consensus_queue.cc:1048] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:25.604698 17119 raft_consensus.cc:1275] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.607337 17307 consensus_queue.cc:1048] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.626327 17119 raft_consensus.cc:1275] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.628818 17272 consensus_queue.cc:1048] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:25.641700 17193 raft_consensus.cc:1275] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.643725 17326 consensus_queue.cc:1048] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.656155 17042 raft_consensus.cc:1275] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.657845 17119 raft_consensus.cc:1275] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.658712 17261 consensus_queue.cc:1048] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.659909 17327 consensus_queue.cc:1048] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.670463 17193 raft_consensus.cc:1275] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.672106 17276 consensus_queue.cc:1048] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.675177 17194 raft_consensus.cc:1275] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.677204 17307 consensus_queue.cc:1048] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.687870 17042 raft_consensus.cc:1275] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.689566 17321 consensus_queue.cc:1048] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.704638 17119 raft_consensus.cc:1275] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.711771 17119 raft_consensus.cc:1275] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.713109 17327 consensus_queue.cc:1048] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.713625 17328 consensus_queue.cc:1048] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.727196 17194 raft_consensus.cc:1275] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.728602 17301 consensus_queue.cc:1048] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.742338 17194 raft_consensus.cc:1275] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.743988 17276 consensus_queue.cc:1048] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.755070 17042 raft_consensus.cc:1275] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.756711 17255 consensus_queue.cc:1048] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.068260 16940 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52260:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:28.071067 16940 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:28.126708 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 5404794018634b3f8f36a8a38dddf532 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:28.127765 17104 tablet_service.cc:1511] Processing CreateTablet for tablet 5404794018634b3f8f36a8a38dddf532 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:28.128610 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5404794018634b3f8f36a8a38dddf532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.129381 17104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5404794018634b3f8f36a8a38dddf532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.129757 17176 tablet_service.cc:1511] Processing CreateTablet for tablet 5404794018634b3f8f36a8a38dddf532 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:28.131204 17176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5404794018634b3f8f36a8a38dddf532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.135499 17182 tablet_service.cc:1511] Processing CreateTablet for tablet 396b45f312ef40459875c1ac5c3fa61f (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:28.137086 17182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396b45f312ef40459875c1ac5c3fa61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.137792 17027 tablet_service.cc:1511] Processing CreateTablet for tablet 396b45f312ef40459875c1ac5c3fa61f (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:28.139180 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396b45f312ef40459875c1ac5c3fa61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.143659 17110 tablet_service.cc:1511] Processing CreateTablet for tablet 396b45f312ef40459875c1ac5c3fa61f (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:28.145068 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396b45f312ef40459875c1ac5c3fa61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.146075 17184 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc66eae0bde4000a4444facaae4ad03 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:28.146514 17107 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc66eae0bde4000a4444facaae4ad03 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:28.147471 17184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc66eae0bde4000a4444facaae4ad03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.149822 17029 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc66eae0bde4000a4444facaae4ad03 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:28.151213 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc66eae0bde4000a4444facaae4ad03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.151693 17103 tablet_service.cc:1511] Processing CreateTablet for tablet 4bfb6592df094e0a8111074b80cb89c5 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:28.153029 17030 tablet_service.cc:1511] Processing CreateTablet for tablet 4bfb6592df094e0a8111074b80cb89c5 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:28.154433 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bfb6592df094e0a8111074b80cb89c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.154896 17181 tablet_service.cc:1511] Processing CreateTablet for tablet 4bfb6592df094e0a8111074b80cb89c5 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:28.156158 17181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bfb6592df094e0a8111074b80cb89c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.163079 17031 tablet_service.cc:1511] Processing CreateTablet for tablet 793abc267f8c40d49eafe8498174538b (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:28.164544 17031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793abc267f8c40d49eafe8498174538b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.166513 17108 tablet_service.cc:1511] Processing CreateTablet for tablet 793abc267f8c40d49eafe8498174538b (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:28.168527 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bfb6592df094e0a8111074b80cb89c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.169225 17108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793abc267f8c40d49eafe8498174538b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.170827 17107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc66eae0bde4000a4444facaae4ad03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.179227 17180 tablet_service.cc:1511] Processing CreateTablet for tablet 793abc267f8c40d49eafe8498174538b (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:28.180190 17035 tablet_service.cc:1511] Processing CreateTablet for tablet b7f3873ba6f442c69d5571528b893a14 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:28.180662 17180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793abc267f8c40d49eafe8498174538b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.184682 17106 tablet_service.cc:1511] Processing CreateTablet for tablet b7f3873ba6f442c69d5571528b893a14 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:28.186131 17106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f3873ba6f442c69d5571528b893a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.190064 17035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f3873ba6f442c69d5571528b893a14. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:28.195580 16991 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:28.218842 17034 tablet_service.cc:1511] Processing CreateTablet for tablet e6fad20c5f56460594318e58ca0cce4f (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:28.220265 17034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fad20c5f56460594318e58ca0cce4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.221251 17178 tablet_service.cc:1511] Processing CreateTablet for tablet e6fad20c5f56460594318e58ca0cce4f (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:28.222746 17178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fad20c5f56460594318e58ca0cce4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.224318 17105 tablet_service.cc:1511] Processing CreateTablet for tablet e6fad20c5f56460594318e58ca0cce4f (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:28.224718 17109 tablet_service.cc:1511] Processing CreateTablet for tablet ea5398427931485690d9f15403a2dab5 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:28.225649 17105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fad20c5f56460594318e58ca0cce4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.226287 17109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5398427931485690d9f15403a2dab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.227248 17032 tablet_service.cc:1511] Processing CreateTablet for tablet ea5398427931485690d9f15403a2dab5 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:28.228523 17032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5398427931485690d9f15403a2dab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.254791 17181 tablet_service.cc:1511] Processing CreateTablet for tablet b7f3873ba6f442c69d5571528b893a14 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:28.256269 17181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f3873ba6f442c69d5571528b893a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.267851 17344 tablet_bootstrap.cc:492] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.274358 17178 tablet_service.cc:1511] Processing CreateTablet for tablet ea5398427931485690d9f15403a2dab5 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:28.275740 17178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5398427931485690d9f15403a2dab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.275573 17034 tablet_service.cc:1511] Processing CreateTablet for tablet 55a9ee806a744894935ec7a114d60221 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:28.278155 17034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a9ee806a744894935ec7a114d60221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.278888 17183 tablet_service.cc:1511] Processing CreateTablet for tablet 55a9ee806a744894935ec7a114d60221 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:28.280117 17183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a9ee806a744894935ec7a114d60221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.293880 17342 tablet_bootstrap.cc:492] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.301766 17110 tablet_service.cc:1511] Processing CreateTablet for tablet 55a9ee806a744894935ec7a114d60221 (DEFAULT_TABLE table=soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:28.303108 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a9ee806a744894935ec7a114d60221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.306595 17343 tablet_bootstrap.cc:492] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.316704 17342 tablet_bootstrap.cc:654] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.323733 17344 tablet_bootstrap.cc:654] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.343065 17343 tablet_bootstrap.cc:654] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.345666 17342 tablet_bootstrap.cc:492] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.346462 17342 ts_tablet_manager.cc:1403] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.016s
I20260709 13:07:28.347628 17344 tablet_bootstrap.cc:492] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.348218 17344 ts_tablet_manager.cc:1403] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.001s
I20260709 13:07:28.349696 17342 raft_consensus.cc:359] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.350548 17342 raft_consensus.cc:385] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.350854 17342 raft_consensus.cc:740] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.351611 17342 consensus_queue.cc:260] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.351661 17344 raft_consensus.cc:359] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.352604 17344 raft_consensus.cc:385] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.352628 17343 tablet_bootstrap.cc:492] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.353698 17344 raft_consensus.cc:740] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.354066 17343 ts_tablet_manager.cc:1403] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 13:07:28.354816 17344 consensus_queue.cc:260] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.357177 17344 ts_tablet_manager.cc:1434] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:07:28.358065 17344 tablet_bootstrap.cc:492] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.359793 17343 raft_consensus.cc:359] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.360520 17343 raft_consensus.cc:385] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.360798 17343 raft_consensus.cc:740] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.361542 17343 consensus_queue.cc:260] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.366659 17342 ts_tablet_manager.cc:1434] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:07:28.367570 17344 tablet_bootstrap.cc:654] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.368153 17342 tablet_bootstrap.cc:492] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.369290 17343 ts_tablet_manager.cc:1434] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:28.370384 17343 tablet_bootstrap.cc:492] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.376406 17342 tablet_bootstrap.cc:654] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.376752 17343 tablet_bootstrap.cc:654] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.385640 17344 tablet_bootstrap.cc:492] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.386191 17344 ts_tablet_manager.cc:1403] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.001s
I20260709 13:07:28.389729 17344 raft_consensus.cc:359] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.390509 17344 raft_consensus.cc:385] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.390807 17344 raft_consensus.cc:740] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.391671 17344 consensus_queue.cc:260] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.394626 17344 ts_tablet_manager.cc:1434] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:28.395632 17344 tablet_bootstrap.cc:492] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.396561 17343 tablet_bootstrap.cc:492] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.397120 17343 ts_tablet_manager.cc:1403] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.012s
I20260709 13:07:28.402328 17343 raft_consensus.cc:359] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.403352 17343 raft_consensus.cc:385] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.403664 17343 raft_consensus.cc:740] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.405040 17344 tablet_bootstrap.cc:654] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.404646 17343 consensus_queue.cc:260] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.405400 17342 tablet_bootstrap.cc:492] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.406114 17342 ts_tablet_manager.cc:1403] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.012s
I20260709 13:07:28.407683 17343 ts_tablet_manager.cc:1434] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:28.409296 17343 tablet_bootstrap.cc:492] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.409773 17342 raft_consensus.cc:359] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.414979 17342 raft_consensus.cc:385] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.415275 17342 raft_consensus.cc:740] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.416391 17343 tablet_bootstrap.cc:654] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.416134 17342 consensus_queue.cc:260] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.418309 17344 tablet_bootstrap.cc:492] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.418855 17342 ts_tablet_manager.cc:1434] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:07:28.418900 17344 ts_tablet_manager.cc:1403] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:07:28.419937 17342 tablet_bootstrap.cc:492] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.422314 17344 raft_consensus.cc:359] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.422840 17344 raft_consensus.cc:385] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.423108 17344 raft_consensus.cc:740] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.423854 17344 consensus_queue.cc:260] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.426285 17344 ts_tablet_manager.cc:1434] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:28.427261 17344 tablet_bootstrap.cc:492] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.427680 17342 tablet_bootstrap.cc:654] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.433517 17344 tablet_bootstrap.cc:654] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.435616 17343 tablet_bootstrap.cc:492] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.436197 17343 ts_tablet_manager.cc:1403] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.005s
I20260709 13:07:28.439227 17342 tablet_bootstrap.cc:492] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.439150 17343 raft_consensus.cc:359] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.439756 17342 ts_tablet_manager.cc:1403] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 13:07:28.439882 17343 raft_consensus.cc:385] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.440207 17343 raft_consensus.cc:740] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.441915 17343 consensus_queue.cc:260] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.442776 17342 raft_consensus.cc:359] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.443176 17307 raft_consensus.cc:493] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.443513 17342 raft_consensus.cc:385] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.443823 17342 raft_consensus.cc:740] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.443646 17307 raft_consensus.cc:515] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.444687 17343 ts_tablet_manager.cc:1434] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:07:28.444594 17342 consensus_queue.cc:260] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.445791 17343 tablet_bootstrap.cc:492] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.446072 17255 raft_consensus.cc:493] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.446542 17255 raft_consensus.cc:515] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.448659 17255 leader_election.cc:290] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.450199 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.451292 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:28.452044 17192 raft_consensus.cc:2468] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
W20260709 13:07:28.452288 17083 leader_election.cc:343] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.452976 17343 tablet_bootstrap.cc:654] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.453025 17344 tablet_bootstrap.cc:492] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.453704 17344 ts_tablet_manager.cc:1403] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:07:28.454231 17086 leader_election.cc:304] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:28.456724 17344 raft_consensus.cc:359] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.457499 17344 raft_consensus.cc:385] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.457777 17344 raft_consensus.cc:740] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.458421 17342 ts_tablet_manager.cc:1434] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:07:28.458491 17344 consensus_queue.cc:260] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.459544 17342 tablet_bootstrap.cc:492] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.461654 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
W20260709 13:07:28.464164 17008 leader_election.cc:343] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.465538 17255 raft_consensus.cc:2804] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.465957 17255 raft_consensus.cc:493] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.466265 17255 raft_consensus.cc:3060] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.470755 17342 tablet_bootstrap.cc:654] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.472978 17355 raft_consensus.cc:493] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.473518 17355 raft_consensus.cc:515] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.475649 17355 leader_election.cc:290] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.477007 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:28.477662 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
W20260709 13:07:28.479399 17011 leader_election.cc:343] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.479803 17343 tablet_bootstrap.cc:492] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
W20260709 13:07:28.480088 17011 leader_election.cc:343] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.480314 17343 ts_tablet_manager.cc:1403] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.012s
I20260709 13:07:28.453182 17328 raft_consensus.cc:493] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.481083 17328 raft_consensus.cc:515] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.481945 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.482632 17119 raft_consensus.cc:2468] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 0.
I20260709 13:07:28.483389 17328 leader_election.cc:290] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.483536 17343 raft_consensus.cc:359] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.483939 17008 leader_election.cc:304] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:28.484248 17343 raft_consensus.cc:385] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.484599 17343 raft_consensus.cc:740] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.485165 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.480579 17011 leader_election.cc:304] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214
I20260709 13:07:28.485859 17119 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.486506 17355 raft_consensus.cc:2749] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.486460 17343 consensus_queue.cc:260] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.487241 17157 leader_election.cc:304] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:28.488668 17328 raft_consensus.cc:2804] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.488940 17343 ts_tablet_manager.cc:1434] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:28.489042 17328 raft_consensus.cc:493] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.489468 17328 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.489789 17342 tablet_bootstrap.cc:492] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.489952 17343 tablet_bootstrap.cc:492] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.490280 17342 ts_tablet_manager.cc:1403] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:07:28.493580 17342 raft_consensus.cc:359] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.494231 17342 raft_consensus.cc:385] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.494489 17342 raft_consensus.cc:740] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.495158 17342 consensus_queue.cc:260] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.497402 17343 tablet_bootstrap.cc:654] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.497669 17342 ts_tablet_manager.cc:1434] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:28.498672 17342 tablet_bootstrap.cc:492] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.481057 17344 ts_tablet_manager.cc:1434] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.027s	user 0.014s	sys 0.012s
I20260709 13:07:28.503216 17328 raft_consensus.cc:515] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.504962 17342 tablet_bootstrap.cc:654] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.505616 17328 leader_election.cc:290] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.487437 17307 leader_election.cc:290] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.522822 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.522740 17307 raft_consensus.cc:2804] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.526232 17307 raft_consensus.cc:493] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.526526 17307 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.530910 17343 tablet_bootstrap.cc:492] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.531150 17342 tablet_bootstrap.cc:492] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.531594 17343 ts_tablet_manager.cc:1403] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.042s	user 0.030s	sys 0.007s
I20260709 13:07:28.531770 17342 ts_tablet_manager.cc:1403] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.002s
I20260709 13:07:28.533157 17307 raft_consensus.cc:515] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.534866 17343 raft_consensus.cc:359] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.535259 17342 raft_consensus.cc:359] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.535686 17343 raft_consensus.cc:385] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.536072 17343 raft_consensus.cc:740] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.536857 17343 consensus_queue.cc:260] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.538589 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:28.539223 17119 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.539355 17343 ts_tablet_manager.cc:1434] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:28.539875 17344 tablet_bootstrap.cc:492] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.540380 17343 tablet_bootstrap.cc:492] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.520941 17255 raft_consensus.cc:515] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.543643 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
W20260709 13:07:28.544950 17083 leader_election.cc:343] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.547829 17343 tablet_bootstrap.cc:654] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.549959 17255 leader_election.cc:290] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.536006 17342 raft_consensus.cc:385] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.551117 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:28.551299 17342 raft_consensus.cc:740] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.551728 17192 raft_consensus.cc:3060] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.552065 17342 consensus_queue.cc:260] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.554848 17342 ts_tablet_manager.cc:1434] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
W20260709 13:07:28.555116 17157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.66:37943, user_credentials={real_user=slave}} blocked reactor thread for 68044.4us
I20260709 13:07:28.557029 17342 tablet_bootstrap.cc:492] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.557634 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:28.558248 17120 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.558619 17359 raft_consensus.cc:493] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.559937 17157 leader_election.cc:343] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.560436 17343 tablet_bootstrap.cc:492] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.560894 17343 ts_tablet_manager.cc:1403] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:07:28.565049 17342 tablet_bootstrap.cc:654] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.559110 17359 raft_consensus.cc:515] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.575047 17307 leader_election.cc:290] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.575403 17192 raft_consensus.cc:2468] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:28.573603 17355 raft_consensus.cc:493] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.576308 17355 raft_consensus.cc:515] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.576510 17343 raft_consensus.cc:359] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.576871 17086 leader_election.cc:304] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:28.577276 17343 raft_consensus.cc:385] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.577613 17343 raft_consensus.cc:740] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.578083 17255 raft_consensus.cc:2804] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.575430 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:28.578562 17355 leader_election.cc:290] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.578609 17255 raft_consensus.cc:697] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:28.579808 17255 consensus_queue.cc:237] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.578298 17343 consensus_queue.cc:260] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.581804 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:28.582700 17042 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.578261 17344 tablet_bootstrap.cc:654] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:28.584118 17011 leader_election.cc:343] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.589107 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
W20260709 13:07:28.590659 17008 leader_election.cc:343] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.591693 17120 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:28.595276 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:28.596055 17194 raft_consensus.cc:2468] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 0.
I20260709 13:07:28.596220 17343 ts_tablet_manager.cc:1434] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:07:28.596768 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.597443 17343 tablet_bootstrap.cc:492] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.597400 17043 raft_consensus.cc:2468] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.595558 17359 leader_election.cc:290] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.606770 17157 leader_election.cc:304] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:28.608705 17359 raft_consensus.cc:2804] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.609247 17359 raft_consensus.cc:697] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:28.610549 17343 tablet_bootstrap.cc:654] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.610106 17359 consensus_queue.cc:237] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.613225 17011 leader_election.cc:304] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 65640e19115147f8acf6f371a65a0214
I20260709 13:07:28.613451 17119 raft_consensus.cc:2468] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 1.
I20260709 13:07:28.613667 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.614576 17307 raft_consensus.cc:2804] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.614995 17307 raft_consensus.cc:493] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.615046 17120 raft_consensus.cc:2468] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.615489 17307 raft_consensus.cc:3060] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.615963 17008 leader_election.cc:304] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:28.616966 17355 raft_consensus.cc:2804] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.617835 17344 tablet_bootstrap.cc:492] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.618440 17344 ts_tablet_manager.cc:1403] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.009s
I20260709 13:07:28.622531 17344 raft_consensus.cc:359] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.626199 17342 tablet_bootstrap.cc:492] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.627017 17342 ts_tablet_manager.cc:1403] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.001s
I20260709 13:07:28.624037 17344 raft_consensus.cc:385] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.630829 17344 raft_consensus.cc:740] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.631826 17344 consensus_queue.cc:260] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.632230 16940 catalog_manager.cc:5697] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.634523 17344 ts_tablet_manager.cc:1434] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:07:28.635840 17344 tablet_bootstrap.cc:492] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.639297 17342 raft_consensus.cc:359] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.639299 17157 leader_election.cc:304] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:28.646437 17342 raft_consensus.cc:385] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.646828 17342 raft_consensus.cc:740] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.647174 17359 raft_consensus.cc:2804] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.642832 17343 tablet_bootstrap.cc:492] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.644116 17344 tablet_bootstrap.cc:654] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.610431 17042 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:28.647625 17359 raft_consensus.cc:493] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.647565 17342 consensus_queue.cc:260] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.649771 17359 raft_consensus.cc:3060] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.631032 16942 catalog_manager.cc:5697] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.648065 17343 ts_tablet_manager.cc:1403] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.009s
I20260709 13:07:28.653863 17342 ts_tablet_manager.cc:1434] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 13:07:28.656903 17307 raft_consensus.cc:515] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.663882 17344 tablet_bootstrap.cc:492] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.657758 17342 tablet_bootstrap.cc:492] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.658020 17359 raft_consensus.cc:515] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.664578 17344 ts_tablet_manager.cc:1403] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.003s
I20260709 13:07:28.666199 17359 leader_election.cc:290] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.666056 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:28.660820 17343 raft_consensus.cc:359] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.661142 17355 raft_consensus.cc:697] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:28.664278 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:28.667070 17343 raft_consensus.cc:385] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.667569 17343 raft_consensus.cc:740] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.667827 17355 consensus_queue.cc:237] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.666993 17192 raft_consensus.cc:3060] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.668535 17343 consensus_queue.cc:260] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.672636 17343 ts_tablet_manager.cc:1434] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:07:28.673110 17344 raft_consensus.cc:359] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
W20260709 13:07:28.668574 17008 leader_election.cc:343] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.673908 17344 raft_consensus.cc:385] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.674376 17344 raft_consensus.cc:740] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.675258 17344 consensus_queue.cc:260] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.677680 17344 ts_tablet_manager.cc:1434] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 13:07:28.678683 17344 tablet_bootstrap.cc:492] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.678849 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:28.679330 17342 tablet_bootstrap.cc:654] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.679543 17119 raft_consensus.cc:3060] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.681313 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:28.682017 17042 raft_consensus.cc:3060] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.673852 17343 tablet_bootstrap.cc:492] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.688845 17344 tablet_bootstrap.cc:654] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.691395 17192 raft_consensus.cc:2468] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 1.
I20260709 13:07:28.688845 17343 tablet_bootstrap.cc:654] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.691612 17342 tablet_bootstrap.cc:492] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.693300 17342 ts_tablet_manager.cc:1403] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.002s
I20260709 13:07:28.695726 16941 catalog_manager.cc:5697] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 0 to 1, leader changed from <none> to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 1 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.697961 17042 raft_consensus.cc:2468] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:28.705994 17157 leader_election.cc:304] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:28.706789 17359 raft_consensus.cc:2804] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.707158 17359 raft_consensus.cc:697] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:28.707813 17359 consensus_queue.cc:237] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.664582 17307 leader_election.cc:290] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.701151 17119 raft_consensus.cc:2468] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:28.701879 17342 raft_consensus.cc:359] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.711033 17011 leader_election.cc:304] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 65640e19115147f8acf6f371a65a0214
I20260709 13:07:28.715360 17307 raft_consensus.cc:2804] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.715993 17307 raft_consensus.cc:697] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:28.714241 17342 raft_consensus.cc:385] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.717829 17342 raft_consensus.cc:740] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.718614 17342 consensus_queue.cc:260] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.721076 17342 ts_tablet_manager.cc:1434] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:07:28.716840 17307 consensus_queue.cc:237] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.722311 17342 tablet_bootstrap.cc:492] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.732064 17343 tablet_bootstrap.cc:492] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.732611 17343 ts_tablet_manager.cc:1403] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.010s
I20260709 13:07:28.733510 17344 tablet_bootstrap.cc:492] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.734014 17344 ts_tablet_manager.cc:1403] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.013s
I20260709 13:07:28.735260 17343 raft_consensus.cc:359] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.735930 17343 raft_consensus.cc:385] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.736164 17343 raft_consensus.cc:740] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.736469 17342 tablet_bootstrap.cc:654] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.736783 17344 raft_consensus.cc:359] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.736807 17343 consensus_queue.cc:260] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.737599 17344 raft_consensus.cc:385] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.737928 17344 raft_consensus.cc:740] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.738672 17344 consensus_queue.cc:260] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.741904 17344 ts_tablet_manager.cc:1434] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:28.743189 17344 tablet_bootstrap.cc:492] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.743793 17343 ts_tablet_manager.cc:1434] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:28.744890 17343 tablet_bootstrap.cc:492] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: Bootstrap starting.
I20260709 13:07:28.751423 17344 tablet_bootstrap.cc:654] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.752211 16941 catalog_manager.cc:5697] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 0 to 1, leader changed from <none> to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 1 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.754638 17343 tablet_bootstrap.cc:654] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.758005 17344 tablet_bootstrap.cc:492] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.758474 17344 ts_tablet_manager.cc:1403] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:07:28.760106 17343 tablet_bootstrap.cc:492] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: No bootstrap required, opened a new log
I20260709 13:07:28.760951 17344 raft_consensus.cc:359] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.761533 17343 ts_tablet_manager.cc:1403] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:07:28.761698 17344 raft_consensus.cc:385] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.762024 17344 raft_consensus.cc:740] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.762679 17344 consensus_queue.cc:260] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.764911 17344 ts_tablet_manager.cc:1434] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:28.765552 17359 raft_consensus.cc:493] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.765197 17343 raft_consensus.cc:359] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.766068 17343 raft_consensus.cc:385] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.766026 17359 raft_consensus.cc:515] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.766601 17343 raft_consensus.cc:740] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.766765 17342 tablet_bootstrap.cc:492] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.767287 17342 ts_tablet_manager.cc:1403] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 13:07:28.767380 17343 consensus_queue.cc:260] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.768088 17359 leader_election.cc:290] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.769832 17343 ts_tablet_manager.cc:1434] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:07:28.770248 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3873ba6f442c69d5571528b893a14" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.770380 17342 raft_consensus.cc:359] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.770982 17344 tablet_bootstrap.cc:492] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: Bootstrap starting.
I20260709 13:07:28.771088 17342 raft_consensus.cc:385] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.771464 17342 raft_consensus.cc:740] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
W20260709 13:07:28.771538 17157 leader_election.cc:343] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.772425 17342 consensus_queue.cc:260] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.771317 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3873ba6f442c69d5571528b893a14" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.774012 16942 catalog_manager.cc:5697] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:28.774770 17157 leader_election.cc:343] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.775292 17157 leader_election.cc:304] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8; no voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:28.776365 17328 raft_consensus.cc:2749] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.777985 17342 ts_tablet_manager.cc:1434] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:07:28.778987 17342 tablet_bootstrap.cc:492] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: Bootstrap starting.
I20260709 13:07:28.780108 17344 tablet_bootstrap.cc:654] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.785257 17344 tablet_bootstrap.cc:492] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: No bootstrap required, opened a new log
I20260709 13:07:28.785734 17344 ts_tablet_manager.cc:1403] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:07:28.787037 17342 tablet_bootstrap.cc:654] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.788410 17344 raft_consensus.cc:359] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.789314 17344 raft_consensus.cc:385] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.789762 17344 raft_consensus.cc:740] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.790639 17344 consensus_queue.cc:260] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.793208 17344 ts_tablet_manager.cc:1434] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:07:28.794626 17307 raft_consensus.cc:493] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.795109 17307 raft_consensus.cc:515] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.796838 17307 leader_election.cc:290] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.797818 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.798430 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:28.799221 17192 raft_consensus.cc:2393] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f85a650cd3c44d07b5fbd8f99511f06d in current term 1: Already voted for candidate 65640e19115147f8acf6f371a65a0214 in this term.
I20260709 13:07:28.801016 17008 leader_election.cc:304] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f85a650cd3c44d07b5fbd8f99511f06d; no voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214
I20260709 13:07:28.801800 17307 raft_consensus.cc:3060] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.807929 17307 raft_consensus.cc:2749] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.809562 17342 tablet_bootstrap.cc:492] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: No bootstrap required, opened a new log
I20260709 13:07:28.809983 17342 ts_tablet_manager.cc:1403] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.003s
I20260709 13:07:28.811146 17255 raft_consensus.cc:493] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.811575 17255 raft_consensus.cc:515] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.811964 17342 raft_consensus.cc:359] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.812466 17342 raft_consensus.cc:385] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.812654 17342 raft_consensus.cc:740] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.813185 17342 consensus_queue.cc:260] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.814105 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9ee806a744894935ec7a114d60221" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.814461 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9ee806a744894935ec7a114d60221" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:28.814729 17042 raft_consensus.cc:2468] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:28.815074 17192 raft_consensus.cc:2468] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:28.815394 17255 leader_election.cc:290] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.815855 17083 leader_election.cc:304] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:28.816644 17255 raft_consensus.cc:2804] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.816980 17255 raft_consensus.cc:493] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.817142 17342 ts_tablet_manager.cc:1434] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:28.817312 17255 raft_consensus.cc:3060] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.819581 17328 raft_consensus.cc:493] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.820039 17328 raft_consensus.cc:515] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.822067 17328 leader_election.cc:290] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.823009 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.823661 17119 raft_consensus.cc:2468] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.824215 17255 raft_consensus.cc:515] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.824681 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.824820 17157 leader_election.cc:304] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:28.825234 17042 raft_consensus.cc:2468] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.826036 17328 raft_consensus.cc:2804] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.826263 17255 leader_election.cc:290] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.826406 17328 raft_consensus.cc:493] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.826785 17328 raft_consensus.cc:3060] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.830659 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9ee806a744894935ec7a114d60221" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:28.830358 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9ee806a744894935ec7a114d60221" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:28.831529 17192 raft_consensus.cc:3060] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.831574 17042 raft_consensus.cc:3060] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.831727 17328 raft_consensus.cc:515] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.834671 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:28.835227 17043 raft_consensus.cc:3060] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.836436 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:28.837029 17119 raft_consensus.cc:3060] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.838356 17042 raft_consensus.cc:2468] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:28.839377 17255 raft_consensus.cc:493] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.839569 17083 leader_election.cc:304] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:28.840094 17328 leader_election.cc:290] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.840408 17361 raft_consensus.cc:2804] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.839877 17255 raft_consensus.cc:515] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.840950 17361 raft_consensus.cc:697] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:28.841899 17361 consensus_queue.cc:237] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.842926 17043 raft_consensus.cc:2468] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:28.843056 17255 leader_election.cc:290] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:28.838694 17192 raft_consensus.cc:2468] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:28.844256 17157 leader_election.cc:304] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:28.844195 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:28.845329 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.845773 17194 raft_consensus.cc:2393] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65640e19115147f8acf6f371a65a0214 in current term 1: Already voted for candidate f85a650cd3c44d07b5fbd8f99511f06d in this term.
I20260709 13:07:28.847083 17328 raft_consensus.cc:2804] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.847838 17083 leader_election.cc:304] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65640e19115147f8acf6f371a65a0214; no voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:28.848423 17328 raft_consensus.cc:697] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:28.847970 17119 raft_consensus.cc:2468] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:28.849625 17255 raft_consensus.cc:3060] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.850225 17328 consensus_queue.cc:237] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.857406 17255 raft_consensus.cc:2749] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.860661 16941 catalog_manager.cc:5697] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.861652 16942 catalog_manager.cc:5697] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.971830 17255 consensus_queue.cc:1048] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.973455 17255 consensus_queue.cc:1048] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.974435 17359 raft_consensus.cc:493] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.974974 17359 raft_consensus.cc:515] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.976817 17359 leader_election.cc:290] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:28.978235 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:28.978894 17042 raft_consensus.cc:2468] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.979885 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:28.980064 17157 leader_election.cc:304] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:28.980623 17119 raft_consensus.cc:2468] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 0.
I20260709 13:07:28.980860 17359 raft_consensus.cc:2804] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.981297 17359 raft_consensus.cc:493] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.981698 17359 raft_consensus.cc:3060] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.990724 17359 raft_consensus.cc:515] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:28.995108 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:28.995659 17042 raft_consensus.cc:3060] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.003504 17042 raft_consensus.cc:2468] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:29.003624 17328 raft_consensus.cc:493] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.004132 17328 raft_consensus.cc:515] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.004710 17157 leader_election.cc:304] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.006207 17328 leader_election.cc:290] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:29.006726 17328 raft_consensus.cc:2804] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.007009 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:29.007143 17328 raft_consensus.cc:697] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:29.009068 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214" is_pre_election: true
I20260709 13:07:29.009361 17328 consensus_queue.cc:237] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.010027 17119 raft_consensus.cc:2393] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dced28973c34f6692b20138fab8a2b8 in current term 1: Already voted for candidate f85a650cd3c44d07b5fbd8f99511f06d in this term.
I20260709 13:07:29.011498 17157 leader_election.cc:304] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8; no voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:29.013099 17359 leader_election.cc:290] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:29.013827 17359 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.023025 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:29.023699 17119 raft_consensus.cc:3060] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.023957 17359 raft_consensus.cc:2749] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.025902 17359 consensus_queue.cc:1048] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.030238 17119 raft_consensus.cc:2468] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 1.
I20260709 13:07:29.030305 16941 catalog_manager.cc:5697] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.038667 17359 consensus_queue.cc:1048] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.055758 17307 consensus_queue.cc:1048] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.066103 17355 consensus_queue.cc:1048] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.137789 17361 raft_consensus.cc:493] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.138314 17361 raft_consensus.cc:515] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.140072 17361 leader_election.cc:290] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.141032 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3873ba6f442c69d5571528b893a14" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8" is_pre_election: true
I20260709 13:07:29.141064 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3873ba6f442c69d5571528b893a14" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" is_pre_election: true
I20260709 13:07:29.141672 17194 raft_consensus.cc:2468] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:29.141921 17043 raft_consensus.cc:2468] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 0.
I20260709 13:07:29.142620 17086 leader_election.cc:304] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:29.143471 17361 raft_consensus.cc:2804] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.143960 17361 raft_consensus.cc:493] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.144384 17361 raft_consensus.cc:3060] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.149775 17396 consensus_queue.cc:1048] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.150265 17361 raft_consensus.cc:515] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.152166 17361 leader_election.cc:290] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.152851 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3873ba6f442c69d5571528b893a14" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:29.153462 17042 raft_consensus.cc:3060] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.154371 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f3873ba6f442c69d5571528b893a14" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.155196 17194 raft_consensus.cc:3060] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.161511 17042 raft_consensus.cc:2468] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:29.161911 17194 raft_consensus.cc:2468] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 1.
I20260709 13:07:29.162983 17083 leader_election.cc:304] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.163864 17255 raft_consensus.cc:2804] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.164258 17255 raft_consensus.cc:697] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:29.164918 17255 consensus_queue.cc:237] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.173437 17328 consensus_queue.cc:1048] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.181411 16942 catalog_manager.cc:5697] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 1 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.213900 17355 consensus_queue.cc:1048] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.224989 17369 consensus_queue.cc:1048] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.293018 17194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:07:29.293628 17194 raft_consensus.cc:606] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:29.298290 17119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:56806
I20260709 13:07:29.298740 17119 raft_consensus.cc:606] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:29.303259 17194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:07:29.303781 17194 raft_consensus.cc:606] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:29.306145 17255 consensus_queue.cc:1048] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.308581 17192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
mode: GRACEFUL
new_leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:07:29.309182 17192 raft_consensus.cc:606] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Received request to transfer leadership to TS f85a650cd3c44d07b5fbd8f99511f06d
I20260709 13:07:29.314642 17043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793abc267f8c40d49eafe8498174538b"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
mode: GRACEFUL
new_leader_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:55828
I20260709 13:07:29.315132 17043 raft_consensus.cc:606] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Received request to transfer leadership to TS 65640e19115147f8acf6f371a65a0214
I20260709 13:07:29.321123 17255 consensus_queue.cc:1048] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.324038 17194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
mode: GRACEFUL
new_leader_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:07:29.324818 17194 raft_consensus.cc:606] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Received request to transfer leadership to TS 65640e19115147f8acf6f371a65a0214
I20260709 13:07:29.330502 17043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5398427931485690d9f15403a2dab5"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
mode: GRACEFUL
new_leader_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:55828
I20260709 13:07:29.331043 17043 raft_consensus.cc:606] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Received request to transfer leadership to TS 65640e19115147f8acf6f371a65a0214
I20260709 13:07:29.335701 17119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a9ee806a744894935ec7a114d60221"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:56806
I20260709 13:07:29.336117 17119 raft_consensus.cc:606] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:29.427856 17328 consensus_queue.cc:1048] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.433844 17359 raft_consensus.cc:993] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.434406 17396 raft_consensus.cc:1081] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.437141 17042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:07:29.437703 17042 raft_consensus.cc:493] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.438023 17042 raft_consensus.cc:3060] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.440160 17396 consensus_queue.cc:1048] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.443748 17396 consensus_queue.cc:1048] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.445102 17042 raft_consensus.cc:515] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.450599 17328 raft_consensus.cc:993] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.451051 17395 raft_consensus.cc:1081] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.452798 17045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:07:29.453231 17045 raft_consensus.cc:493] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.453627 17045 raft_consensus.cc:3060] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.457041 17042 leader_election.cc:290] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.460280 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:29.460773 17119 raft_consensus.cc:3060] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.463212 17328 consensus_queue.cc:1048] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.465220 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5404794018634b3f8f36a8a38dddf532" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.465190 17045 raft_consensus.cc:515] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.466068 17194 raft_consensus.cc:3055] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.466439 17194 raft_consensus.cc:740] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:29.467264 17194 consensus_queue.cc:260] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.467540 17119 raft_consensus.cc:2468] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.468844 17008 leader_election.cc:304] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.468225 17117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:29.469606 17042 raft_consensus.cc:1240] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Rejecting Update request from peer 5dced28973c34f6692b20138fab8a2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:29.469799 17369 raft_consensus.cc:2804] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.470333 17369 raft_consensus.cc:697] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:29.471136 17369 consensus_queue.cc:237] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.469051 17194 raft_consensus.cc:3060] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.475456 17045 leader_election.cc:290] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.476496 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc66eae0bde4000a4444facaae4ad03" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.477075 17192 raft_consensus.cc:3055] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.477401 17192 raft_consensus.cc:740] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:29.477908 17328 consensus_queue.cc:1059] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.479950 17194 raft_consensus.cc:2468] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.481208 17192 consensus_queue.cc:260] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.482129 16940 catalog_manager.cc:5697] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.482676 17192 raft_consensus.cc:3060] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.489400 17192 raft_consensus.cc:2468] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.490314 17011 leader_election.cc:304] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 65640e19115147f8acf6f371a65a0214
I20260709 13:07:29.491370 17369 raft_consensus.cc:2804] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.491833 17369 raft_consensus.cc:697] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:29.492597 17369 consensus_queue.cc:237] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.498561 16942 catalog_manager.cc:5697] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.538641 17255 raft_consensus.cc:993] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.539310 17357 raft_consensus.cc:1081] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.541066 17045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55814
I20260709 13:07:29.541646 17045 raft_consensus.cc:493] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.542016 17045 raft_consensus.cc:3060] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.548384 17045 raft_consensus.cc:515] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.549806 17045 leader_election.cc:290] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.550552 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:29.550805 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396b45f312ef40459875c1ac5c3fa61f" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.551126 17120 raft_consensus.cc:3055] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.551285 17192 raft_consensus.cc:3060] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.551465 17120 raft_consensus.cc:740] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:29.552273 17120 consensus_queue.cc:260] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.553186 17120 raft_consensus.cc:3060] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.556602 17192 raft_consensus.cc:2468] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.557781 17011 leader_election.cc:304] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.558503 17369 raft_consensus.cc:2804] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.559002 17369 raft_consensus.cc:697] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:29.559614 17120 raft_consensus.cc:2468] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.559911 17369 consensus_queue.cc:237] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.566398 16942 catalog_manager.cc:5697] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.625859 17359 raft_consensus.cc:993] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: : Instructing follower f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.626286 17359 raft_consensus.cc:1081] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Signalling peer f85a650cd3c44d07b5fbd8f99511f06d to start an election
I20260709 13:07:29.627766 17045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:07:29.628300 17045 raft_consensus.cc:493] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.628659 17045 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.633466 17045 raft_consensus.cc:515] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.634850 17045 leader_election.cc:290] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Requested vote from peers 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.635526 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:29.635861 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.636164 17120 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.636402 17192 raft_consensus.cc:3055] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.636711 17192 raft_consensus.cc:740] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:29.637431 17192 consensus_queue.cc:260] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.638653 17192 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.642526 17395 raft_consensus.cc:993] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: : Instructing follower 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:29.643008 17395 raft_consensus.cc:1081] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Signalling peer 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:29.645393 17192 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.645393 17120 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f85a650cd3c44d07b5fbd8f99511f06d in term 2.
I20260709 13:07:29.646693 17011 leader_election.cc:304] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.647182 17117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:29.647733 17117 raft_consensus.cc:493] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.647833 17369 raft_consensus.cc:2804] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.648134 17117 raft_consensus.cc:3060] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.648061 17357 consensus_queue.cc:1048] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.648551 17369 raft_consensus.cc:697] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Leader. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:29.649415 17369 consensus_queue.cc:237] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.654098 17117 raft_consensus.cc:515] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.657447 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:29.657546 17117 leader_election.cc:290] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.656998 16942 catalog_manager.cc:5697] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d reported cstate change: term changed from 1 to 2, leader changed from 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67) to f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65). New cstate: current_term: 2 leader_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.657696 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fad20c5f56460594318e58ca0cce4f" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.658061 17042 raft_consensus.cc:3060] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.658284 17192 raft_consensus.cc:3055] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.659828 17192 raft_consensus.cc:740] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:29.660526 17192 consensus_queue.cc:260] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.664691 17042 raft_consensus.cc:2468] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:29.665239 17192 raft_consensus.cc:3060] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.665985 17083 leader_election.cc:304] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65640e19115147f8acf6f371a65a0214, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.667132 17361 raft_consensus.cc:2804] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.667600 17361 raft_consensus.cc:697] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:29.668411 17357 consensus_queue.cc:1048] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.668344 17361 consensus_queue.cc:237] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.675416 17372 raft_consensus.cc:993] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: : Instructing follower 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:29.675855 17372 raft_consensus.cc:1081] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Signalling peer 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:29.680547 17120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea5398427931485690d9f15403a2dab5"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:56776
I20260709 13:07:29.681098 17120 raft_consensus.cc:493] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.681495 17120 raft_consensus.cc:3060] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.682471 16942 catalog_manager.cc:5697] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 1 to 2, leader changed from 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67) to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.684216 17192 raft_consensus.cc:2468] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:29.686837 17369 raft_consensus.cc:993] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: : Instructing follower 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:29.687255 17369 raft_consensus.cc:1081] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Signalling peer 65640e19115147f8acf6f371a65a0214 to start an election
I20260709 13:07:29.688973 17117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793abc267f8c40d49eafe8498174538b"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
 from {username='slave'} at 127.0.0.1:56776
I20260709 13:07:29.689815 17120 raft_consensus.cc:515] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.690249 17117 raft_consensus.cc:493] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.690635 17117 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.691857 17120 leader_election.cc:290] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.693728 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.694020 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5398427931485690d9f15403a2dab5" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:29.694229 17194 raft_consensus.cc:3060] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.694602 17045 raft_consensus.cc:3055] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.694944 17045 raft_consensus.cc:740] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:29.695695 17045 consensus_queue.cc:260] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.696938 17045 raft_consensus.cc:3060] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.700608 17194 raft_consensus.cc:2468] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:29.701601 17086 leader_election.cc:304] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:29.704941 17255 raft_consensus.cc:2804] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.705288 17255 raft_consensus.cc:697] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:29.700920 17117 raft_consensus.cc:515] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.706058 17255 consensus_queue.cc:237] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.703444 17045 raft_consensus.cc:2468] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:29.707701 17117 leader_election.cc:290] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67:42655)
I20260709 13:07:29.708493 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
I20260709 13:07:29.709169 17194 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.710630 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "65640e19115147f8acf6f371a65a0214" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:29.711187 17045 raft_consensus.cc:3055] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.711894 17045 raft_consensus.cc:740] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:29.712713 17045 consensus_queue.cc:260] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.713750 17045 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.714016 16942 catalog_manager.cc:5697] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 1 to 2, leader changed from f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65) to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.715514 17194 raft_consensus.cc:2468] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:29.716681 17086 leader_election.cc:304] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:29.717456 17255 raft_consensus.cc:2804] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.717871 17255 raft_consensus.cc:697] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Becoming Leader. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:29.718576 17255 consensus_queue.cc:237] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.719370 17045 raft_consensus.cc:2468] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65640e19115147f8acf6f371a65a0214 in term 2.
I20260709 13:07:29.727244 16942 catalog_manager.cc:5697] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 reported cstate change: term changed from 1 to 2, leader changed from f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65) to 65640e19115147f8acf6f371a65a0214 (127.6.215.66). New cstate: current_term: 2 leader_uuid: "65640e19115147f8acf6f371a65a0214" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.782871 17255 raft_consensus.cc:993] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: : Instructing follower 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:29.783257 17361 raft_consensus.cc:1081] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:29.784520 17192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55a9ee806a744894935ec7a114d60221"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:07:29.784890 17192 raft_consensus.cc:493] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.785102 17192 raft_consensus.cc:3060] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.790858 17192 raft_consensus.cc:515] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.792551 17192 leader_election.cc:290] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:29.793372 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9ee806a744894935ec7a114d60221" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:29.793788 17117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9ee806a744894935ec7a114d60221" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:29.794077 17045 raft_consensus.cc:3060] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.794430 17117 raft_consensus.cc:3055] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.794790 17117 raft_consensus.cc:740] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:29.795498 17117 consensus_queue.cc:260] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.796793 17117 raft_consensus.cc:3060] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.800475 17045 raft_consensus.cc:2468] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 2.
I20260709 13:07:29.801560 17157 leader_election.cc:304] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:29.802181 17328 raft_consensus.cc:2804] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.802650 17328 raft_consensus.cc:697] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:29.803418 17328 consensus_queue.cc:237] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:29.808437 17117 raft_consensus.cc:2468] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 2.
I20260709 13:07:29.810573 16942 catalog_manager.cc:5697] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.887353 17117 raft_consensus.cc:3060] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.892351 17117 raft_consensus.cc:1275] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.893458 17307 consensus_queue.cc:1048] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.900831 17192 raft_consensus.cc:1275] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.903043 17369 consensus_queue.cc:1048] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.944222 17192 raft_consensus.cc:1275] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.945108 17117 raft_consensus.cc:1275] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.945485 17369 consensus_queue.cc:1048] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.946431 17307 consensus_queue.cc:1048] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.052947 17117 raft_consensus.cc:1275] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.054278 17307 consensus_queue.cc:1048] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.063027 17192 raft_consensus.cc:1275] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.064522 17355 consensus_queue.cc:1048] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.076208 17192 raft_consensus.cc:1275] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.077780 17361 consensus_queue.cc:1048] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:30.086688 17045 raft_consensus.cc:1275] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.088174 17357 consensus_queue.cc:1048] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.088831 17045 raft_consensus.cc:1275] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.090147 17357 consensus_queue.cc:1048] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.099299 17192 raft_consensus.cc:1275] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.100692 17361 consensus_queue.cc:1048] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.142277 17117 raft_consensus.cc:1275] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.143496 17369 consensus_queue.cc:1048] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.152261 17192 raft_consensus.cc:1275] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer f85a650cd3c44d07b5fbd8f99511f06d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.153709 17369 consensus_queue.cc:1048] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.182287 17045 raft_consensus.cc:1275] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.183670 17255 consensus_queue.cc:1048] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.193074 17192 raft_consensus.cc:1275] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Refusing update from remote peer 65640e19115147f8acf6f371a65a0214: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.194661 17417 consensus_queue.cc:1048] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:30.319406 17045 raft_consensus.cc:1275] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.320770 17328 consensus_queue.cc:1048] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.329071 17117 raft_consensus.cc:1275] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:30.330331 17328 consensus_queue.cc:1048] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.339504 16941 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52260:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:07:32.357430 16941 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52260:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:07:32.380532  7005 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:07:32.468050 17083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.65:42227, user_credentials={real_user=slave}} blocked reactor thread for 45317us
W20260709 13:07:32.551113 17086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:42655, user_credentials={real_user=slave}} blocked reactor thread for 79605.5us
W20260709 13:07:32.567830 17435 log.cc:927] Time spent T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: Append to log took a long time: real 0.129s	user 0.003s	sys 0.001s
W20260709 13:07:32.604892 17440 log.cc:927] Time spent T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:07:32.599972 17436 log.cc:927] Time spent T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:07:32.673146 17045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
mode: GRACEFUL
new_leader_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:52446
I20260709 13:07:32.673739 17045 raft_consensus.cc:606] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Received request to transfer leadership to TS 5dced28973c34f6692b20138fab8a2b8
W20260709 13:07:32.709941 17464 log.cc:927] Time spent T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:07:32.740845 17496 tablet.cc:1724] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:32.751586 17485 log.cc:927] Time spent T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:07:32.757287 17494 tablet.cc:1724] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:32.758936 17479 log.cc:927] Time spent T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:07:32.763909 17486 log.cc:927] Time spent T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:32.769775 17495 tablet.cc:1724] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.819505 17488 tablet.cc:1724] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.821767 17492 tablet.cc:1724] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.838402 17491 tablet.cc:1724] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.847609 17499 tablet.cc:1724] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.849031 17498 tablet.cc:1724] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.850605 17496 tablet.cc:1724] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.860045 17497 tablet.cc:1724] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.860597 17116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793abc267f8c40d49eafe8498174538b"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:43030
I20260709 13:07:32.861543 17116 raft_consensus.cc:606] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Received request to transfer leadership to TS 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:32.866747  7005 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
W20260709 13:07:32.867671 17146 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:55a9ee806a744894935ec7a114d60221)
I20260709 13:07:32.867694  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.867213 17503 tablet.cc:1724] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.864337 17494 tablet.cc:1724] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.877511 17501 tablet.cc:1724] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.878990 17447 raft_consensus.cc:993] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: : Instructing follower 5dced28973c34f6692b20138fab8a2b8 to start an election
W20260709 13:07:32.879256 17146 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:55a9ee806a744894935ec7a114d60221)
I20260709 13:07:32.885746 17447 raft_consensus.cc:1081] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Signalling peer 5dced28973c34f6692b20138fab8a2b8 to start an election
W20260709 13:07:32.886085 17146 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:55a9ee806a744894935ec7a114d60221)
I20260709 13:07:32.879971 17502 tablet.cc:1724] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.881422 17495 tablet.cc:1724] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.889899 17044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf"
dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
mode: GRACEFUL
new_leader_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:52446
I20260709 13:07:32.890022 17187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:07:32.890549 17044 raft_consensus.cc:606] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Received request to transfer leadership to TS 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:32.890630 17187 raft_consensus.cc:493] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.891131 17187 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.894702 17496 tablet.cc:1724] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.907613 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e"
dest_uuid: "65640e19115147f8acf6f371a65a0214"
mode: GRACEFUL
new_leader_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:43030
I20260709 13:07:32.908392 17120 raft_consensus.cc:606] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Received request to transfer leadership to TS 5dced28973c34f6692b20138fab8a2b8
I20260709 13:07:32.910688  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:32.911314  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:32.911039 17495 tablet.cc:1724] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.913420 17187 raft_consensus.cc:515] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:32.916497 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:32.917109 17044 raft_consensus.cc:3055] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.917471 17044 raft_consensus.cc:740] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:32.918366 17044 consensus_queue.cc:260] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:32.921952 17044 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.924279 17502 tablet.cc:1724] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.929381 17498 tablet.cc:1724] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.932725 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfb6592df094e0a8111074b80cb89c5" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:32.933382 17120 raft_consensus.cc:3060] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.934139 17496 tablet.cc:1724] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.939043 17497 tablet.cc:1724] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.940191 17187 leader_election.cc:290] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 3 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:32.943228 17120 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 3.
I20260709 13:07:32.946818 17157 leader_election.cc:304] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:32.948436 17469 raft_consensus.cc:2804] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.948961 17469 raft_consensus.cc:697] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 3 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:32.949911 17469 consensus_queue.cc:237] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:32.950935 17503 tablet.cc:1724] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.919433 17488 tablet.cc:1724] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.931003 17492 tablet.cc:1724] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.962085 17491 tablet.cc:1724] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.963928 17044 raft_consensus.cc:2468] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 3.
I20260709 13:07:32.971786 17498 tablet.cc:1724] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:32.972641 16940 catalog_manager.cc:5697] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 2 to 3, leader changed from f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65) to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.973080 17501 tablet.cc:1724] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:33.009387 16940 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075: soft_deleted_table [id=fe9cff9a26a34a6ea75f1df34dc75d23] alter complete (version 1)
I20260709 13:07:33.221244 17447 raft_consensus.cc:993] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: : Instructing follower 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:33.221685 17451 raft_consensus.cc:1081] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Signalling peer 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:33.223148 17187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:07:33.223639 17187 raft_consensus.cc:493] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.223896 17187 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.229622 17444 raft_consensus.cc:993] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: : Instructing follower 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:33.230332 17453 raft_consensus.cc:1081] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Signalling peer 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:33.231319 17187 raft_consensus.cc:515] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.232390 17190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:07:33.232992 17190 raft_consensus.cc:493] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.233323 17190 raft_consensus.cc:3060] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.233449 17187 leader_election.cc:290] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 3 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:33.234184 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:33.234287 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9584437fedc242cabbc93bc1021ba0bf" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:33.234887 17120 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.238528 17190 raft_consensus.cc:515] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.239073 17120 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 3.
I20260709 13:07:33.239180 17044 raft_consensus.cc:3055] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:33.239698 17044 raft_consensus.cc:740] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f85a650cd3c44d07b5fbd8f99511f06d, State: Running, Role: LEADER
I20260709 13:07:33.240393 17190 leader_election.cc:290] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:33.240967 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:33.240455 17044 consensus_queue.cc:260] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.241575 17043 raft_consensus.cc:3060] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.240840 17157 leader_election.cc:304] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, 65640e19115147f8acf6f371a65a0214; no voters: 
I20260709 13:07:33.241703 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb013bfd9de94bc08f91498855cfbd1e" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:33.242255 17044 raft_consensus.cc:3060] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.242388 17469 raft_consensus.cc:2804] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:33.242789 17120 raft_consensus.cc:3055] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:33.243083 17469 raft_consensus.cc:697] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 3 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:33.243124 17120 raft_consensus.cc:740] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:33.244124 17469 consensus_queue.cc:237] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.245422 17120 consensus_queue.cc:260] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.247129 17120 raft_consensus.cc:3060] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.250607 17044 raft_consensus.cc:2468] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 3.
I20260709 13:07:33.251961 17043 raft_consensus.cc:2468] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 2.
I20260709 13:07:33.254393 17157 leader_election.cc:304] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:33.255015 17469 raft_consensus.cc:2804] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:33.255450 17469 raft_consensus.cc:697] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:33.256352 17120 raft_consensus.cc:2468] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 2.
I20260709 13:07:33.256412 17469 consensus_queue.cc:237] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.258908 16941 catalog_manager.cc:5697] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 2 to 3, leader changed from f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65) to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.271703 16941 catalog_manager.cc:5697] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 1 to 2, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.319404 17444 raft_consensus.cc:993] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: : Instructing follower 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:33.319890 17453 raft_consensus.cc:1081] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Signalling peer 5dced28973c34f6692b20138fab8a2b8 to start an election
I20260709 13:07:33.321169 17190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793abc267f8c40d49eafe8498174538b"
dest_uuid: "5dced28973c34f6692b20138fab8a2b8"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:07:33.321630 17190 raft_consensus.cc:493] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.321867 17190 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.327131 17190 raft_consensus.cc:515] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.328938 17190 leader_election.cc:290] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 3 election: Requested vote from peers f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227), 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943)
I20260709 13:07:33.329569 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f85a650cd3c44d07b5fbd8f99511f06d"
I20260709 13:07:33.330200 17044 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.330173 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793abc267f8c40d49eafe8498174538b" candidate_uuid: "5dced28973c34f6692b20138fab8a2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "65640e19115147f8acf6f371a65a0214"
I20260709 13:07:33.330927 17120 raft_consensus.cc:3055] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:33.331224 17120 raft_consensus.cc:740] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65640e19115147f8acf6f371a65a0214, State: Running, Role: LEADER
I20260709 13:07:33.331920 17120 consensus_queue.cc:260] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.333019 17120 raft_consensus.cc:3060] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.337069 17044 raft_consensus.cc:2468] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 3.
I20260709 13:07:33.338351 17157 leader_election.cc:304] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dced28973c34f6692b20138fab8a2b8, f85a650cd3c44d07b5fbd8f99511f06d; no voters: 
I20260709 13:07:33.338917 17469 raft_consensus.cc:2804] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:33.339059 17120 raft_consensus.cc:2468] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dced28973c34f6692b20138fab8a2b8 in term 3.
I20260709 13:07:33.339336 17469 raft_consensus.cc:697] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 3 LEADER]: Becoming Leader. State: Replica: 5dced28973c34f6692b20138fab8a2b8, State: Running, Role: LEADER
I20260709 13:07:33.340142 17469 consensus_queue.cc:237] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } }
I20260709 13:07:33.346132 16941 catalog_manager.cc:5697] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 reported cstate change: term changed from 2 to 3, leader changed from 65640e19115147f8acf6f371a65a0214 (127.6.215.66) to 5dced28973c34f6692b20138fab8a2b8 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "5dced28973c34f6692b20138fab8a2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dced28973c34f6692b20138fab8a2b8" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 42655 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.372787 17044 raft_consensus.cc:1275] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.373914 17469 consensus_queue.cc:1048] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.381731 17120 raft_consensus.cc:1275] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.383236 17473 consensus_queue.cc:1048] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.639971 17043 raft_consensus.cc:1275] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.641032 17473 consensus_queue.cc:1048] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.649884 17120 raft_consensus.cc:1275] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.652050 17469 consensus_queue.cc:1048] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.751093 17043 raft_consensus.cc:1275] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.752247 17469 consensus_queue.cc:1048] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.760474 17120 raft_consensus.cc:1275] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.761709 17510 consensus_queue.cc:1048] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.901930 17043 raft_consensus.cc:1275] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.902745 17120 raft_consensus.cc:1275] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Refusing update from remote peer 5dced28973c34f6692b20138fab8a2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.903118 17473 consensus_queue.cc:1048] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f85a650cd3c44d07b5fbd8f99511f06d" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.904127 17510 consensus_queue.cc:1048] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65640e19115147f8acf6f371a65a0214" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.973889  7005 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:07:33.978686  7005 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:07:33.979051  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.984530  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:07:33.984894  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.015524  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
W20260709 13:07:35.023324 17083 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:07:35.028191 17083 consensus_peers.cc:597] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 -> Peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Couldn't send request to peer f85a650cd3c44d07b5fbd8f99511f06d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.045887  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:35.046751  7005 tablet_replica.cc:333] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.047354  7005 raft_consensus.cc:2243] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.047847  7005 raft_consensus.cc:2272] T 55a9ee806a744894935ec7a114d60221 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.049664  7005 tablet_replica.cc:333] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.050190  7005 raft_consensus.cc:2243] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.050884  7005 raft_consensus.cc:2272] T 7bc66eae0bde4000a4444facaae4ad03 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.052558  7005 tablet_replica.cc:333] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.053078  7005 raft_consensus.cc:2243] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.053517  7005 raft_consensus.cc:2272] T ea5398427931485690d9f15403a2dab5 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.055215  7005 tablet_replica.cc:333] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.055684  7005 raft_consensus.cc:2243] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.056384  7005 raft_consensus.cc:2272] T 5404794018634b3f8f36a8a38dddf532 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.058051  7005 tablet_replica.cc:333] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.058543  7005 raft_consensus.cc:2243] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.059203  7005 raft_consensus.cc:2272] T 25ff3fc31eec4a4f81333e037b0d2f79 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.061022  7005 tablet_replica.cc:333] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.061637  7005 raft_consensus.cc:2243] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.061991  7005 raft_consensus.cc:2272] T cf321c9ca5c34ceb97c2b8a81a136e38 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.063740  7005 tablet_replica.cc:333] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.064191  7005 raft_consensus.cc:2243] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.064842  7005 raft_consensus.cc:2272] T 396b45f312ef40459875c1ac5c3fa61f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.066504  7005 tablet_replica.cc:333] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.067092  7005 raft_consensus.cc:2243] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.067875  7005 raft_consensus.cc:2272] T eb013bfd9de94bc08f91498855cfbd1e P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.070309  7005 tablet_replica.cc:333] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
W20260709 13:07:35.070312 17157 consensus_peers.cc:597] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 -> Peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Couldn't send request to peer f85a650cd3c44d07b5fbd8f99511f06d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.071056  7005 raft_consensus.cc:2243] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.071473  7005 raft_consensus.cc:2272] T 2328239e139e464fb35d7d777c47b620 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.073632  7005 tablet_replica.cc:333] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.074530  7005 raft_consensus.cc:2243] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.075225  7005 raft_consensus.cc:2272] T 4bfb6592df094e0a8111074b80cb89c5 P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.077193  7005 tablet_replica.cc:333] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.077944  7005 raft_consensus.cc:2243] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.078783  7005 raft_consensus.cc:2272] T 3ea4f02a1ba5442c82b9ac472ea116d8 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.081235  7005 tablet_replica.cc:333] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.081746  7005 raft_consensus.cc:2243] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.082108  7005 raft_consensus.cc:2272] T b7f3873ba6f442c69d5571528b893a14 P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.083704  7005 tablet_replica.cc:333] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.084170  7005 raft_consensus.cc:2243] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.084858  7005 raft_consensus.cc:2272] T a52b1a2917524e118d30fc4813508883 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.086937  7005 tablet_replica.cc:333] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.087560  7005 raft_consensus.cc:2243] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.087972  7005 raft_consensus.cc:2272] T 793abc267f8c40d49eafe8498174538b P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.089820  7005 tablet_replica.cc:333] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
W20260709 13:07:35.090159 17157 consensus_peers.cc:597] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 -> Peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Couldn't send request to peer f85a650cd3c44d07b5fbd8f99511f06d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.090426  7005 raft_consensus.cc:2243] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.090911  7005 raft_consensus.cc:2272] T e6fad20c5f56460594318e58ca0cce4f P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.092500  7005 tablet_replica.cc:333] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.092947  7005 raft_consensus.cc:2243] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.093268  7005 raft_consensus.cc:2272] T 9584437fedc242cabbc93bc1021ba0bf P f85a650cd3c44d07b5fbd8f99511f06d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.095108  7005 tablet_replica.cc:333] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.095530  7005 raft_consensus.cc:2243] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.095896  7005 raft_consensus.cc:2272] T 57e03d9f0d2741958a6827035af32691 P f85a650cd3c44d07b5fbd8f99511f06d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.097818  7005 tablet_replica.cc:333] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d: stopping tablet replica
I20260709 13:07:35.098229  7005 raft_consensus.cc:2243] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.098572  7005 raft_consensus.cc:2272] T 4329a755f77247878e0d59db0e3be79b P f85a650cd3c44d07b5fbd8f99511f06d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.135396  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
W20260709 13:07:35.167532 17083 consensus_peers.cc:597] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 -> Peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Couldn't send request to peer f85a650cd3c44d07b5fbd8f99511f06d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:42227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.168269  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
I20260709 13:07:35.195483  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:35.196180  7005 tablet_replica.cc:333] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.196786  7005 raft_consensus.cc:2243] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.197234  7005 raft_consensus.cc:2272] T 55a9ee806a744894935ec7a114d60221 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.199154  7005 tablet_replica.cc:333] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.199677  7005 raft_consensus.cc:2243] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.200075  7005 raft_consensus.cc:2272] T 7bc66eae0bde4000a4444facaae4ad03 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.201722  7005 tablet_replica.cc:333] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.202229  7005 raft_consensus.cc:2243] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.202896  7005 raft_consensus.cc:2272] T ea5398427931485690d9f15403a2dab5 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.204454  7005 tablet_replica.cc:333] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.204931  7005 raft_consensus.cc:2243] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.205302  7005 raft_consensus.cc:2272] T 5404794018634b3f8f36a8a38dddf532 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.206995  7005 tablet_replica.cc:333] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.207599  7005 raft_consensus.cc:2243] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.207975  7005 raft_consensus.cc:2272] T eb013bfd9de94bc08f91498855cfbd1e P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:35.209785 17157 consensus_peers.cc:597] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 -> Peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Couldn't send request to peer 65640e19115147f8acf6f371a65a0214. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.210357  7005 tablet_replica.cc:333] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.210884  7005 raft_consensus.cc:2243] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.211272  7005 raft_consensus.cc:2272] T 396b45f312ef40459875c1ac5c3fa61f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.212879  7005 tablet_replica.cc:333] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.213371  7005 raft_consensus.cc:2243] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.214043  7005 raft_consensus.cc:2272] T b7f3873ba6f442c69d5571528b893a14 P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.215837  7005 tablet_replica.cc:333] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.216351  7005 raft_consensus.cc:2243] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.216722  7005 raft_consensus.cc:2272] T a52b1a2917524e118d30fc4813508883 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.218531  7005 tablet_replica.cc:333] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.218997  7005 raft_consensus.cc:2243] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.219357  7005 raft_consensus.cc:2272] T 9584437fedc242cabbc93bc1021ba0bf P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.221279  7005 tablet_replica.cc:333] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.221840  7005 raft_consensus.cc:2243] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.222496  7005 raft_consensus.cc:2272] T 57e03d9f0d2741958a6827035af32691 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.224428  7005 tablet_replica.cc:333] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.224979  7005 raft_consensus.cc:2243] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.225680  7005 raft_consensus.cc:2272] T 4329a755f77247878e0d59db0e3be79b P 65640e19115147f8acf6f371a65a0214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.227448  7005 tablet_replica.cc:333] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.227944  7005 raft_consensus.cc:2243] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.228286  7005 raft_consensus.cc:2272] T 25ff3fc31eec4a4f81333e037b0d2f79 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.230069  7005 tablet_replica.cc:333] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.230544  7005 raft_consensus.cc:2243] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.231009  7005 raft_consensus.cc:2272] T cf321c9ca5c34ceb97c2b8a81a136e38 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.232650  7005 tablet_replica.cc:333] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.233103  7005 raft_consensus.cc:2243] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.233857  7005 raft_consensus.cc:2272] T 2328239e139e464fb35d7d777c47b620 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.236274  7005 tablet_replica.cc:333] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.236884  7005 raft_consensus.cc:2243] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.237771  7005 raft_consensus.cc:2272] T e6fad20c5f56460594318e58ca0cce4f P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.239794  7005 tablet_replica.cc:333] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.240216  7005 raft_consensus.cc:2243] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.240546  7005 raft_consensus.cc:2272] T 793abc267f8c40d49eafe8498174538b P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.242126  7005 tablet_replica.cc:333] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.242555  7005 raft_consensus.cc:2243] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.242936  7005 raft_consensus.cc:2272] T 4bfb6592df094e0a8111074b80cb89c5 P 65640e19115147f8acf6f371a65a0214 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.244570  7005 tablet_replica.cc:333] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214: stopping tablet replica
I20260709 13:07:35.244972  7005 raft_consensus.cc:2243] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.245335  7005 raft_consensus.cc:2272] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 65640e19115147f8acf6f371a65a0214 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:35.274340 17157 consensus_peers.cc:597] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 -> Peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Couldn't send request to peer f85a650cd3c44d07b5fbd8f99511f06d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:42227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.281615  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
I20260709 13:07:35.311254  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
W20260709 13:07:35.316349 17157 consensus_peers.cc:597] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 -> Peer 65640e19115147f8acf6f371a65a0214 (127.6.215.66:37943): Couldn't send request to peer 65640e19115147f8acf6f371a65a0214. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:37943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.341545  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:35.342319  7005 tablet_replica.cc:333] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.343056  7005 raft_consensus.cc:2243] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.344070  7005 raft_consensus.cc:2272] T 55a9ee806a744894935ec7a114d60221 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.346532  7005 tablet_replica.cc:333] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.347289  7005 raft_consensus.cc:2243] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:35.347308 17157 consensus_peers.cc:597] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 -> Peer f85a650cd3c44d07b5fbd8f99511f06d (127.6.215.65:42227): Couldn't send request to peer f85a650cd3c44d07b5fbd8f99511f06d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:42227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.347796  7005 raft_consensus.cc:2272] T 5404794018634b3f8f36a8a38dddf532 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.349568  7005 tablet_replica.cc:333] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.350085  7005 raft_consensus.cc:2243] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.350454  7005 raft_consensus.cc:2272] T ea5398427931485690d9f15403a2dab5 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.352069  7005 tablet_replica.cc:333] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.352605  7005 raft_consensus.cc:2243] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.352988  7005 raft_consensus.cc:2272] T 7bc66eae0bde4000a4444facaae4ad03 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.354647  7005 tablet_replica.cc:333] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.355129  7005 raft_consensus.cc:2243] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.355847  7005 raft_consensus.cc:2272] T 793abc267f8c40d49eafe8498174538b P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.357487  7005 tablet_replica.cc:333] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.357973  7005 raft_consensus.cc:2243] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.358349  7005 raft_consensus.cc:2272] T e6fad20c5f56460594318e58ca0cce4f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.360030  7005 tablet_replica.cc:333] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.360584  7005 raft_consensus.cc:2243] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.360972  7005 raft_consensus.cc:2272] T 3ea4f02a1ba5442c82b9ac472ea116d8 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.362788  7005 tablet_replica.cc:333] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.363261  7005 raft_consensus.cc:2243] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.364035  7005 raft_consensus.cc:2272] T 4bfb6592df094e0a8111074b80cb89c5 P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.365705  7005 tablet_replica.cc:333] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.366207  7005 raft_consensus.cc:2243] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.366990  7005 raft_consensus.cc:2272] T eb013bfd9de94bc08f91498855cfbd1e P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.368881  7005 tablet_replica.cc:333] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.369411  7005 raft_consensus.cc:2243] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.369784  7005 raft_consensus.cc:2272] T 396b45f312ef40459875c1ac5c3fa61f P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.371411  7005 tablet_replica.cc:333] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.371879  7005 raft_consensus.cc:2243] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.372542  7005 raft_consensus.cc:2272] T cf321c9ca5c34ceb97c2b8a81a136e38 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.374406  7005 tablet_replica.cc:333] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.374871  7005 raft_consensus.cc:2243] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.375353  7005 raft_consensus.cc:2272] T 25ff3fc31eec4a4f81333e037b0d2f79 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.377161  7005 tablet_replica.cc:333] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.377660  7005 raft_consensus.cc:2243] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.378038  7005 raft_consensus.cc:2272] T b7f3873ba6f442c69d5571528b893a14 P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.379861  7005 tablet_replica.cc:333] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.380339  7005 raft_consensus.cc:2243] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.380734  7005 raft_consensus.cc:2272] T a52b1a2917524e118d30fc4813508883 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.382709  7005 tablet_replica.cc:333] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.383354  7005 raft_consensus.cc:2243] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.384024  7005 raft_consensus.cc:2272] T 9584437fedc242cabbc93bc1021ba0bf P 5dced28973c34f6692b20138fab8a2b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.385928  7005 tablet_replica.cc:333] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.386381  7005 raft_consensus.cc:2243] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.386719  7005 raft_consensus.cc:2272] T 4329a755f77247878e0d59db0e3be79b P 5dced28973c34f6692b20138fab8a2b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.388409  7005 tablet_replica.cc:333] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.388840  7005 raft_consensus.cc:2243] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.389197  7005 raft_consensus.cc:2272] T 57e03d9f0d2741958a6827035af32691 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.390910  7005 tablet_replica.cc:333] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8: stopping tablet replica
I20260709 13:07:35.391335  7005 raft_consensus.cc:2243] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.391709  7005 raft_consensus.cc:2272] T 2328239e139e464fb35d7d777c47b620 P 5dced28973c34f6692b20138fab8a2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.430117  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
I20260709 13:07:35.457981  7005 master.cc:562] Master@127.6.215.126:39177 shutting down...
I20260709 13:07:35.478822  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.479306  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.479660  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P d736dd9bdb644e238f7e18f4c4f74075: stopping tablet replica
I20260709 13:07:35.499167  7005 master.cc:584] Master@127.6.215.126:39177 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12547 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:07:35.544993  7005 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.215.126:40441
I20260709 13:07:35.546037  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:35.550969 17525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:35.551585 17526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:35.552134 17528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:35.552619  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:35.553489  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:35.553704  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:35.553824  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602455553813 us; error 0 us; skew 500 ppm
I20260709 13:07:35.554265  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:35.556530  7005 webserver.cc:533] Webserver started at http://127.6.215.126:38241/ using document root <none> and password file <none>
I20260709 13:07:35.556918  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:35.557065  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:35.557264  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:35.558277  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/master-0-root/instance:
uuid: "913a1b4f54fd462baf2c5ddfe386d281"
format_stamp: "Formatted at 2026-07-09 13:07:35 on dist-test-slave-r31z"
I20260709 13:07:35.563437  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:35.566560 17533 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.567224  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:35.567467  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/master-0-root
uuid: "913a1b4f54fd462baf2c5ddfe386d281"
format_stamp: "Formatted at 2026-07-09 13:07:35 on dist-test-slave-r31z"
I20260709 13:07:35.567726  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:35.595775  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:35.597522  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:35.656862  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.126:40441
I20260709 13:07:35.657097 17585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.126:40441 every 8 connection(s)
I20260709 13:07:35.661883 17586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:35.675408 17586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281: Bootstrap starting.
I20260709 13:07:35.680557 17586 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.684839 17586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281: No bootstrap required, opened a new log
I20260709 13:07:35.687186 17586 raft_consensus.cc:359] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "913a1b4f54fd462baf2c5ddfe386d281" member_type: VOTER }
I20260709 13:07:35.687856 17586 raft_consensus.cc:385] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.688099 17586 raft_consensus.cc:740] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 913a1b4f54fd462baf2c5ddfe386d281, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.688689 17586 consensus_queue.cc:260] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "913a1b4f54fd462baf2c5ddfe386d281" member_type: VOTER }
I20260709 13:07:35.689123 17586 raft_consensus.cc:399] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:35.689364 17586 raft_consensus.cc:493] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:35.689797 17586 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.694626 17586 raft_consensus.cc:515] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "913a1b4f54fd462baf2c5ddfe386d281" member_type: VOTER }
I20260709 13:07:35.695092 17586 leader_election.cc:304] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 913a1b4f54fd462baf2c5ddfe386d281; no voters: 
I20260709 13:07:35.696187 17586 leader_election.cc:290] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:35.696558 17589 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.698060 17589 raft_consensus.cc:697] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 1 LEADER]: Becoming Leader. State: Replica: 913a1b4f54fd462baf2c5ddfe386d281, State: Running, Role: LEADER
I20260709 13:07:35.698769 17589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "913a1b4f54fd462baf2c5ddfe386d281" member_type: VOTER }
I20260709 13:07:35.698954 17586 sys_catalog.cc:565] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:35.705080 17591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 913a1b4f54fd462baf2c5ddfe386d281. Latest consensus state: current_term: 1 leader_uuid: "913a1b4f54fd462baf2c5ddfe386d281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "913a1b4f54fd462baf2c5ddfe386d281" member_type: VOTER } }
I20260709 13:07:35.705760 17591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:35.705173 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "913a1b4f54fd462baf2c5ddfe386d281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "913a1b4f54fd462baf2c5ddfe386d281" member_type: VOTER } }
I20260709 13:07:35.706656 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:35.707712 17598 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:35.714807 17598 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:35.715783  7005 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:35.723984 17598 catalog_manager.cc:1383] Generated new cluster ID: 3cc5bd862d344c59b08ff28d957c2539
I20260709 13:07:35.724277 17598 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:35.749785 17598 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:35.751057 17598 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:35.776473 17598 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281: Generated new TSK 0
I20260709 13:07:35.777415 17598 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:35.782266  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:35.789091 17607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:35.789981 17608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:35.793781  7005 server_base.cc:1061] running on GCE node
W20260709 13:07:35.794006 17611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:35.795163  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:35.795419  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:35.795634  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602455795600 us; error 0 us; skew 500 ppm
I20260709 13:07:35.796295  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:35.799013  7005 webserver.cc:533] Webserver started at http://127.6.215.65:41753/ using document root <none> and password file <none>
I20260709 13:07:35.799468  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:35.799664  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:35.799961  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:35.801370  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-0-root/instance:
uuid: "93a60cf4fc4e47298fad3224ae393a4e"
format_stamp: "Formatted at 2026-07-09 13:07:35 on dist-test-slave-r31z"
I20260709 13:07:35.805922  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:35.809437 17615 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.810146  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:07:35.810410  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-0-root
uuid: "93a60cf4fc4e47298fad3224ae393a4e"
format_stamp: "Formatted at 2026-07-09 13:07:35 on dist-test-slave-r31z"
I20260709 13:07:35.810676  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:35.833678  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:35.834906  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:35.836315  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:35.838656  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:35.838853  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.839110  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:35.839314  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.884277  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.65:40633
I20260709 13:07:35.884384 17677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.65:40633 every 8 connection(s)
I20260709 13:07:35.889024  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:35.896473 17682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:35.898300 17683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:35.900312 17685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:35.901297  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:35.903097  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:35.903328  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:35.903527  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602455903510 us; error 0 us; skew 500 ppm
I20260709 13:07:35.904243  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:35.904296 17678 heartbeater.cc:344] Connected to a master server at 127.6.215.126:40441
I20260709 13:07:35.904664 17678 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:35.905550 17678 heartbeater.cc:507] Master 127.6.215.126:40441 requested a full tablet report, sending...
I20260709 13:07:35.907011  7005 webserver.cc:533] Webserver started at http://127.6.215.66:37533/ using document root <none> and password file <none>
I20260709 13:07:35.907593  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:35.907776  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:35.908015  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:35.907963 17551 ts_manager.cc:194] Registered new tserver with Master: 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:35.909554  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-1-root/instance:
uuid: "e6537a4c3753400e8bba662080f00b7d"
format_stamp: "Formatted at 2026-07-09 13:07:35 on dist-test-slave-r31z"
I20260709 13:07:35.910179 17551 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39624
I20260709 13:07:35.914566  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:35.917999 17690 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.918648  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:35.918900  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-1-root
uuid: "e6537a4c3753400e8bba662080f00b7d"
format_stamp: "Formatted at 2026-07-09 13:07:35 on dist-test-slave-r31z"
I20260709 13:07:35.919157  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:35.950079  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:35.951200  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:35.952555  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:35.954743  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:35.954936  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.955165  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:35.955370  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:35.997138  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.66:40467
I20260709 13:07:35.997239 17752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.66:40467 every 8 connection(s)
I20260709 13:07:36.002097  7005 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.008657 17756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.011265 17757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.012283 17759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.012631  7005 server_base.cc:1061] running on GCE node
I20260709 13:07:36.013922 17753 heartbeater.cc:344] Connected to a master server at 127.6.215.126:40441
I20260709 13:07:36.013970  7005 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.014510  7005 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.014547 17753 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.014658  7005 hybrid_clock.cc:648] HybridClock initialized: now 1783602456014647 us; error 0 us; skew 500 ppm
I20260709 13:07:36.015652  7005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.015750 17753 heartbeater.cc:507] Master 127.6.215.126:40441 requested a full tablet report, sending...
I20260709 13:07:36.017920 17551 ts_manager.cc:194] Registered new tserver with Master: e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.018358  7005 webserver.cc:533] Webserver started at http://127.6.215.67:41485/ using document root <none> and password file <none>
I20260709 13:07:36.018874  7005 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.019054  7005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.019289  7005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.019443 17551 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39630
I20260709 13:07:36.021023  7005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-2-root/instance:
uuid: "7c224ad6ecab4bda8d05a8575cd52774"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-r31z"
I20260709 13:07:36.025810  7005 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:07:36.029173 17764 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.030020  7005 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:07:36.030290  7005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-2-root
uuid: "7c224ad6ecab4bda8d05a8575cd52774"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-r31z"
I20260709 13:07:36.030560  7005 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskMQqPY7/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132286331-7005-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.052371  7005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.053601  7005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.055089  7005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.058089  7005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.058343  7005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.058607  7005 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.058779  7005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.108734  7005 rpc_server.cc:307] RPC server started. Bound to: 127.6.215.67:45477
I20260709 13:07:36.108857 17826 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.215.67:45477 every 8 connection(s)
I20260709 13:07:36.123404 17827 heartbeater.cc:344] Connected to a master server at 127.6.215.126:40441
I20260709 13:07:36.123875 17827 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.124712 17827 heartbeater.cc:507] Master 127.6.215.126:40441 requested a full tablet report, sending...
I20260709 13:07:36.126714 17551 ts_manager.cc:194] Registered new tserver with Master: 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.126891  7005 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014910018s
I20260709 13:07:36.128058 17551 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39642
I20260709 13:07:36.152333 17551 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39648:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:36.155017 17551 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:36.226403 17718 tablet_service.cc:1511] Processing CreateTablet for tablet ac4c9cc396ae4bb5a08beed6d56412f5 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:36.227941 17718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4c9cc396ae4bb5a08beed6d56412f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.230585 17717 tablet_service.cc:1511] Processing CreateTablet for tablet 6500bb507c4749cb8035b4ce7c74461c (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:36.232170 17717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6500bb507c4749cb8035b4ce7c74461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.234903 17716 tablet_service.cc:1511] Processing CreateTablet for tablet 60549dbf5f124f1fb8a0a3afd74aa8b8 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:36.236634 17716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60549dbf5f124f1fb8a0a3afd74aa8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.242795 17715 tablet_service.cc:1511] Processing CreateTablet for tablet 44b8cc8a5741468cb5d9a3876e020188 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:36.243201 17714 tablet_service.cc:1511] Processing CreateTablet for tablet 52a4704f7c374728868027127171513f (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:36.244383 17715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b8cc8a5741468cb5d9a3876e020188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.245579 17713 tablet_service.cc:1511] Processing CreateTablet for tablet 8db72511366941e88df0a824a3d4cb79 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:36.246870 17713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db72511366941e88df0a824a3d4cb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.250451 17712 tablet_service.cc:1511] Processing CreateTablet for tablet 359bae5c513c4be193f7d42aed1250e6 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:36.251804 17712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359bae5c513c4be193f7d42aed1250e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.254889 17714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a4704f7c374728868027127171513f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.254544 17711 tablet_service.cc:1511] Processing CreateTablet for tablet 19581d1a91374a01bfc271ffc9ea6558 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:36.255846 17711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19581d1a91374a01bfc271ffc9ea6558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.254544 17710 tablet_service.cc:1511] Processing CreateTablet for tablet b6e4003d1f254fbca9c2a3157b56b968 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:36.264344 17710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e4003d1f254fbca9c2a3157b56b968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.270277 17792 tablet_service.cc:1511] Processing CreateTablet for tablet ac4c9cc396ae4bb5a08beed6d56412f5 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:36.271703 17792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4c9cc396ae4bb5a08beed6d56412f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.283397 17791 tablet_service.cc:1511] Processing CreateTablet for tablet 6500bb507c4749cb8035b4ce7c74461c (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:36.284973 17791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6500bb507c4749cb8035b4ce7c74461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.291157 17790 tablet_service.cc:1511] Processing CreateTablet for tablet 60549dbf5f124f1fb8a0a3afd74aa8b8 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:36.292701 17790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60549dbf5f124f1fb8a0a3afd74aa8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.294866 17789 tablet_service.cc:1511] Processing CreateTablet for tablet 44b8cc8a5741468cb5d9a3876e020188 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:36.296988 17789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b8cc8a5741468cb5d9a3876e020188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.298796 17788 tablet_service.cc:1511] Processing CreateTablet for tablet 52a4704f7c374728868027127171513f (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:36.302650 17786 tablet_service.cc:1511] Processing CreateTablet for tablet 359bae5c513c4be193f7d42aed1250e6 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:36.305182 17785 tablet_service.cc:1511] Processing CreateTablet for tablet 19581d1a91374a01bfc271ffc9ea6558 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:36.307708 17784 tablet_service.cc:1511] Processing CreateTablet for tablet b6e4003d1f254fbca9c2a3157b56b968 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:36.309809 17787 tablet_service.cc:1511] Processing CreateTablet for tablet 8db72511366941e88df0a824a3d4cb79 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:36.318325 17786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359bae5c513c4be193f7d42aed1250e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.320603 17784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e4003d1f254fbca9c2a3157b56b968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.325637 17785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19581d1a91374a01bfc271ffc9ea6558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.327411 17787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db72511366941e88df0a824a3d4cb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.329685 17788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a4704f7c374728868027127171513f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.350524 17842 tablet_bootstrap.cc:492] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.356602 17841 tablet_bootstrap.cc:492] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.357239 17643 tablet_service.cc:1511] Processing CreateTablet for tablet ac4c9cc396ae4bb5a08beed6d56412f5 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:36.358570 17643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4c9cc396ae4bb5a08beed6d56412f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.358428 17641 tablet_service.cc:1511] Processing CreateTablet for tablet 60549dbf5f124f1fb8a0a3afd74aa8b8 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:36.359724 17636 tablet_service.cc:1511] Processing CreateTablet for tablet 19581d1a91374a01bfc271ffc9ea6558 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:36.360610 17640 tablet_service.cc:1511] Processing CreateTablet for tablet 44b8cc8a5741468cb5d9a3876e020188 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:36.362449 17639 tablet_service.cc:1511] Processing CreateTablet for tablet 52a4704f7c374728868027127171513f (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:36.362782 17635 tablet_service.cc:1511] Processing CreateTablet for tablet b6e4003d1f254fbca9c2a3157b56b968 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:36.362802 17638 tablet_service.cc:1511] Processing CreateTablet for tablet 8db72511366941e88df0a824a3d4cb79 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:36.364418 17642 tablet_service.cc:1511] Processing CreateTablet for tablet 6500bb507c4749cb8035b4ce7c74461c (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:36.363895 17637 tablet_service.cc:1511] Processing CreateTablet for tablet 359bae5c513c4be193f7d42aed1250e6 (DEFAULT_TABLE table=test-workload [id=14fdfb9fcaa746f7b237c66f09b8f2e6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:36.369105 17841 tablet_bootstrap.cc:654] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.361023 17636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19581d1a91374a01bfc271ffc9ea6558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.373713 17635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e4003d1f254fbca9c2a3157b56b968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.375947 17638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db72511366941e88df0a824a3d4cb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.378054 17639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a4704f7c374728868027127171513f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.380686 17640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b8cc8a5741468cb5d9a3876e020188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.382313 17642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6500bb507c4749cb8035b4ce7c74461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.385704 17637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359bae5c513c4be193f7d42aed1250e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.389714 17641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60549dbf5f124f1fb8a0a3afd74aa8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.429611 17844 tablet_bootstrap.cc:492] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.437203 17844 tablet_bootstrap.cc:654] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.451506 17842 tablet_bootstrap.cc:654] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.454463 17841 tablet_bootstrap.cc:492] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.456635 17841 ts_tablet_manager.cc:1403] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.100s	user 0.042s	sys 0.040s
I20260709 13:07:36.459879 17841 raft_consensus.cc:359] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.460677 17841 raft_consensus.cc:385] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.460965 17841 raft_consensus.cc:740] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.462226 17841 consensus_queue.cc:260] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.463835 17842 tablet_bootstrap.cc:492] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.464274 17842 ts_tablet_manager.cc:1403] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.006s
I20260709 13:07:36.464856 17844 tablet_bootstrap.cc:492] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.465435 17844 ts_tablet_manager.cc:1403] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 13:07:36.466539 17842 raft_consensus.cc:359] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.467085 17842 raft_consensus.cc:385] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.467372 17842 raft_consensus.cc:740] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.468190 17753 heartbeater.cc:499] Master 127.6.215.126:40441 was elected leader, sending a full tablet report...
I20260709 13:07:36.468662 17841 ts_tablet_manager.cc:1434] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:07:36.468252 17844 raft_consensus.cc:359] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.472685 17844 raft_consensus.cc:385] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.468223 17842 consensus_queue.cc:260] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.473176 17844 raft_consensus.cc:740] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.473605 17841 tablet_bootstrap.cc:492] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.474428 17844 consensus_queue.cc:260] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.481731 17841 tablet_bootstrap.cc:654] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.482475 17844 ts_tablet_manager.cc:1434] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:07:36.483243 17678 heartbeater.cc:499] Master 127.6.215.126:40441 was elected leader, sending a full tablet report...
I20260709 13:07:36.498099 17844 tablet_bootstrap.cc:492] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.505859 17842 ts_tablet_manager.cc:1434] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.041s	user 0.022s	sys 0.020s
I20260709 13:07:36.505767 17844 tablet_bootstrap.cc:654] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.508179 17841 tablet_bootstrap.cc:492] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.508665 17841 ts_tablet_manager.cc:1403] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.023s
I20260709 13:07:36.510123 17827 heartbeater.cc:499] Master 127.6.215.126:40441 was elected leader, sending a full tablet report...
I20260709 13:07:36.510984 17842 tablet_bootstrap.cc:492] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.511294 17841 raft_consensus.cc:359] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.512020 17841 raft_consensus.cc:385] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.512315 17841 raft_consensus.cc:740] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.513216 17841 consensus_queue.cc:260] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.515823 17841 ts_tablet_manager.cc:1434] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:36.516799 17841 tablet_bootstrap.cc:492] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.522056 17842 tablet_bootstrap.cc:654] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.523712 17841 tablet_bootstrap.cc:654] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.526569 17844 tablet_bootstrap.cc:492] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.527082 17844 ts_tablet_manager.cc:1403] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.011s
I20260709 13:07:36.530144 17844 raft_consensus.cc:359] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.530835 17844 raft_consensus.cc:385] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.531112 17844 raft_consensus.cc:740] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.531935 17844 consensus_queue.cc:260] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.542423 17844 ts_tablet_manager.cc:1434] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:07:36.547828 17841 tablet_bootstrap.cc:492] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.548416 17841 ts_tablet_manager.cc:1403] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.003s
I20260709 13:07:36.549417 17842 tablet_bootstrap.cc:492] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.549932 17842 ts_tablet_manager.cc:1403] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.011s
I20260709 13:07:36.551050 17844 tablet_bootstrap.cc:492] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.551270 17841 raft_consensus.cc:359] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.551993 17841 raft_consensus.cc:385] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.552278 17841 raft_consensus.cc:740] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.553164 17841 consensus_queue.cc:260] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.554102 17842 raft_consensus.cc:359] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.555137 17842 raft_consensus.cc:385] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.555465 17842 raft_consensus.cc:740] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.555861 17841 ts_tablet_manager.cc:1434] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:36.557443 17841 tablet_bootstrap.cc:492] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.557060 17842 consensus_queue.cc:260] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.558192 17844 tablet_bootstrap.cc:654] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.562965 17842 ts_tablet_manager.cc:1434] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:36.564201 17842 tablet_bootstrap.cc:492] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.565528 17841 tablet_bootstrap.cc:654] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.571244 17842 tablet_bootstrap.cc:654] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.571979 17849 raft_consensus.cc:493] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.572579 17849 raft_consensus.cc:515] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.575878 17849 leader_election.cc:290] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.592612 17842 tablet_bootstrap.cc:492] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.593196 17842 ts_tablet_manager.cc:1403] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.007s
I20260709 13:07:36.596095 17842 raft_consensus.cc:359] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.596799 17842 raft_consensus.cc:385] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.597086 17842 raft_consensus.cc:740] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.599267 17842 consensus_queue.cc:260] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.600930 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.601781 17728 raft_consensus.cc:2468] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:36.601868 17842 ts_tablet_manager.cc:1434] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:36.603372 17842 tablet_bootstrap.cc:492] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.603403 17619 leader_election.cc:304] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.605100 17841 tablet_bootstrap.cc:492] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.605333 17849 raft_consensus.cc:2804] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.605971 17849 raft_consensus.cc:493] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.606348 17849 raft_consensus.cc:3060] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.610095 17802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.610749 17844 tablet_bootstrap.cc:492] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.611270 17844 ts_tablet_manager.cc:1403] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.027s
I20260709 13:07:36.611707 17842 tablet_bootstrap.cc:654] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:36.611943 17618 leader_election.cc:343] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.605782 17841 ts_tablet_manager.cc:1403] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.006s
I20260709 13:07:36.614472 17844 raft_consensus.cc:359] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.615243 17844 raft_consensus.cc:385] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.615536 17844 raft_consensus.cc:740] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.616257 17844 consensus_queue.cc:260] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.618857 17841 raft_consensus.cc:359] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.619827 17841 raft_consensus.cc:385] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.619395 17849 raft_consensus.cc:515] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.620206 17841 raft_consensus.cc:740] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.621291 17841 consensus_queue.cc:260] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.623250 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:36.623854 17728 raft_consensus.cc:3060] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.627200 17841 ts_tablet_manager.cc:1434] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:07:36.628455 17841 tablet_bootstrap.cc:492] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.636075 17842 tablet_bootstrap.cc:492] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.636654 17842 ts_tablet_manager.cc:1403] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.016s
I20260709 13:07:36.636888 17841 tablet_bootstrap.cc:654] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.640332 17842 raft_consensus.cc:359] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.641306 17842 raft_consensus.cc:385] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.641680 17842 raft_consensus.cc:740] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.642642 17842 consensus_queue.cc:260] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.646484 17728 raft_consensus.cc:2468] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:36.648866 17802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
W20260709 13:07:36.651132 17618 leader_election.cc:343] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.649477 17849 leader_election.cc:290] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.652558 17842 ts_tablet_manager.cc:1434] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:07:36.658016 17619 leader_election.cc:304] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 7c224ad6ecab4bda8d05a8575cd52774
I20260709 13:07:36.659545 17849 raft_consensus.cc:2804] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.660209 17849 raft_consensus.cc:697] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:36.662305 17842 tablet_bootstrap.cc:492] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.661152 17849 consensus_queue.cc:237] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.667894 17844 ts_tablet_manager.cc:1434] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.056s	user 0.028s	sys 0.028s
I20260709 13:07:36.669155 17844 tablet_bootstrap.cc:492] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.670742 17842 tablet_bootstrap.cc:654] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.671983 17841 tablet_bootstrap.cc:492] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.672508 17841 ts_tablet_manager.cc:1403] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 13:07:36.676294 17841 raft_consensus.cc:359] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.677275 17841 raft_consensus.cc:385] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.677835 17841 raft_consensus.cc:740] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.678522 17844 tablet_bootstrap.cc:654] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.678785 17841 consensus_queue.cc:260] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.679980 17549 catalog_manager.cc:5697] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.686704 17841 ts_tablet_manager.cc:1434] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:07:36.687997 17841 tablet_bootstrap.cc:492] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.695684 17841 tablet_bootstrap.cc:654] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.699733 17844 tablet_bootstrap.cc:492] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.700282 17842 tablet_bootstrap.cc:492] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.700371 17844 ts_tablet_manager.cc:1403] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.001s
I20260709 13:07:36.701217 17842 ts_tablet_manager.cc:1403] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.013s
I20260709 13:07:36.704365 17842 raft_consensus.cc:359] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.705109 17842 raft_consensus.cc:385] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.705446 17842 raft_consensus.cc:740] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.705291 17844 raft_consensus.cc:359] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.706354 17844 raft_consensus.cc:385] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.706702 17844 raft_consensus.cc:740] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.706700 17842 consensus_queue.cc:260] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.708990 17842 ts_tablet_manager.cc:1434] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:07:36.709163 17841 tablet_bootstrap.cc:492] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.709694 17841 ts_tablet_manager.cc:1403] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:07:36.709658 17849 raft_consensus.cc:493] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.709972 17599 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:36.710290 17849 raft_consensus.cc:515] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.710716 17844 consensus_queue.cc:260] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.712445 17849 leader_election.cc:290] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.712908 17841 raft_consensus.cc:359] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.713907 17841 raft_consensus.cc:385] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.714308 17841 raft_consensus.cc:740] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.714673 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bae5c513c4be193f7d42aed1250e6" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.715293 17841 consensus_queue.cc:260] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
W20260709 13:07:36.716615 17619 leader_election.cc:343] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.716908 17844 ts_tablet_manager.cc:1434] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:07:36.717696 17841 ts_tablet_manager.cc:1434] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:36.717991 17842 tablet_bootstrap.cc:492] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.718313 17844 tablet_bootstrap.cc:492] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.721136 17841 tablet_bootstrap.cc:492] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.717492 17802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bae5c513c4be193f7d42aed1250e6" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.725503 17844 tablet_bootstrap.cc:654] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:36.726712 17618 leader_election.cc:343] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.727031 17842 tablet_bootstrap.cc:654] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.727177 17618 leader_election.cc:304] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e; no voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:36.727895 17841 tablet_bootstrap.cc:654] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.728525 17849 raft_consensus.cc:2749] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.731832 17844 tablet_bootstrap.cc:492] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.732321 17844 ts_tablet_manager.cc:1403] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:07:36.734094 17841 tablet_bootstrap.cc:492] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.734567 17841 ts_tablet_manager.cc:1403] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:07:36.735229 17844 raft_consensus.cc:359] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.735967 17844 raft_consensus.cc:385] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.736267 17844 raft_consensus.cc:740] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.737183 17844 consensus_queue.cc:260] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.737691 17841 raft_consensus.cc:359] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.738539 17841 raft_consensus.cc:385] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.738803 17841 raft_consensus.cc:740] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.739688 17844 ts_tablet_manager.cc:1434] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:07:36.739478 17841 consensus_queue.cc:260] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.740698 17844 tablet_bootstrap.cc:492] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.737838 17847 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.743705 17847 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.747102 17844 tablet_bootstrap.cc:654] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.748926 17847 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:36.757789 17847 raft_consensus.cc:493] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.758083 17842 tablet_bootstrap.cc:492] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.758723 17842 ts_tablet_manager.cc:1403] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
I20260709 13:07:36.758302 17847 raft_consensus.cc:515] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.760388 17847 leader_election.cc:290] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.762005 17842 raft_consensus.cc:359] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.762797 17842 raft_consensus.cc:385] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.763057 17842 raft_consensus.cc:740] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.763827 17842 consensus_queue.cc:260] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.764550 17849 raft_consensus.cc:493] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.765080 17849 raft_consensus.cc:515] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.767342 17849 leader_election.cc:290] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.768589 17802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.768996 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.769354 17802 raft_consensus.cc:2468] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:36.769748 17728 raft_consensus.cc:2468] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:36.771288 17619 leader_election.cc:304] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.771845 17842 ts_tablet_manager.cc:1434] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:07:36.772181 17849 raft_consensus.cc:2804] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.772619 17849 raft_consensus.cc:493] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.772938 17849 raft_consensus.cc:3060] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.772833 17842 tablet_bootstrap.cc:492] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.777275 17841 ts_tablet_manager.cc:1434] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.042s	user 0.024s	sys 0.014s
I20260709 13:07:36.780251 17841 tablet_bootstrap.cc:492] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.780781 17848 raft_consensus.cc:493] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.781302 17848 raft_consensus.cc:515] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.782244 17842 tablet_bootstrap.cc:654] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.786468 17841 tablet_bootstrap.cc:654] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.790648 17848 leader_election.cc:290] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.796319 17849 raft_consensus.cc:515] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.798974 17848 raft_consensus.cc:493] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.799597 17848 raft_consensus.cc:515] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.802063 17848 leader_election.cc:290] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.809935 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:36.810725 17728 raft_consensus.cc:3060] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.819191 17728 raft_consensus.cc:2468] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:36.820575 17619 leader_election.cc:304] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.821739 17860 raft_consensus.cc:2804] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.824040 17848 raft_consensus.cc:493] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.824702 17848 raft_consensus.cc:515] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.827062 17848 leader_election.cc:290] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.837951 17802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:36.838728 17802 raft_consensus.cc:3060] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.839320 17844 tablet_bootstrap.cc:492] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.839965 17844 ts_tablet_manager.cc:1403] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.032s
I20260709 13:07:36.843689 17844 raft_consensus.cc:359] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.844583 17844 raft_consensus.cc:385] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.844893 17848 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.845506 17848 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.844888 17844 raft_consensus.cc:740] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.846593 17844 consensus_queue.cc:260] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.847496 17802 raft_consensus.cc:2468] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:36.848253 17848 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:36.837881 17849 leader_election.cc:290] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.851728 17860 raft_consensus.cc:697] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:36.852689 17869 raft_consensus.cc:493] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.853229 17869 raft_consensus.cc:515] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.854868 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.855347 17869 leader_election.cc:290] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.856076 17801 raft_consensus.cc:2468] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:36.857636 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.857707 17693 leader_election.cc:304] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.858599 17800 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:36.858916 17869 raft_consensus.cc:2804] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.859366 17869 raft_consensus.cc:493] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.859714 17869 raft_consensus.cc:3060] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.861529 17802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.852802 17860 consensus_queue.cc:237] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.865262 17727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.871738 17727 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:36.865727 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.867223 17693 leader_election.cc:304] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.868963 17869 raft_consensus.cc:515] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.869884 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.877712 17847 raft_consensus.cc:2804] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.870802 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.878093 17847 raft_consensus.cc:493] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.878083 17726 raft_consensus.cc:2468] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:36.878625 17847 raft_consensus.cc:3060] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.879215 17869 leader_election.cc:290] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.879721 17725 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:36.871704 17802 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:36.873867 17768 leader_election.cc:304] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.881104 17728 raft_consensus.cc:2393] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate e6537a4c3753400e8bba662080f00b7d in this term.
I20260709 13:07:36.881673 17768 leader_election.cc:304] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.882882 17848 raft_consensus.cc:2804] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.883266 17848 raft_consensus.cc:493] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.883597 17848 raft_consensus.cc:3060] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.885298 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:36.886054 17800 raft_consensus.cc:3060] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.887480 17847 raft_consensus.cc:515] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.888652 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.889328 17652 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:36.891075 17847 leader_election.cc:290] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.903285 17844 ts_tablet_manager.cc:1434] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.063s	user 0.016s	sys 0.014s
I20260709 13:07:36.904407 17844 tablet_bootstrap.cc:492] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:36.904958 17649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.905818 17648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.906471 17648 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:36.907497 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:36.890936 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:36.890283 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.890715 17650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.889856 17653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.911255 17844 tablet_bootstrap.cc:654] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:36.911168 17767 leader_election.cc:343] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:36.911947 17767 leader_election.cc:343] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.900158 17869 raft_consensus.cc:493] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.912117 17693 leader_election.cc:343] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:36.912982 17767 leader_election.cc:343] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.912997 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:36.915505 17768 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:36.915516 17647 raft_consensus.cc:3060] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:36.917994 17693 leader_election.cc:343] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.918807 17693 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.920009 17847 raft_consensus.cc:2804] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.920521 17847 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.920584 17841 tablet_bootstrap.cc:492] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:36.920926 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.921145 17847 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.921481 17841 ts_tablet_manager.cc:1403] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.141s	user 0.036s	sys 0.055s
I20260709 13:07:36.923774 17549 catalog_manager.cc:5697] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.924772 17841 raft_consensus.cc:359] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.925521 17841 raft_consensus.cc:385] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.925781 17841 raft_consensus.cc:740] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.913908 17869 raft_consensus.cc:515] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.929492 17841 consensus_queue.cc:260] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
W20260709 13:07:36.927183 17693 leader_election.cc:343] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.932237 17880 raft_consensus.cc:2804] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.934895 17800 raft_consensus.cc:2468] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:36.936089 17880 raft_consensus.cc:493] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.936977 17693 leader_election.cc:304] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:36.935310 17848 raft_consensus.cc:515] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.940610 17801 raft_consensus.cc:2393] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6537a4c3753400e8bba662080f00b7d in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:36.941113 17848 leader_election.cc:290] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.941802 17848 raft_consensus.cc:2804] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.942168 17848 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.942567 17848 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.943084 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:36.938534 17880 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.948910 17841 ts_tablet_manager.cc:1434] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.005s
I20260709 13:07:36.951068 17842 tablet_bootstrap.cc:492] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:36.951597 17842 ts_tablet_manager.cc:1403] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.048s
I20260709 13:07:36.958741 17841 tablet_bootstrap.cc:492] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:36.958987 17768 leader_election.cc:304] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:36.963511 17869 leader_election.cc:290] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:36.967034 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.968222 17647 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:36.968756 17652 raft_consensus.cc:2468] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:36.969830 17693 leader_election.cc:304] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 7c224ad6ecab4bda8d05a8575cd52774
I20260709 13:07:36.959157 17842 raft_consensus.cc:359] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.971320 17842 raft_consensus.cc:385] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.971634 17842 raft_consensus.cc:740] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.972801 17885 raft_consensus.cc:2804] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.972457 17842 consensus_queue.cc:260] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.974385 17882 raft_consensus.cc:493] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.974926 17882 raft_consensus.cc:515] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.975577 17880 raft_consensus.cc:515] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.967876 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:36.972399 17848 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.978524 17801 raft_consensus.cc:2468] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:36.979560 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:36.979803 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:36.968037 17869 raft_consensus.cc:2804] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.981070 17652 raft_consensus.cc:2468] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:36.981468 17869 raft_consensus.cc:697] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
W20260709 13:07:36.981812 17767 leader_election.cc:343] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.980121 17883 raft_consensus.cc:2749] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.983151 17848 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:36.984241 17842 ts_tablet_manager.cc:1434] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 13:07:36.985232 17880 leader_election.cc:290] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.986481 17869 consensus_queue.cc:237] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.991158 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:36.991923 17882 leader_election.cc:290] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:36.987934 17844 tablet_bootstrap.cc:492] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:36.997187 17844 ts_tablet_manager.cc:1403] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.013s
I20260709 13:07:36.999266 17882 raft_consensus.cc:493] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.999408 17844 raft_consensus.cc:359] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.000237 17844 raft_consensus.cc:385] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.999778 17882 raft_consensus.cc:515] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:36.988384 17693 leader_election.cc:304] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:36.989043 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:36.992213 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:36.966619 17847 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:36.992898 17885 raft_consensus.cc:697] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:36.992987 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:37.001899 17726 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.002240 17885 consensus_queue.cc:237] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.002800 17847 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:37.003667 17725 raft_consensus.cc:2393] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate e6537a4c3753400e8bba662080f00b7d in this term.
I20260709 13:07:37.001381 17869 raft_consensus.cc:2804] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.004781 17869 raft_consensus.cc:493] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.005112 17869 raft_consensus.cc:3060] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.005045 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
W20260709 13:07:37.007627 17693 leader_election.cc:343] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.994306 17727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:36.996008 17842 tablet_bootstrap.cc:492] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:36.996639 17841 tablet_bootstrap.cc:654] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.010128 17726 raft_consensus.cc:2468] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:37.000646 17844 raft_consensus.cc:740] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.987823 17767 leader_election.cc:304] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:37.011807 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
W20260709 13:07:37.011686 17767 leader_election.cc:343] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.012583 17801 raft_consensus.cc:2393] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6537a4c3753400e8bba662080f00b7d in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:37.012552 17767 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:37.013331 17880 raft_consensus.cc:2804] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.014355 17693 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6537a4c3753400e8bba662080f00b7d; no voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:37.011296 17768 leader_election.cc:304] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:37.014653 17880 raft_consensus.cc:493] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.013852 17844 consensus_queue.cc:260] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.015219 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a4704f7c374728868027127171513f" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:37.015530 17883 raft_consensus.cc:2804] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.016295 17647 raft_consensus.cc:2468] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:37.015494 17847 raft_consensus.cc:2749] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.016593 17883 raft_consensus.cc:697] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:37.017716 17767 leader_election.cc:304] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:37.015348 17848 raft_consensus.cc:2749] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.018854 17888 raft_consensus.cc:2804] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.019655 17888 raft_consensus.cc:493] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.020182 17888 raft_consensus.cc:3060] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.018965 17883 consensus_queue.cc:237] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.021327 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a4704f7c374728868027127171513f" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:37.022069 17726 raft_consensus.cc:2468] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:37.014591 17882 leader_election.cc:290] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:37.023926 17842 tablet_bootstrap.cc:654] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.012540 17869 raft_consensus.cc:515] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.027245 17727 raft_consensus.cc:2393] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate e6537a4c3753400e8bba662080f00b7d in this term.
I20260709 13:07:37.015264 17880 raft_consensus.cc:3060] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.031060 17768 leader_election.cc:304] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:37.028954 17888 raft_consensus.cc:515] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.032442 17882 raft_consensus.cc:2749] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.036347 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a4704f7c374728868027127171513f" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:37.037114 17647 raft_consensus.cc:3060] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.038307 17550 catalog_manager.cc:5697] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.036249 17844 ts_tablet_manager.cc:1434] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:07:37.043149 17869 leader_election.cc:290] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:37.044226 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:37.044860 17652 raft_consensus.cc:3060] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.046207 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:37.044471 17844 tablet_bootstrap.cc:492] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:37.052886 17652 raft_consensus.cc:2468] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:37.054157 17693 leader_election.cc:304] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:37.055172 17869 raft_consensus.cc:2804] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.055953 17869 raft_consensus.cc:697] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:37.056753 17869 consensus_queue.cc:237] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.058147 17549 catalog_manager.cc:5697] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.059579 17844 tablet_bootstrap.cc:654] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.059688 17551 catalog_manager.cc:5697] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.063119 17842 tablet_bootstrap.cc:492] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:37.063643 17842 ts_tablet_manager.cc:1403] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.004s
I20260709 13:07:37.066495 17842 raft_consensus.cc:359] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.067147 17842 raft_consensus.cc:385] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.067462 17842 raft_consensus.cc:740] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.068310 17842 consensus_queue.cc:260] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.069250 17860 consensus_queue.cc:1048] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:37.070210 17842 ts_tablet_manager.cc:1434] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:07:37.071038 17842 tablet_bootstrap.cc:492] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:37.054198 17880 raft_consensus.cc:515] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.077991 17801 raft_consensus.cc:2393] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6537a4c3753400e8bba662080f00b7d in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:37.080145 17880 leader_election.cc:290] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:37.082319 17727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:37.083647 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:37.084636 17652 raft_consensus.cc:2393] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate e6537a4c3753400e8bba662080f00b7d in this term.
I20260709 13:07:37.086072 17767 leader_election.cc:304] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:37.088376 17727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a4704f7c374728868027127171513f" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:37.089133 17727 raft_consensus.cc:3060] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.075668 17842 tablet_bootstrap.cc:654] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.077144 17841 tablet_bootstrap.cc:492] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:37.093472 17841 ts_tablet_manager.cc:1403] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.135s	user 0.007s	sys 0.008s
I20260709 13:07:37.093530 17880 raft_consensus.cc:2749] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.086089 17647 raft_consensus.cc:2468] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:37.096153 17767 leader_election.cc:304] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:37.097322 17880 raft_consensus.cc:2804] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.098850 17880 raft_consensus.cc:697] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:37.100571 17880 consensus_queue.cc:237] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.097677 17841 raft_consensus.cc:359] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.101646 17888 leader_election.cc:290] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:37.102083 17841 raft_consensus.cc:385] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.102443 17841 raft_consensus.cc:740] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.103219 17841 consensus_queue.cc:260] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.105624 17841 ts_tablet_manager.cc:1434] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:37.113088 17551 catalog_manager.cc:5697] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.147912 17727 raft_consensus.cc:2468] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
W20260709 13:07:37.158718 17618 consensus_peers.cc:597] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e -> Peer 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477): Couldn't send request to peer 7c224ad6ecab4bda8d05a8575cd52774. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:37.164878 17842 tablet_bootstrap.cc:492] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:37.165463 17842 ts_tablet_manager.cc:1403] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.044s
I20260709 13:07:37.167877 17842 raft_consensus.cc:359] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.168524 17842 raft_consensus.cc:385] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.168779 17842 raft_consensus.cc:740] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.169478 17842 consensus_queue.cc:260] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.171152 17844 tablet_bootstrap.cc:492] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:37.169551 17550 catalog_manager.cc:5697] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.171551 17842 ts_tablet_manager.cc:1434] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:37.171701 17844 ts_tablet_manager.cc:1403] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.127s	user 0.057s	sys 0.048s
I20260709 13:07:37.174386 17844 raft_consensus.cc:359] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:37.175000 17844 raft_consensus.cc:385] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.175246 17844 raft_consensus.cc:740] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.175879 17844 consensus_queue.cc:260] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:37.178153 17844 ts_tablet_manager.cc:1434] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:37.179171 17844 tablet_bootstrap.cc:492] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:37.184387 17844 tablet_bootstrap.cc:654] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.188746 17844 tablet_bootstrap.cc:492] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:37.189211 17844 ts_tablet_manager.cc:1403] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:07:37.191083 17844 raft_consensus.cc:359] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.191524 17844 raft_consensus.cc:385] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.191689 17844 raft_consensus.cc:740] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.192436 17844 consensus_queue.cc:260] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.194269 17844 ts_tablet_manager.cc:1434] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:37.248839 17869 raft_consensus.cc:493] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.249429 17869 raft_consensus.cc:515] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.251103 17869 leader_election.cc:290] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:37.251989 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bae5c513c4be193f7d42aed1250e6" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:37.252156 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bae5c513c4be193f7d42aed1250e6" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:37.252686 17647 raft_consensus.cc:2468] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:37.252725 17801 raft_consensus.cc:2468] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:37.253984 17693 leader_election.cc:304] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:37.254595 17869 raft_consensus.cc:2804] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.254962 17869 raft_consensus.cc:493] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.255308 17869 raft_consensus.cc:3060] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.260308 17869 raft_consensus.cc:515] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.261844 17869 leader_election.cc:290] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:37.262633 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bae5c513c4be193f7d42aed1250e6" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:37.262797 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bae5c513c4be193f7d42aed1250e6" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:37.263139 17647 raft_consensus.cc:3060] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.263310 17801 raft_consensus.cc:3060] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.268157 17801 raft_consensus.cc:2468] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:37.268313 17647 raft_consensus.cc:2468] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:37.269140 17693 leader_election.cc:304] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:37.269791 17869 raft_consensus.cc:2804] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.270154 17869 raft_consensus.cc:697] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:37.270869 17869 consensus_queue.cc:237] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.278079 17550 catalog_manager.cc:5697] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.322908 17849 consensus_queue.cc:1048] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.334717 17849 consensus_queue.cc:1048] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.343019 17849 raft_consensus.cc:493] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.344897 17849 raft_consensus.cc:515] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.347362 17849 leader_election.cc:290] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:37.348536 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:37.350090 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:37.350772 17728 raft_consensus.cc:2393] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93a60cf4fc4e47298fad3224ae393a4e in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:37.351725 17619 leader_election.cc:304] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e; no voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:37.352421 17849 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.358680 17849 raft_consensus.cc:2749] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.377744 17647 raft_consensus.cc:3060] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.383977 17869 consensus_queue.cc:1048] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.396651 17847 consensus_queue.cc:1048] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.408671 17880 consensus_queue.cc:1048] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.418619 17883 raft_consensus.cc:493] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.419077 17883 raft_consensus.cc:515] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:37.421108 17883 leader_election.cc:290] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:37.421609 17888 consensus_queue.cc:1048] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.421837 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:37.422430 17727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:37.424090 17768 leader_election.cc:304] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:37.425539 17888 raft_consensus.cc:2749] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.492215 17883 consensus_queue.cc:1048] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.503157 17888 consensus_queue.cc:1048] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.589613 17847 consensus_queue.cc:1048] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.600878 17885 consensus_queue.cc:1048] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.602797 17913 consensus_queue.cc:1048] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.617082 17885 consensus_queue.cc:1048] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.625401 17849 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.626240 17849 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:37.629166 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:37.629935 17728 raft_consensus.cc:2393] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93a60cf4fc4e47298fad3224ae393a4e in current term 1: Already voted for candidate e6537a4c3753400e8bba662080f00b7d in this term.
I20260709 13:07:37.629797 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:37.630613 17801 raft_consensus.cc:2393] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93a60cf4fc4e47298fad3224ae393a4e in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:37.631721 17618 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e; no voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:37.632362 17879 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.633008 17849 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:37.637856 17879 raft_consensus.cc:2749] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:37.711647 17599 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:37.728317 17801 raft_consensus.cc:3060] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.795537 17885 consensus_queue.cc:1048] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.806311 17913 consensus_queue.cc:1048] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.635418 17888 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.635844 17888 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:38.637578 17888 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:38.638307 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:38.638428 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:38.638876 17728 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:38.638993 17652 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:38.639847 17768 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:38.640516 17888 raft_consensus.cc:2804] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:38.640882 17888 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.641136 17888 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.645762 17888 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:38.647455 17888 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:38.648212 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:38.648459 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:38.648715 17728 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.649760 17652 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.655390 17728 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 2.
I20260709 13:07:38.656342 17652 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 2.
I20260709 13:07:38.656468 17768 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:38.657236 17888 raft_consensus.cc:2804] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.658084 17888 raft_consensus.cc:697] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:38.659089 17888 consensus_queue.cc:237] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:38.665279 17549 catalog_manager.cc:5697] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.898769 17801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
mode: GRACEFUL
new_leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:38190
I20260709 13:07:38.899391 17801 raft_consensus.cc:606] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Received request to transfer leadership to TS 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:38.912017 17728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
mode: GRACEFUL
new_leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:46792
I20260709 13:07:38.912508 17728 raft_consensus.cc:606] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Received request to transfer leadership to TS 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:38.917212 17728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
mode: GRACEFUL
new_leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:46792
I20260709 13:07:38.917704 17728 raft_consensus.cc:606] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Received request to transfer leadership to TS 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:38.922264 17728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
mode: GRACEFUL
new_leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:46792
I20260709 13:07:38.922711 17728 raft_consensus.cc:606] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Received request to transfer leadership to TS 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:38.927563 17801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52a4704f7c374728868027127171513f"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
mode: GRACEFUL
new_leader_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:38190
I20260709 13:07:38.928015 17801 raft_consensus.cc:606] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Received request to transfer leadership to TS e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:38.939388 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
mode: GRACEFUL
new_leader_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:07:38.939949 17652 raft_consensus.cc:606] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Received request to transfer leadership to TS e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:38.946843 17801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
mode: GRACEFUL
new_leader_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:38190
I20260709 13:07:38.947314 17801 raft_consensus.cc:606] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Received request to transfer leadership to TS e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:38.951865 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
mode: GRACEFUL
new_leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:07:38.952316 17652 raft_consensus.cc:606] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Received request to transfer leadership to TS 7c224ad6ecab4bda8d05a8575cd52774
I20260709 13:07:38.958796 17920 raft_consensus.cc:993] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: : Instructing follower e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:38.959201 17888 raft_consensus.cc:1081] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Signalling peer e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:38.960476 17728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52a4704f7c374728868027127171513f"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:46790
I20260709 13:07:38.960889 17728 raft_consensus.cc:493] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.961156 17728 raft_consensus.cc:3060] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.966023 17728 raft_consensus.cc:515] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:38.967587 17728 leader_election.cc:290] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:38.968361 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a4704f7c374728868027127171513f" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:38.968580 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a4704f7c374728868027127171513f" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:38.969049 17652 raft_consensus.cc:3060] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.969098 17801 raft_consensus.cc:3055] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.969594 17801 raft_consensus.cc:740] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:38.970381 17801 consensus_queue.cc:260] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:38.971586 17801 raft_consensus.cc:3060] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.976019 17652 raft_consensus.cc:2468] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:38.977149 17693 leader_election.cc:304] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:38.977911 17913 raft_consensus.cc:2804] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.978175 17801 raft_consensus.cc:2468] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:38.979058 17913 raft_consensus.cc:697] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:38.979839 17913 consensus_queue.cc:237] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:38.986871 17549 catalog_manager.cc:5697] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 1 to 2, leader changed from 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67) to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.051754 17879 raft_consensus.cc:993] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: : Instructing follower e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:39.052337 17932 raft_consensus.cc:1081] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Signalling peer e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:39.054471 17728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:46774
I20260709 13:07:39.054975 17728 raft_consensus.cc:493] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.055311 17728 raft_consensus.cc:3060] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.055588 17930 raft_consensus.cc:993] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: : Instructing follower 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.056044 17913 raft_consensus.cc:1081] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Signalling peer 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.057446 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:45080
I20260709 13:07:39.057871 17652 raft_consensus.cc:493] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.058139 17652 raft_consensus.cc:3060] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.060346 17728 raft_consensus.cc:515] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.062147 17728 leader_election.cc:290] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:39.062783 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:39.063169 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db72511366941e88df0a824a3d4cb79" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:39.062964 17652 raft_consensus.cc:515] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.063392 17647 raft_consensus.cc:3055] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.063755 17801 raft_consensus.cc:3060] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.063807 17647 raft_consensus.cc:740] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:39.064666 17647 consensus_queue.cc:260] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.065848 17647 raft_consensus.cc:3060] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.066186 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:39.066270 17652 leader_election.cc:290] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:39.066910 17800 raft_consensus.cc:3060] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.066188 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60549dbf5f124f1fb8a0a3afd74aa8b8" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:39.067672 17728 raft_consensus.cc:3055] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.067993 17728 raft_consensus.cc:740] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:39.068838 17728 consensus_queue.cc:260] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.070065 17728 raft_consensus.cc:3060] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.070503 17801 raft_consensus.cc:2468] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:39.071651 17693 leader_election.cc:304] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:39.072495 17913 raft_consensus.cc:2804] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.072953 17913 raft_consensus.cc:697] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:39.073961 17800 raft_consensus.cc:2468] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:39.073773 17913 consensus_queue.cc:237] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.074623 17647 raft_consensus.cc:2468] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:39.075171 17618 leader_election.cc:304] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:39.076042 17932 raft_consensus.cc:2804] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.076239 17728 raft_consensus.cc:2468] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:39.076514 17932 raft_consensus.cc:697] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:39.078186 17932 consensus_queue.cc:237] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.082186 17549 catalog_manager.cc:5697] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 1 to 2, leader changed from 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65) to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.085713 17550 catalog_manager.cc:5697] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 1 to 2, leader changed from e6537a4c3753400e8bba662080f00b7d (127.6.215.66) to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.104947 17647 raft_consensus.cc:1275] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:39.106070 17888 consensus_queue.cc:1048] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.112454 17920 raft_consensus.cc:993] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: : Instructing follower 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.113209 17888 raft_consensus.cc:1081] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Signalling peer 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.114989 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:45094
I20260709 13:07:39.118134 17728 raft_consensus.cc:1275] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:39.119156 17652 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.119644 17652 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.127568 17652 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:39.128602 17936 consensus_queue.cc:1048] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.130611 17888 raft_consensus.cc:993] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: : Instructing follower e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:39.131253 17888 raft_consensus.cc:1081] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Signalling peer e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:39.132733 17727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:39.133585 17726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:46790
I20260709 13:07:39.134150 17726 raft_consensus.cc:493] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.134521 17726 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.138441 17652 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 3 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:39.139801 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:39.140398 17800 raft_consensus.cc:3055] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:39.140717 17800 raft_consensus.cc:740] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:39.141526 17800 consensus_queue.cc:260] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:39.142795 17800 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.143977 17726 raft_consensus.cc:515] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.146144 17726 leader_election.cc:290] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:39.147563 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:39.148228 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:39.148286 17801 raft_consensus.cc:3055] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.149928 17801 raft_consensus.cc:740] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:39.149214 17652 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.151834 17801 consensus_queue.cc:260] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.152519 17800 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 3.
I20260709 13:07:39.153784 17618 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:39.155000 17932 raft_consensus.cc:2804] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:39.155527 17932 raft_consensus.cc:697] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:39.157019 17930 raft_consensus.cc:993] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: : Instructing follower 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.157049 17801 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.157658 17930 raft_consensus.cc:1081] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Signalling peer 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.156292 17932 consensus_queue.cc:237] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:39.159137 17652 raft_consensus.cc:2468] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:39.160151 17693 leader_election.cc:304] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:39.160969 17930 raft_consensus.cc:2804] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.161377 17930 raft_consensus.cc:697] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:39.162150 17930 consensus_queue.cc:237] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.163576 17647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:45080
I20260709 13:07:39.164157 17647 raft_consensus.cc:493] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.164522 17647 raft_consensus.cc:3060] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.166072 17801 raft_consensus.cc:2468] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:39.167181 17550 catalog_manager.cc:5697] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 2 to 3, leader changed from 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67) to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 3 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.173844 17647 raft_consensus.cc:515] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.175503 17647 leader_election.cc:290] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:39.175252 17549 catalog_manager.cc:5697] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 1 to 2, leader changed from 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67) to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.176882 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:39.177556 17726 raft_consensus.cc:3055] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.177855 17726 raft_consensus.cc:740] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:39.176882 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b8cc8a5741468cb5d9a3876e020188" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:39.178644 17726 consensus_queue.cc:260] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.179332 17801 raft_consensus.cc:3060] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.183313 17726 raft_consensus.cc:3060] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.187765 17801 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:39.188761 17618 leader_election.cc:304] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:39.189169 17726 raft_consensus.cc:2468] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:39.189420 17932 raft_consensus.cc:2804] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.190573 17932 raft_consensus.cc:697] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:39.191215 17932 consensus_queue.cc:237] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.199707 17549 catalog_manager.cc:5697] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 1 to 2, leader changed from e6537a4c3753400e8bba662080f00b7d (127.6.215.66) to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.232824 17879 raft_consensus.cc:993] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: : Instructing follower 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:39.233247 17932 raft_consensus.cc:1081] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Signalling peer 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:39.234707 17801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:38170
I20260709 13:07:39.235126 17801 raft_consensus.cc:493] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.235366 17801 raft_consensus.cc:3060] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.239892 17801 raft_consensus.cc:515] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.241518 17801 leader_election.cc:290] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:39.242225 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:39.242530 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e4003d1f254fbca9c2a3157b56b968" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:39.242870 17647 raft_consensus.cc:3055] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.243068 17726 raft_consensus.cc:3060] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.243189 17647 raft_consensus.cc:740] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:39.243920 17647 consensus_queue.cc:260] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.244813 17647 raft_consensus.cc:3060] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.247820 17726 raft_consensus.cc:2468] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 2.
I20260709 13:07:39.248797 17768 leader_election.cc:304] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:39.249222 17647 raft_consensus.cc:2468] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 2.
I20260709 13:07:39.249439 17920 raft_consensus.cc:2804] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.249923 17920 raft_consensus.cc:697] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:39.250717 17920 consensus_queue.cc:237] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.257462 17549 catalog_manager.cc:5697] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 1 to 2, leader changed from 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65) to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.348924 17913 raft_consensus.cc:993] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: : Instructing follower 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.349315 17930 raft_consensus.cc:1081] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Signalling peer 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:39.350692 17647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:45080
I20260709 13:07:39.351137 17647 raft_consensus.cc:493] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.351408 17647 raft_consensus.cc:3060] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.356009 17647 raft_consensus.cc:515] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.357677 17647 leader_election.cc:290] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:39.358614 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:39.359062 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500bb507c4749cb8035b4ce7c74461c" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:39.359181 17801 raft_consensus.cc:3060] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.359571 17726 raft_consensus.cc:3055] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.359853 17726 raft_consensus.cc:740] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:39.360432 17726 consensus_queue.cc:260] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.361308 17726 raft_consensus.cc:3060] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.363996 17801 raft_consensus.cc:2468] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:39.364960 17618 leader_election.cc:304] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:39.365613 17932 raft_consensus.cc:2804] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.366076 17932 raft_consensus.cc:697] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:39.367127 17726 raft_consensus.cc:2468] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:39.366845 17932 consensus_queue.cc:237] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:39.373440 17549 catalog_manager.cc:5697] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 1 to 2, leader changed from e6537a4c3753400e8bba662080f00b7d (127.6.215.66) to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.510303 17801 raft_consensus.cc:1275] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.511507 17932 consensus_queue.cc:1048] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.515743 17647 raft_consensus.cc:1275] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.516978 17930 consensus_queue.cc:1048] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.520210 17726 raft_consensus.cc:1275] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.522122 17932 consensus_queue.cc:1048] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.534014 17801 raft_consensus.cc:1275] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.535342 17913 consensus_queue.cc:1048] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.611238 17801 raft_consensus.cc:1275] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.612363 17913 consensus_queue.cc:1048] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.620123 17647 raft_consensus.cc:1275] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.621767 17913 consensus_queue.cc:1048] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.620111 17801 raft_consensus.cc:1275] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.623842 17946 consensus_queue.cc:1048] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.633796 17726 raft_consensus.cc:1275] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.635524 17879 consensus_queue.cc:1048] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.640985 17801 raft_consensus.cc:1275] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.642768 17949 consensus_queue.cc:1048] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.652468 17647 raft_consensus.cc:1275] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.654201 17913 consensus_queue.cc:1048] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.661257 17801 raft_consensus.cc:1275] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:39.662670 17879 consensus_queue.cc:1048] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.671793 17726 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.678627 17726 raft_consensus.cc:1275] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 3 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:39.680720 17957 consensus_queue.cc:1048] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.783551 17647 raft_consensus.cc:1275] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.784639 17920 consensus_queue.cc:1048] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.798156 17726 raft_consensus.cc:1275] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.800587 17920 consensus_queue.cc:1048] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.801144 17726 raft_consensus.cc:1275] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.802703 17957 consensus_queue.cc:1048] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.815419 17801 raft_consensus.cc:1275] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.817198 17879 consensus_queue.cc:1048] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:41.980973 17550 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47808:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:41.983034 17550 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:42.028136 17642 tablet_service.cc:1511] Processing CreateTablet for tablet d0cfe5ce842b4bd28642566bf44dad2d (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:42.029384 17642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cfe5ce842b4bd28642566bf44dad2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.029126 17712 tablet_service.cc:1511] Processing CreateTablet for tablet d0cfe5ce842b4bd28642566bf44dad2d (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:42.030627 17787 tablet_service.cc:1511] Processing CreateTablet for tablet d0cfe5ce842b4bd28642566bf44dad2d (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:42.031813 17787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cfe5ce842b4bd28642566bf44dad2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.033208 17714 tablet_service.cc:1511] Processing CreateTablet for tablet fdc6ef2bd2394e0ba87c1f29653eace1 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:42.033614 17643 tablet_service.cc:1511] Processing CreateTablet for tablet fdc6ef2bd2394e0ba87c1f29653eace1 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:42.034749 17643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc6ef2bd2394e0ba87c1f29653eace1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.030647 17712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cfe5ce842b4bd28642566bf44dad2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.035799 17710 tablet_service.cc:1511] Processing CreateTablet for tablet 568bd150e77943d6887eec075264bdf2 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:42.037020 17710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568bd150e77943d6887eec075264bdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.037814 17714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc6ef2bd2394e0ba87c1f29653eace1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.038414 17639 tablet_service.cc:1511] Processing CreateTablet for tablet 568bd150e77943d6887eec075264bdf2 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:42.039578 17639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568bd150e77943d6887eec075264bdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.038800 17790 tablet_service.cc:1511] Processing CreateTablet for tablet fdc6ef2bd2394e0ba87c1f29653eace1 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:42.041906 17790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc6ef2bd2394e0ba87c1f29653eace1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.060103 17786 tablet_service.cc:1511] Processing CreateTablet for tablet 568bd150e77943d6887eec075264bdf2 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:42.061450 17786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568bd150e77943d6887eec075264bdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.061599 17638 tablet_service.cc:1511] Processing CreateTablet for tablet a480ab4624b544dbbf66924d1c475cd4 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:42.062956 17638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a480ab4624b544dbbf66924d1c475cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.088171 17717 tablet_service.cc:1511] Processing CreateTablet for tablet a480ab4624b544dbbf66924d1c475cd4 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:42.089960 17717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a480ab4624b544dbbf66924d1c475cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.090052 17976 tablet_bootstrap.cc:492] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.092721 17788 tablet_service.cc:1511] Processing CreateTablet for tablet a480ab4624b544dbbf66924d1c475cd4 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:42.094029 17788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a480ab4624b544dbbf66924d1c475cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.094664 17640 tablet_service.cc:1511] Processing CreateTablet for tablet a5a2548442544fa4b6c34bd81fc64dc9 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:42.095846 17640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a2548442544fa4b6c34bd81fc64dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.109536 17714 tablet_service.cc:1511] Processing CreateTablet for tablet a5a2548442544fa4b6c34bd81fc64dc9 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:42.115432 17784 tablet_service.cc:1511] Processing CreateTablet for tablet a5a2548442544fa4b6c34bd81fc64dc9 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:42.116616 17714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a2548442544fa4b6c34bd81fc64dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.116752 17784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a2548442544fa4b6c34bd81fc64dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.122331 17977 tablet_bootstrap.cc:492] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.123131 17976 tablet_bootstrap.cc:654] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.135300 17640 tablet_service.cc:1511] Processing CreateTablet for tablet 98c348564c4941d8bb6b605bcb70288b (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:42.137131 17640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c348564c4941d8bb6b605bcb70288b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.139560 17975 tablet_bootstrap.cc:492] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.140692 17977 tablet_bootstrap.cc:654] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.147843 17975 tablet_bootstrap.cc:654] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.153260 17977 tablet_bootstrap.cc:492] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.153172 17638 tablet_service.cc:1511] Processing CreateTablet for tablet 480882de823c4b938ea823faa2c2c6a4 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:42.154296 17786 tablet_service.cc:1511] Processing CreateTablet for tablet 98c348564c4941d8bb6b605bcb70288b (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:42.155800 17638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480882de823c4b938ea823faa2c2c6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.155874 17786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c348564c4941d8bb6b605bcb70288b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.157275 17977 ts_tablet_manager.cc:1403] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.005s
I20260709 13:07:42.158367 17710 tablet_service.cc:1511] Processing CreateTablet for tablet 480882de823c4b938ea823faa2c2c6a4 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:42.159710 17710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480882de823c4b938ea823faa2c2c6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.161033 17977 raft_consensus.cc:359] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.165315 17977 raft_consensus.cc:385] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.166373 17977 raft_consensus.cc:740] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.170949 17642 tablet_service.cc:1511] Processing CreateTablet for tablet 90fc7ecf798e49fda56eb67e6fe2b202 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:42.147626 17717 tablet_service.cc:1511] Processing CreateTablet for tablet 98c348564c4941d8bb6b605bcb70288b (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:42.172327 17642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fc7ecf798e49fda56eb67e6fe2b202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.169549 17784 tablet_service.cc:1511] Processing CreateTablet for tablet 480882de823c4b938ea823faa2c2c6a4 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:42.173264 17717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c348564c4941d8bb6b605bcb70288b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.173434 17784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480882de823c4b938ea823faa2c2c6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.167866 17977 consensus_queue.cc:260] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.178547 17977 ts_tablet_manager.cc:1434] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 13:07:42.179551 17977 tablet_bootstrap.cc:492] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.194221 17977 tablet_bootstrap.cc:654] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.200948 17788 tablet_service.cc:1511] Processing CreateTablet for tablet 90fc7ecf798e49fda56eb67e6fe2b202 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:42.202304 17788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fc7ecf798e49fda56eb67e6fe2b202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.203006 17976 tablet_bootstrap.cc:492] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.203523 17976 ts_tablet_manager.cc:1403] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.016s
I20260709 13:07:42.203583 17714 tablet_service.cc:1511] Processing CreateTablet for tablet 90fc7ecf798e49fda56eb67e6fe2b202 (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:42.205010 17714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fc7ecf798e49fda56eb67e6fe2b202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.207029 17976 raft_consensus.cc:359] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.207778 17976 raft_consensus.cc:385] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.208065 17976 raft_consensus.cc:740] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
W20260709 13:07:42.210649 17828 tablet.cc:2406] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:42.208742 17976 consensus_queue.cc:260] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.212031 17977 tablet_bootstrap.cc:492] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.212769 17977 ts_tablet_manager.cc:1403] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.004s
I20260709 13:07:42.210899 17975 tablet_bootstrap.cc:492] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.217245 17975 ts_tablet_manager.cc:1403] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.078s	user 0.000s	sys 0.014s
I20260709 13:07:42.220181 17975 raft_consensus.cc:359] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.216718 17976 ts_tablet_manager.cc:1434] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:42.222084 17976 tablet_bootstrap.cc:492] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.220801 17977 raft_consensus.cc:359] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.225226 17712 tablet_service.cc:1511] Processing CreateTablet for tablet 64bd85e84f0849c9a929516b707f2aec (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:42.220913 17975 raft_consensus.cc:385] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.226148 17975 raft_consensus.cc:740] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.226516 17712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bd85e84f0849c9a929516b707f2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.226980 17975 consensus_queue.cc:260] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.229668 17975 ts_tablet_manager.cc:1434] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:07:42.230747 17975 tablet_bootstrap.cc:492] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.216674 17640 tablet_service.cc:1511] Processing CreateTablet for tablet 64bd85e84f0849c9a929516b707f2aec (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:42.233321 17640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bd85e84f0849c9a929516b707f2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.239425 17975 tablet_bootstrap.cc:654] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.225812 17977 raft_consensus.cc:385] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.241904 17977 raft_consensus.cc:740] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.242584 17788 tablet_service.cc:1511] Processing CreateTablet for tablet 64bd85e84f0849c9a929516b707f2aec (DEFAULT_TABLE table=soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:42.243027 17977 consensus_queue.cc:260] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.247292 17977 ts_tablet_manager.cc:1434] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:07:42.248478 17977 tablet_bootstrap.cc:492] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.231297 17976 tablet_bootstrap.cc:654] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.243968 17788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bd85e84f0849c9a929516b707f2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.255605 17975 tablet_bootstrap.cc:492] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.256305 17975 ts_tablet_manager.cc:1403] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:07:42.259552 17975 raft_consensus.cc:359] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.260300 17975 raft_consensus.cc:385] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.260605 17975 raft_consensus.cc:740] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.261297 17975 consensus_queue.cc:260] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.263747 17975 ts_tablet_manager.cc:1434] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:42.267019 17976 tablet_bootstrap.cc:492] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.267709 17976 ts_tablet_manager.cc:1403] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 13:07:42.274219 17976 raft_consensus.cc:359] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.268653 17977 tablet_bootstrap.cc:654] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.275009 17976 raft_consensus.cc:385] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.275380 17976 raft_consensus.cc:740] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.276232 17976 consensus_queue.cc:260] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.268328 17975 tablet_bootstrap.cc:492] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.278636 17976 ts_tablet_manager.cc:1434] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:42.279575 17976 tablet_bootstrap.cc:492] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.294576 17976 tablet_bootstrap.cc:654] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.297639 17975 tablet_bootstrap.cc:654] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.299664 17977 tablet_bootstrap.cc:492] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.300302 17977 ts_tablet_manager.cc:1403] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.009s
I20260709 13:07:42.300669 17976 tablet_bootstrap.cc:492] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.301375 17976 ts_tablet_manager.cc:1403] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:07:42.303375 17975 tablet_bootstrap.cc:492] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.303412 17977 raft_consensus.cc:359] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.304054 17975 ts_tablet_manager.cc:1403] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.005s
I20260709 13:07:42.304317 17977 raft_consensus.cc:385] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.304226 17976 raft_consensus.cc:359] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.304764 17977 raft_consensus.cc:740] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.305095 17976 raft_consensus.cc:385] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.305435 17976 raft_consensus.cc:740] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.305815 17977 consensus_queue.cc:260] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.306290 17976 consensus_queue.cc:260] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.308130 17977 ts_tablet_manager.cc:1434] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:42.308547 17976 ts_tablet_manager.cc:1434] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:07:42.309531 17977 tablet_bootstrap.cc:492] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.309981 17976 tablet_bootstrap.cc:492] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.309540 17985 raft_consensus.cc:493] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.310887 17985 raft_consensus.cc:515] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.312956 17985 leader_election.cc:290] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.315284 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.315964 17647 raft_consensus.cc:2468] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:42.316674 17977 tablet_bootstrap.cc:654] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.317660 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.317911 17693 leader_election.cc:304] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.318737 17985 raft_consensus.cc:2804] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.319079 17985 raft_consensus.cc:493] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.319388 17985 raft_consensus.cc:3060] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.321597 17801 raft_consensus.cc:2468] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:42.323598 17977 tablet_bootstrap.cc:492] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.324180 17977 ts_tablet_manager.cc:1403] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:07:42.324009 17975 raft_consensus.cc:359] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.324761 17975 raft_consensus.cc:385] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.325002 17975 raft_consensus.cc:740] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.325749 17975 consensus_queue.cc:260] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.327140 17977 raft_consensus.cc:359] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.327944 17977 raft_consensus.cc:385] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.328025 17975 ts_tablet_manager.cc:1434] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:07:42.328258 17977 raft_consensus.cc:740] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.329448 17976 tablet_bootstrap.cc:654] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.330123 17975 tablet_bootstrap.cc:492] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.336741 17977 consensus_queue.cc:260] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.337519 17975 tablet_bootstrap.cc:654] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.339208 17977 ts_tablet_manager.cc:1434] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:07:42.340262 17977 tablet_bootstrap.cc:492] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.346645 17985 raft_consensus.cc:515] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.350402 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.351016 17647 raft_consensus.cc:3060] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.354368 17977 tablet_bootstrap.cc:654] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.362926 17975 tablet_bootstrap.cc:492] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.363842 17975 ts_tablet_manager.cc:1403] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.015s
I20260709 13:07:42.367235 17647 raft_consensus.cc:2468] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:42.367502 17975 raft_consensus.cc:359] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.368665 17975 raft_consensus.cc:385] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.369041 17975 raft_consensus.cc:740] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.369817 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:42.369856 17975 consensus_queue.cc:260] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.370781 17801 raft_consensus.cc:3060] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.373135 17975 ts_tablet_manager.cc:1434] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:07:42.374163 17975 tablet_bootstrap.cc:492] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.379369 17801 raft_consensus.cc:2468] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:42.381559 17975 tablet_bootstrap.cc:654] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.385689 17693 leader_election.cc:304] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.387199 17985 leader_election.cc:290] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.387549 17913 raft_consensus.cc:2804] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.393034 17913 raft_consensus.cc:697] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:42.393940 17913 consensus_queue.cc:237] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.394990 17976 tablet_bootstrap.cc:492] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.395506 17976 ts_tablet_manager.cc:1403] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.021s
I20260709 13:07:42.396049 17977 tablet_bootstrap.cc:492] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.396611 17977 ts_tablet_manager.cc:1403] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.033s
I20260709 13:07:42.399192 17976 raft_consensus.cc:359] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.400043 17976 raft_consensus.cc:385] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.399674 17977 raft_consensus.cc:359] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.400369 17976 raft_consensus.cc:740] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.401553 17976 consensus_queue.cc:260] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.403007 17975 tablet_bootstrap.cc:492] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.403522 17975 ts_tablet_manager.cc:1403] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 13:07:42.403681 17977 raft_consensus.cc:385] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.404008 17977 raft_consensus.cc:740] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.404109 17976 ts_tablet_manager.cc:1434] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:42.404757 17977 consensus_queue.cc:260] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.406723 17975 raft_consensus.cc:359] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.407083 17977 ts_tablet_manager.cc:1434] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:42.407469 17975 raft_consensus.cc:385] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.407766 17975 raft_consensus.cc:740] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.406991 17550 catalog_manager.cc:5697] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.408183 17977 tablet_bootstrap.cc:492] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.408475 17975 consensus_queue.cc:260] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.410712 17975 ts_tablet_manager.cc:1434] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:07:42.411659 17975 tablet_bootstrap.cc:492] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.415403 17977 tablet_bootstrap.cc:654] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.417774 17975 tablet_bootstrap.cc:654] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.421083 17976 tablet_bootstrap.cc:492] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.430028 17976 tablet_bootstrap.cc:654] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.433338 17932 raft_consensus.cc:493] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.433883 17932 raft_consensus.cc:515] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.436036 17932 leader_election.cc:290] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.437872 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568bd150e77943d6887eec075264bdf2" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.438678 17801 raft_consensus.cc:2468] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:42.439843 17618 leader_election.cc:304] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:42.441320 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568bd150e77943d6887eec075264bdf2" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.441723 17932 raft_consensus.cc:2804] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.441948 17728 raft_consensus.cc:2468] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:42.442144 17932 raft_consensus.cc:493] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.442582 17932 raft_consensus.cc:3060] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.443768 17977 tablet_bootstrap.cc:492] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.444275 17977 ts_tablet_manager.cc:1403] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.016s
I20260709 13:07:42.445081 17975 tablet_bootstrap.cc:492] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.445596 17975 ts_tablet_manager.cc:1403] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.017s
I20260709 13:07:42.447177 17977 raft_consensus.cc:359] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.447896 17977 raft_consensus.cc:385] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.448156 17977 raft_consensus.cc:740] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.448470 17932 raft_consensus.cc:515] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.448617 17975 raft_consensus.cc:359] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.448933 17977 consensus_queue.cc:260] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.449518 17975 raft_consensus.cc:385] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.451512 17977 ts_tablet_manager.cc:1434] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:42.451561 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568bd150e77943d6887eec075264bdf2" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.452483 17728 raft_consensus.cc:3060] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.449811 17975 raft_consensus.cc:740] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.452948 17977 tablet_bootstrap.cc:492] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.453869 17975 consensus_queue.cc:260] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.455129 17964 raft_consensus.cc:493] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.455618 17964 raft_consensus.cc:515] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.457955 17964 leader_election.cc:290] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.458947 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.459571 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.459867 17647 raft_consensus.cc:2468] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:42.460807 17977 tablet_bootstrap.cc:654] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:42.461404 17768 leader_election.cc:343] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.461710 17728 raft_consensus.cc:2468] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:42.465436 17767 leader_election.cc:304] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:42.466257 17964 raft_consensus.cc:2804] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.466614 17964 raft_consensus.cc:493] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.466918 17964 raft_consensus.cc:3060] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.479254 17932 leader_election.cc:290] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.482661 17964 raft_consensus.cc:515] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.483238 17619 leader_election.cc:304] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.489329 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.489941 17647 raft_consensus.cc:3060] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.489123 17998 raft_consensus.cc:2804] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.492285 17998 raft_consensus.cc:697] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:42.493093 17998 consensus_queue.cc:237] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.493534 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.497417 17647 raft_consensus.cc:2468] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:42.498524 17767 leader_election.cc:304] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
W20260709 13:07:42.499075 17768 leader_election.cc:343] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.499900 17976 tablet_bootstrap.cc:492] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.500728 17976 ts_tablet_manager.cc:1403] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.010s
I20260709 13:07:42.495085 17964 leader_election.cc:290] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.501467 17964 raft_consensus.cc:2804] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.502177 17964 raft_consensus.cc:697] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:42.503554 17964 consensus_queue.cc:237] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.504019 17976 raft_consensus.cc:359] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.506536 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568bd150e77943d6887eec075264bdf2" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:42.508944 17801 raft_consensus.cc:3060] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.508826 17976 raft_consensus.cc:385] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.509392 17976 raft_consensus.cc:740] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.508347 17975 ts_tablet_manager.cc:1434] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.003s
I20260709 13:07:42.510193 17976 consensus_queue.cc:260] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.510687 17975 tablet_bootstrap.cc:492] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.512629 17976 ts_tablet_manager.cc:1434] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:07:42.513679 17976 tablet_bootstrap.cc:492] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.516162 17801 raft_consensus.cc:2468] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:42.520236 17976 tablet_bootstrap.cc:654] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.527822 17549 catalog_manager.cc:5697] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.533017 17977 tablet_bootstrap.cc:492] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.533577 17977 ts_tablet_manager.cc:1403] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.081s	user 0.032s	sys 0.042s
I20260709 13:07:42.537065 17977 raft_consensus.cc:359] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.538132 17977 raft_consensus.cc:385] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.538546 17977 raft_consensus.cc:740] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.539398 17977 consensus_queue.cc:260] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.539531 17975 tablet_bootstrap.cc:654] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.546474 17999 raft_consensus.cc:493] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.547071 17999 raft_consensus.cc:515] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.551735 17999 leader_election.cc:290] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.555260 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.556382 17976 tablet_bootstrap.cc:492] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.557040 17976 ts_tablet_manager.cc:1403] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.010s
I20260709 13:07:42.557696 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.558416 17728 raft_consensus.cc:2468] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:42.563577 17976 raft_consensus.cc:359] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.564473 17976 raft_consensus.cc:385] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.564797 17619 leader_election.cc:304] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.566344 17999 raft_consensus.cc:2804] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.566745 17999 raft_consensus.cc:493] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.556166 17801 raft_consensus.cc:2468] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:42.567114 17999 raft_consensus.cc:3060] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.571004 18002 raft_consensus.cc:493] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.571660 18002 raft_consensus.cc:515] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.574762 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.575420 17647 raft_consensus.cc:2468] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:42.576718 17767 leader_election.cc:304] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:42.583763 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.584748 17728 raft_consensus.cc:2468] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:42.564795 17976 raft_consensus.cc:740] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.580969 17999 raft_consensus.cc:515] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.590691 17976 consensus_queue.cc:260] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.592664 17976 ts_tablet_manager.cc:1434] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:07:42.594980 17999 leader_election.cc:290] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.598165 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.598793 17976 tablet_bootstrap.cc:492] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.599248 17728 raft_consensus.cc:3060] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.613380 17976 tablet_bootstrap.cc:654] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.617499 18002 leader_election.cc:290] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.621914 18002 raft_consensus.cc:493] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.624347 18002 raft_consensus.cc:515] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.630698 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.632735 18002 leader_election.cc:290] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.625949 18009 raft_consensus.cc:493] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.626715 17767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.215.65:40633, user_credentials={real_user=slave}} blocked reactor thread for 50094.7us
I20260709 13:07:42.640933 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.640589 17548 catalog_manager.cc:5697] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.626879 17976 tablet_bootstrap.cc:492] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.641950 17647 raft_consensus.cc:2393] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate 93a60cf4fc4e47298fad3224ae393a4e in this term.
I20260709 13:07:42.642437 17976 ts_tablet_manager.cc:1403] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.001s
I20260709 13:07:42.644001 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:42.644655 17801 raft_consensus.cc:3060] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.645805 17913 raft_consensus.cc:493] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.646364 17913 raft_consensus.cc:515] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.648481 17913 leader_election.cc:290] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.650043 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
W20260709 13:07:42.652814 17693 leader_election.cc:343] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.656390 17964 raft_consensus.cc:493] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.657140 17964 raft_consensus.cc:515] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.659751 17964 leader_election.cc:290] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.655105 17976 raft_consensus.cc:359] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.660423 17976 raft_consensus.cc:385] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.660744 17976 raft_consensus.cc:740] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.661661 17976 consensus_queue.cc:260] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.664342 17976 ts_tablet_manager.cc:1434] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:07:42.665324 17976 tablet_bootstrap.cc:492] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.668591 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.669256 17726 raft_consensus.cc:2468] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:42.670750 17768 leader_election.cc:304] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.671574 17964 raft_consensus.cc:2804] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.671953 17964 raft_consensus.cc:493] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.672272 17964 raft_consensus.cc:3060] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.680716 17998 raft_consensus.cc:493] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.681407 17998 raft_consensus.cc:515] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.683911 17964 raft_consensus.cc:515] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.685245 17998 leader_election.cc:290] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.686628 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.687322 17726 raft_consensus.cc:2468] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
I20260709 13:07:42.688607 17619 leader_election.cc:304] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.689481 17998 raft_consensus.cc:2804] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.689854 17998 raft_consensus.cc:493] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.690160 17998 raft_consensus.cc:3060] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.684970 17976 tablet_bootstrap.cc:654] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.695363 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.697571 17964 leader_election.cc:290] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.697729 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.698662 17726 raft_consensus.cc:3060] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.622925 18008 raft_consensus.cc:2804] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.705629 18008 raft_consensus.cc:493] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.706076 18008 raft_consensus.cc:3060] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.718748 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.719714 17800 raft_consensus.cc:2393] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6537a4c3753400e8bba662080f00b7d in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:42.722060 17767 leader_election.cc:304] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
W20260709 13:07:42.723513 17767 leader_election.cc:343] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.680176 17801 raft_consensus.cc:2468] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:42.620420 17728 raft_consensus.cc:2468] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:42.725654 17964 raft_consensus.cc:2749] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.727025 17977 ts_tablet_manager.cc:1434] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.193s	user 0.067s	sys 0.096s
I20260709 13:07:42.728183 17977 tablet_bootstrap.cc:492] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.727145 17619 leader_election.cc:304] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.729939 17999 raft_consensus.cc:2804] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.730376 17999 raft_consensus.cc:697] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:42.731174 17999 consensus_queue.cc:237] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.734577 17977 tablet_bootstrap.cc:654] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.743449 17726 raft_consensus.cc:2468] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:42.744772 17768 leader_election.cc:304] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.745857 18002 raft_consensus.cc:2804] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.746327 18002 raft_consensus.cc:697] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:42.747143 17977 tablet_bootstrap.cc:492] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.747649 17977 ts_tablet_manager.cc:1403] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:07:42.752099 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.753320 17549 catalog_manager.cc:5697] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.754205 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.754765 17977 raft_consensus.cc:359] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.755419 17977 raft_consensus.cc:385] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.755788 18009 raft_consensus.cc:515] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.747176 18002 consensus_queue.cc:237] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.756893 17800 raft_consensus.cc:2468] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 0.
W20260709 13:07:42.765061 17599 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:42.756147 17977 raft_consensus.cc:740] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.766326 17977 consensus_queue.cc:260] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.768584 17977 ts_tablet_manager.cc:1434] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.004s
I20260709 13:07:42.772727 17977 tablet_bootstrap.cc:492] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: Bootstrap starting.
I20260709 13:07:42.775758 17551 catalog_manager.cc:5697] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.777690 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.778373 17728 raft_consensus.cc:2468] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 0.
I20260709 13:07:42.779008 18009 leader_election.cc:290] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.779815 17768 leader_election.cc:304] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.781268 17693 leader_election.cc:304] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6537a4c3753400e8bba662080f00b7d; no voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e
W20260709 13:07:42.783131 17767 leader_election.cc:343] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.783325 17975 tablet_bootstrap.cc:492] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.783545 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.785104 17975 ts_tablet_manager.cc:1403] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.275s	user 0.114s	sys 0.118s
I20260709 13:07:42.783284 17913 raft_consensus.cc:2749] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.787217 18008 raft_consensus.cc:515] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.788127 17975 raft_consensus.cc:359] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.788821 17975 raft_consensus.cc:385] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.789081 17975 raft_consensus.cc:740] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.789294 18008 leader_election.cc:290] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.792361 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.792492 17977 tablet_bootstrap.cc:654] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.789803 17975 consensus_queue.cc:260] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.793437 17652 raft_consensus.cc:3060] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.795185 17975 ts_tablet_manager.cc:1434] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:07:42.796171 17975 tablet_bootstrap.cc:492] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.790544 18009 raft_consensus.cc:2804] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.802934 17975 tablet_bootstrap.cc:654] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.801827 18009 raft_consensus.cc:493] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.805691 18009 raft_consensus.cc:3060] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.809743 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.813223 17726 raft_consensus.cc:3060] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.789944 17998 raft_consensus.cc:515] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.818903 17647 raft_consensus.cc:2393] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate 93a60cf4fc4e47298fad3224ae393a4e in this term.
I20260709 13:07:42.821625 17976 tablet_bootstrap.cc:492] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.822204 17976 ts_tablet_manager.cc:1403] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.157s	user 0.030s	sys 0.026s
I20260709 13:07:42.825034 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.825791 17728 raft_consensus.cc:3060] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.825078 17976 raft_consensus.cc:359] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.828531 17976 raft_consensus.cc:385] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.828784 17976 raft_consensus.cc:740] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.828962 17913 consensus_queue.cc:1048] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.829545 17976 consensus_queue.cc:260] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.831910 17976 ts_tablet_manager.cc:1434] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:07:42.837424 17652 raft_consensus.cc:2468] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:42.838757 17767 leader_election.cc:304] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:42.839547 18002 raft_consensus.cc:2804] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.840139 18002 raft_consensus.cc:697] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:42.840909 17998 leader_election.cc:290] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.840269 17976 tablet_bootstrap.cc:492] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: Bootstrap starting.
I20260709 13:07:42.841065 18002 consensus_queue.cc:237] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.843992 17728 raft_consensus.cc:2468] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 1.
I20260709 13:07:42.847158 17976 tablet_bootstrap.cc:654] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.849092 17619 leader_election.cc:304] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.855399 17998 raft_consensus.cc:2804] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.855890 17998 raft_consensus.cc:697] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:42.856706 17998 consensus_queue.cc:237] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.850219 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:42.852504 17726 raft_consensus.cc:2468] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 1.
I20260709 13:07:42.861269 17975 tablet_bootstrap.cc:492] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.863477 17975 ts_tablet_manager.cc:1403] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.068s	user 0.033s	sys 0.031s
I20260709 13:07:42.862648 17977 tablet_bootstrap.cc:492] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: No bootstrap required, opened a new log
I20260709 13:07:42.865825 17977 ts_tablet_manager.cc:1403] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: Time spent bootstrapping tablet: real 0.096s	user 0.032s	sys 0.020s
I20260709 13:07:42.848897 18009 raft_consensus.cc:515] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.870371 17975 raft_consensus.cc:359] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.870875 18009 leader_election.cc:290] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:42.871549 17801 raft_consensus.cc:2393] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93a60cf4fc4e47298fad3224ae393a4e in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:42.871906 17977 raft_consensus.cc:359] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.872572 17977 raft_consensus.cc:385] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.872668 17975 raft_consensus.cc:385] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.872889 17977 raft_consensus.cc:740] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.873073 17975 raft_consensus.cc:740] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.873653 17977 consensus_queue.cc:260] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.874012 17976 tablet_bootstrap.cc:492] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: No bootstrap required, opened a new log
I20260709 13:07:42.874111 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.874555 17976 ts_tablet_manager.cc:1403] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.007s
I20260709 13:07:42.874594 17975 consensus_queue.cc:260] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.875869 17977 ts_tablet_manager.cc:1434] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:07:42.876907 17975 ts_tablet_manager.cc:1434] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:07:42.877367 17976 raft_consensus.cc:359] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.877875 17975 tablet_bootstrap.cc:492] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: Bootstrap starting.
I20260709 13:07:42.878027 17976 raft_consensus.cc:385] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.878319 17976 raft_consensus.cc:740] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.878942 17976 consensus_queue.cc:260] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.880798 17976 ts_tablet_manager.cc:1434] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:42.884044 17975 tablet_bootstrap.cc:654] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.887713 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a480ab4624b544dbbf66924d1c475cd4" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:42.888628 17726 raft_consensus.cc:2393] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c224ad6ecab4bda8d05a8575cd52774 in current term 1: Already voted for candidate 93a60cf4fc4e47298fad3224ae393a4e in this term.
I20260709 13:07:42.893002 17550 catalog_manager.cc:5697] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 1 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.895812 17992 consensus_queue.cc:1048] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.894593 17768 leader_election.cc:304] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774; no voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:42.898038 18002 raft_consensus.cc:2749] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.888084 17548 catalog_manager.cc:5697] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 1 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.919196 17975 tablet_bootstrap.cc:492] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: No bootstrap required, opened a new log
I20260709 13:07:42.919759 17975 ts_tablet_manager.cc:1403] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.021s
I20260709 13:07:42.922015 17975 raft_consensus.cc:359] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.922475 17975 raft_consensus.cc:385] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.922585 17992 raft_consensus.cc:493] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.922683 17975 raft_consensus.cc:740] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.923254 17992 raft_consensus.cc:515] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.923553 17975 consensus_queue.cc:260] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.925076 17992 leader_election.cc:290] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.925457 17975 ts_tablet_manager.cc:1434] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:07:42.925827 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.926425 17652 raft_consensus.cc:2468] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:42.926609 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.927241 17800 raft_consensus.cc:2468] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:42.927449 17693 leader_election.cc:304] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.928210 17992 raft_consensus.cc:2804] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.928481 17992 raft_consensus.cc:493] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.928730 17992 raft_consensus.cc:3060] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.935688 17992 raft_consensus.cc:515] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.937541 17992 leader_election.cc:290] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.938285 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.938340 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:42.938809 17652 raft_consensus.cc:3060] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.938921 17800 raft_consensus.cc:3060] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.941845 17998 raft_consensus.cc:493] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.942382 17998 raft_consensus.cc:515] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.944099 17800 raft_consensus.cc:2468] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:42.944401 17998 leader_election.cc:290] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.945123 17693 leader_election.cc:304] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.945211 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6537a4c3753400e8bba662080f00b7d" is_pre_election: true
I20260709 13:07:42.945942 17726 raft_consensus.cc:2393] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93a60cf4fc4e47298fad3224ae393a4e in current term 1: Already voted for candidate 7c224ad6ecab4bda8d05a8575cd52774 in this term.
I20260709 13:07:42.946254 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.946379 17652 raft_consensus.cc:2468] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:42.945909 17992 raft_consensus.cc:2804] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.947508 17992 raft_consensus.cc:697] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:42.947505 17618 leader_election.cc:304] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e; no voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:42.948340 17998 raft_consensus.cc:3060] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.948513 17992 consensus_queue.cc:237] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.954106 17998 raft_consensus.cc:2749] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.956861 17550 catalog_manager.cc:5697] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.957332 17992 raft_consensus.cc:493] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.958006 17992 raft_consensus.cc:515] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.960072 17992 leader_election.cc:290] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.960659 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fc7ecf798e49fda56eb67e6fe2b202" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e" is_pre_election: true
I20260709 13:07:42.961172 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fc7ecf798e49fda56eb67e6fe2b202" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774" is_pre_election: true
I20260709 13:07:42.961373 17652 raft_consensus.cc:2468] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:42.961841 17800 raft_consensus.cc:2468] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 0.
I20260709 13:07:42.962631 17693 leader_election.cc:304] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.963346 17992 raft_consensus.cc:2804] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.963840 17992 raft_consensus.cc:493] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.964174 17992 raft_consensus.cc:3060] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.969249 17992 raft_consensus.cc:515] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.970919 17992 leader_election.cc:290] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:42.970791 17998 consensus_queue.cc:1048] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.971519 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fc7ecf798e49fda56eb67e6fe2b202" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:42.971828 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fc7ecf798e49fda56eb67e6fe2b202" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:42.971997 17652 raft_consensus.cc:3060] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.972388 17800 raft_consensus.cc:3060] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.978983 17652 raft_consensus.cc:2468] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:42.979633 17800 raft_consensus.cc:2468] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 1.
I20260709 13:07:42.982013 17693 leader_election.cc:304] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:42.983287 17992 raft_consensus.cc:2804] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.983736 17992 raft_consensus.cc:697] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:42.984483 17992 consensus_queue.cc:237] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:42.995853 18002 consensus_queue.cc:1048] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.995771 17998 consensus_queue.cc:1048] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:43.002748 17548 catalog_manager.cc:5697] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 1 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.007786 17726 raft_consensus.cc:3060] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.017409 18002 consensus_queue.cc:1048] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.173101 17726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
mode: GRACEFUL
new_leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:46792
I20260709 13:07:43.173645 17726 raft_consensus.cc:606] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Received request to transfer leadership to TS 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:43.179899 17801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
mode: GRACEFUL
new_leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:38190
I20260709 13:07:43.180368 17801 raft_consensus.cc:606] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Received request to transfer leadership to TS 93a60cf4fc4e47298fad3224ae393a4e
I20260709 13:07:43.191154 17647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
mode: GRACEFUL
new_leader_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:07:43.191604 17647 raft_consensus.cc:606] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Received request to transfer leadership to TS e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:43.196699 17801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
mode: GRACEFUL
new_leader_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:38190
I20260709 13:07:43.197230 17801 raft_consensus.cc:606] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Received request to transfer leadership to TS e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:43.202646 17801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
mode: GRACEFUL
new_leader_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:38190
I20260709 13:07:43.203090 17801 raft_consensus.cc:606] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Received request to transfer leadership to TS e6537a4c3753400e8bba662080f00b7d
I20260709 13:07:43.210476 17726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
mode: GRACEFUL
new_leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:46792
I20260709 13:07:43.211059 17726 raft_consensus.cc:606] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Received request to transfer leadership to TS 7c224ad6ecab4bda8d05a8575cd52774
I20260709 13:07:43.210990 18006 consensus_queue.cc:1048] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.223567 18006 consensus_queue.cc:1048] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.232214 18008 raft_consensus.cc:993] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: : Instructing follower e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:43.232687 18006 raft_consensus.cc:1081] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Signalling peer e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:43.234148 17726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:46790
I20260709 13:07:43.234694 17726 raft_consensus.cc:493] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.235140 17726 raft_consensus.cc:3060] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.242586 17726 raft_consensus.cc:515] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.246239 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:43.246456 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c348564c4941d8bb6b605bcb70288b" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:43.247062 17801 raft_consensus.cc:3055] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.247211 17647 raft_consensus.cc:3060] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.247367 17801 raft_consensus.cc:740] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:43.248191 17801 consensus_queue.cc:260] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.249153 17801 raft_consensus.cc:3060] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.252800 17647 raft_consensus.cc:2468] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:43.253254 17726 leader_election.cc:290] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:43.253698 17693 leader_election.cc:304] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:43.254408 17801 raft_consensus.cc:2468] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:43.254444 17992 raft_consensus.cc:2804] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.255146 17992 raft_consensus.cc:697] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:43.255834 17992 consensus_queue.cc:237] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.262512 17550 catalog_manager.cc:5697] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 1 to 2, leader changed from 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67) to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.275276 17998 consensus_queue.cc:1048] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.286777 17932 consensus_queue.cc:1048] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.320883 17932 consensus_queue.cc:1048] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.331339 17999 consensus_queue.cc:1048] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.335276 18006 consensus_queue.cc:1048] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.341023 17932 raft_consensus.cc:993] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: : Instructing follower e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:43.341548 17999 raft_consensus.cc:1081] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Signalling peer e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:43.343633 17726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:46774
I20260709 13:07:43.344270 17726 raft_consensus.cc:493] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.344687 17726 raft_consensus.cc:3060] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.345237 18008 raft_consensus.cc:993] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: : Instructing follower 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:43.345701 18008 raft_consensus.cc:1081] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Signalling peer 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:43.350271 18009 consensus_queue.cc:1048] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.351959 17647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:45094
I20260709 13:07:43.352510 17647 raft_consensus.cc:493] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.352842 17647 raft_consensus.cc:3060] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.357055 17726 raft_consensus.cc:515] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.359325 17726 leader_election.cc:290] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:43.360920 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:43.361093 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a2548442544fa4b6c34bd81fc64dc9" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:43.361603 17652 raft_consensus.cc:3055] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.361884 17800 raft_consensus.cc:3060] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.362082 17652 raft_consensus.cc:740] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:43.362910 17652 consensus_queue.cc:260] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.364470 17652 raft_consensus.cc:3060] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.365857 17647 raft_consensus.cc:515] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.368835 17800 raft_consensus.cc:2468] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:43.370128 17693 leader_election.cc:304] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:43.370895 17985 raft_consensus.cc:2804] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.371345 17985 raft_consensus.cc:697] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:43.371587 17652 raft_consensus.cc:2468] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:43.372109 17985 consensus_queue.cc:237] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.373961 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:43.374446 17728 raft_consensus.cc:3060] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.377239 17647 leader_election.cc:290] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:43.377454 17800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc6ef2bd2394e0ba87c1f29653eace1" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:43.379681 17985 consensus_queue.cc:1048] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.380754 17728 raft_consensus.cc:2468] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:43.382202 17619 leader_election.cc:304] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:43.380828 17800 raft_consensus.cc:3055] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.383006 17999 raft_consensus.cc:2804] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.383502 17999 raft_consensus.cc:697] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:43.383010 17800 raft_consensus.cc:740] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:43.384284 17999 consensus_queue.cc:237] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.387699 17549 catalog_manager.cc:5697] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 1 to 2, leader changed from 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65) to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.392059 17992 consensus_queue.cc:1048] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.391346 17800 consensus_queue.cc:260] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.395064 17800 raft_consensus.cc:3060] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.394721 17985 consensus_queue.cc:1048] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.403940 17800 raft_consensus.cc:2468] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:43.407310 18043 raft_consensus.cc:993] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: : Instructing follower 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:43.407721 18043 raft_consensus.cc:1081] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Signalling peer 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:43.409622 17801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:38174
I20260709 13:07:43.410123 17801 raft_consensus.cc:493] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.410377 17801 raft_consensus.cc:3060] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.417861 17550 catalog_manager.cc:5697] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 1 to 2, leader changed from 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67) to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.420531 17801 raft_consensus.cc:515] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.420789 17992 consensus_queue.cc:1048] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.427655 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:43.428150 17652 raft_consensus.cc:3060] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.429047 18043 raft_consensus.cc:993] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: : Instructing follower 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:43.429625 17992 raft_consensus.cc:1081] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Signalling peer 93a60cf4fc4e47298fad3224ae393a4e to start an election
I20260709 13:07:43.431064 17801 leader_election.cc:290] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:43.431141 17647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
 from {username='slave'} at 127.0.0.1:45080
I20260709 13:07:43.431278 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bd85e84f0849c9a929516b707f2aec" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:43.432030 17647 raft_consensus.cc:493] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.432088 17728 raft_consensus.cc:3055] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.432616 17728 raft_consensus.cc:740] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:43.432588 17647 raft_consensus.cc:3060] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.433524 17728 consensus_queue.cc:260] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.435242 17728 raft_consensus.cc:3060] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.439848 17652 raft_consensus.cc:2468] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 2.
I20260709 13:07:43.441193 17767 leader_election.cc:304] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:43.442060 18009 raft_consensus.cc:2804] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.442548 18009 raft_consensus.cc:697] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:43.443323 18009 consensus_queue.cc:237] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.446271 17647 raft_consensus.cc:515] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.447156 17728 raft_consensus.cc:2468] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 2.
I20260709 13:07:43.449100 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:43.449684 17726 raft_consensus.cc:3055] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.449951 17726 raft_consensus.cc:740] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:43.449100 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cfe5ce842b4bd28642566bf44dad2d" candidate_uuid: "93a60cf4fc4e47298fad3224ae393a4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:43.450626 17726 consensus_queue.cc:260] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.451306 17801 raft_consensus.cc:3060] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.451642 17726 raft_consensus.cc:3060] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.453279 18008 raft_consensus.cc:993] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: : Instructing follower e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:43.453884 18002 raft_consensus.cc:1081] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Signalling peer e6537a4c3753400e8bba662080f00b7d to start an election
I20260709 13:07:43.459165 17548 catalog_manager.cc:5697] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 1 to 2, leader changed from e6537a4c3753400e8bba662080f00b7d (127.6.215.66) to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 2 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.459769 17801 raft_consensus.cc:2468] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:43.459967 17726 raft_consensus.cc:2468] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a60cf4fc4e47298fad3224ae393a4e in term 2.
I20260709 13:07:43.460898 17619 leader_election.cc:304] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:43.461519 17728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
 from {username='slave'} at 127.0.0.1:46790
I20260709 13:07:43.462033 17728 raft_consensus.cc:493] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.461793 17999 raft_consensus.cc:2804] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.461022 17647 leader_election.cc:290] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [CANDIDATE]: Term 2 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:43.462631 17999 raft_consensus.cc:697] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Becoming Leader. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:43.462411 17728 raft_consensus.cc:3060] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.463449 17999 consensus_queue.cc:237] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.468617 17728 raft_consensus.cc:515] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.470479 17728 leader_election.cc:290] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67:45477)
I20260709 13:07:43.471218 17647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:43.471758 17647 raft_consensus.cc:3060] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.471977 17801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480882de823c4b938ea823faa2c2c6a4" candidate_uuid: "e6537a4c3753400e8bba662080f00b7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
I20260709 13:07:43.472739 17801 raft_consensus.cc:3055] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.471737 17550 catalog_manager.cc:5697] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e reported cstate change: term changed from 1 to 2, leader changed from e6537a4c3753400e8bba662080f00b7d (127.6.215.66) to 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65). New cstate: current_term: 2 leader_uuid: "93a60cf4fc4e47298fad3224ae393a4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.473019 17801 raft_consensus.cc:740] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:43.473804 17801 consensus_queue.cc:260] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.474875 17801 raft_consensus.cc:3060] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.478864 17647 raft_consensus.cc:2468] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:43.480023 17693 leader_election.cc:304] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a60cf4fc4e47298fad3224ae393a4e, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:43.480717 17992 raft_consensus.cc:2804] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.481102 17992 raft_consensus.cc:697] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Leader. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:43.481825 17992 consensus_queue.cc:237] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:43.482198 17801 raft_consensus.cc:2468] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6537a4c3753400e8bba662080f00b7d in term 2.
I20260709 13:07:43.488780 17550 catalog_manager.cc:5697] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d reported cstate change: term changed from 1 to 2, leader changed from 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67) to e6537a4c3753400e8bba662080f00b7d (127.6.215.66). New cstate: current_term: 2 leader_uuid: "e6537a4c3753400e8bba662080f00b7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.646322 17647 raft_consensus.cc:1275] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.647466 17992 consensus_queue.cc:1048] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.654351 17801 raft_consensus.cc:1275] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.655913 18045 consensus_queue.cc:1048] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.822714 17801 raft_consensus.cc:1275] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.823956 18043 consensus_queue.cc:1048] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.831135 17647 raft_consensus.cc:1275] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.832716 18045 consensus_queue.cc:1048] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.929733 17726 raft_consensus.cc:1275] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.930905 17999 consensus_queue.cc:1048] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.939461 17801 raft_consensus.cc:1275] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.941107 17999 consensus_queue.cc:1048] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.946377 17801 raft_consensus.cc:1275] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.947687 17999 consensus_queue.cc:1048] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.954226 17647 raft_consensus.cc:1275] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.956701 18009 consensus_queue.cc:1048] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.956871 17726 raft_consensus.cc:1275] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 93a60cf4fc4e47298fad3224ae393a4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.958727 17932 consensus_queue.cc:1048] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.976127 17801 raft_consensus.cc:1275] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.977699 18043 consensus_queue.cc:1048] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.980667 17726 raft_consensus.cc:1275] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.984149 18009 consensus_queue.cc:1048] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.987471 17647 raft_consensus.cc:1275] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Refusing update from remote peer e6537a4c3753400e8bba662080f00b7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.991015 18043 consensus_queue.cc:1048] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:46.214964 17548 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47808:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:07:46.243058 17548 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47808:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:07:46.285187  7005 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:46.474253 17618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.67:45477, user_credentials={real_user=slave}} blocked reactor thread for 51806.4us
W20260709 13:07:46.489483 17619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.215.66:40467, user_credentials={real_user=slave}} blocked reactor thread for 53504.7us
I20260709 13:07:46.623420 17726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558"
dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
mode: GRACEFUL
new_leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:44660
I20260709 13:07:46.624251 17726 raft_consensus.cc:606] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Received request to transfer leadership to TS 7c224ad6ecab4bda8d05a8575cd52774
I20260709 13:07:46.634742 18095 raft_consensus.cc:993] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: : Instructing follower 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:46.635282 18095 raft_consensus.cc:1081] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Signalling peer 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:46.658339 17799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:38174
I20260709 13:07:46.659543 17799 raft_consensus.cc:493] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.660038 17799 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:46.672531 17799 raft_consensus.cc:515] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:46.684305 17799 leader_election.cc:290] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 3 election: Requested vote from peers 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633), e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467)
I20260709 13:07:46.686478 17728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:46.687232 17728 raft_consensus.cc:3055] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:46.687495 17728 raft_consensus.cc:740] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6537a4c3753400e8bba662080f00b7d, State: Running, Role: LEADER
I20260709 13:07:46.688503 17728 consensus_queue.cc:260] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:46.690371 17728 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:46.677726 18120 tablet.cc:1724] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.712425 17728 raft_consensus.cc:2468] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 3.
I20260709 13:07:46.718667 17768 leader_election.cc:304] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, e6537a4c3753400e8bba662080f00b7d; no voters: 
I20260709 13:07:46.720148 18050 raft_consensus.cc:2804] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:46.766480 18112 tablet.cc:1724] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.769841 18116 tablet.cc:1724] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.775309 18121 tablet.cc:1724] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.778254 18113 tablet.cc:1724] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.781540 18114 tablet.cc:1724] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.764276 18111 tablet.cc:1724] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.813412 18108 tablet.cc:1724] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.823292 18105 tablet.cc:1724] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.841593 18112 tablet.cc:1724] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.837265 18050 raft_consensus.cc:697] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:46.885991 18050 consensus_queue.cc:237] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } }
I20260709 13:07:46.820842 18109 tablet.cc:1724] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.905745 18112 tablet.cc:1724] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.907692 18118 tablet.cc:1724] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.908869 18102 tablet.cc:1724] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.934623 17548 catalog_manager.cc:5789] TS e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467) does not have the latest schema for tablet 90fc7ecf798e49fda56eb67e6fe2b202 (table soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]). Expected version 1 got 0
I20260709 13:07:46.936066 17548 catalog_manager.cc:5789] TS e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467) does not have the latest schema for tablet 98c348564c4941d8bb6b605bcb70288b (table soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]). Expected version 1 got 0
I20260709 13:07:46.936708 17548 catalog_manager.cc:5789] TS e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467) does not have the latest schema for tablet 480882de823c4b938ea823faa2c2c6a4 (table soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]). Expected version 1 got 0
I20260709 13:07:46.929237 18116 tablet.cc:1724] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.930799 18114 tablet.cc:1724] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.932166 18120 tablet.cc:1724] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.952337 17653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19581d1a91374a01bfc271ffc9ea6558" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:46.953094 17653 raft_consensus.cc:3060] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:46.956455 18109 tablet.cc:1724] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.961035 17653 raft_consensus.cc:2468] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 3.
I20260709 13:07:46.966917 18109 tablet.cc:1724] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.975797 17653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5"
dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
mode: GRACEFUL
new_leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:58142
I20260709 13:07:46.977192 17653 raft_consensus.cc:606] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 LEADER]: Received request to transfer leadership to TS 7c224ad6ecab4bda8d05a8575cd52774
I20260709 13:07:46.976969 18109 tablet.cc:1724] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.978982  7005 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:46.979748  7005 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:46.975697 18120 tablet.cc:1724] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.982173 18114 tablet.cc:1724] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.994551 18116 tablet.cc:1724] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:46.995458 18049 raft_consensus.cc:993] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: : Instructing follower 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:46.995934 18049 raft_consensus.cc:1081] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 LEADER]: Signalling peer 7c224ad6ecab4bda8d05a8575cd52774 to start an election
I20260709 13:07:46.996479 18121 tablet.cc:1724] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:47.005141 17795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5"
dest_uuid: "7c224ad6ecab4bda8d05a8575cd52774"
 from {username='slave'} at 127.0.0.1:38170
I20260709 13:07:47.005846 17795 raft_consensus.cc:493] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:47.006228 17795 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:47.019142 17795 raft_consensus.cc:515] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:47.024513 17795 leader_election.cc:290] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 4 election: Requested vote from peers e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467), 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633)
I20260709 13:07:47.025214 17723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e6537a4c3753400e8bba662080f00b7d"
I20260709 13:07:47.025377 17653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4c9cc396ae4bb5a08beed6d56412f5" candidate_uuid: "7c224ad6ecab4bda8d05a8575cd52774" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "93a60cf4fc4e47298fad3224ae393a4e"
I20260709 13:07:47.025995 17723 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:47.026048 17653 raft_consensus.cc:3055] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:47.026499 17653 raft_consensus.cc:740] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93a60cf4fc4e47298fad3224ae393a4e, State: Running, Role: LEADER
I20260709 13:07:47.027396 18120 tablet.cc:1724] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:47.027925 17653 consensus_queue.cc:260] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:47.031250 17653 raft_consensus.cc:3060] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:47.035859 17549 catalog_manager.cc:5789] TS 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633) does not have the latest schema for tablet fdc6ef2bd2394e0ba87c1f29653eace1 (table soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]). Expected version 1 got 0
I20260709 13:07:47.036648 17549 catalog_manager.cc:5789] TS 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633) does not have the latest schema for tablet d0cfe5ce842b4bd28642566bf44dad2d (table soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]). Expected version 1 got 0
I20260709 13:07:47.038298 17549 catalog_manager.cc:5789] TS 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633) does not have the latest schema for tablet a480ab4624b544dbbf66924d1c475cd4 (table soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04]). Expected version 1 got 0
I20260709 13:07:47.038442 17653 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 4.
I20260709 13:07:47.040031 17767 leader_election.cc:304] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c224ad6ecab4bda8d05a8575cd52774, 93a60cf4fc4e47298fad3224ae393a4e; no voters: 
I20260709 13:07:47.041615 18126 raft_consensus.cc:2804] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:47.042074 18126 raft_consensus.cc:697] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 4 LEADER]: Becoming Leader. State: Replica: 7c224ad6ecab4bda8d05a8575cd52774, State: Running, Role: LEADER
I20260709 13:07:47.041915 17550 catalog_manager.cc:5697] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 2 to 3, leader changed from e6537a4c3753400e8bba662080f00b7d (127.6.215.66) to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 3 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.043002 18126 consensus_queue.cc:237] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } }
I20260709 13:07:47.029445 18116 tablet.cc:1724] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:47.019593 18118 tablet.cc:1724] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:47.080933 17723 raft_consensus.cc:2468] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c224ad6ecab4bda8d05a8575cd52774 in term 4.
I20260709 13:07:47.104792 17550 catalog_manager.cc:5697] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 reported cstate change: term changed from 3 to 4, leader changed from 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65) to 7c224ad6ecab4bda8d05a8575cd52774 (127.6.215.67). New cstate: current_term: 4 leader_uuid: "7c224ad6ecab4bda8d05a8575cd52774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c224ad6ecab4bda8d05a8575cd52774" member_type: VOTER last_known_addr { host: "127.6.215.67" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.111579 17548 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281: soft_deleted_table [id=8d1f74e843fd40ebb19d2e9d459d6a04] alter complete (version 1)
I20260709 13:07:47.339473 17723 raft_consensus.cc:1275] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 3 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:47.340567 18050 consensus_queue.cc:1048] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.348768 17653 raft_consensus.cc:1275] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:47.350172 18050 consensus_queue.cc:1048] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.590914 17723 raft_consensus.cc:1275] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 4 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:47.591941 18050 consensus_queue.cc:1048] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6537a4c3753400e8bba662080f00b7d" member_type: VOTER last_known_addr { host: "127.6.215.66" port: 40467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.595592 17647 raft_consensus.cc:1275] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 4 FOLLOWER]: Refusing update from remote peer 7c224ad6ecab4bda8d05a8575cd52774: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:47.596652 18050 consensus_queue.cc:1048] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a60cf4fc4e47298fad3224ae393a4e" member_type: VOTER last_known_addr { host: "127.6.215.65" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:48.034394  7005 tablet_server.cc:179] TabletServer@127.6.215.65:0 shutting down...
I20260709 13:07:48.057447  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:48.058422  7005 tablet_replica.cc:333] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.059589  7005 raft_consensus.cc:2243] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.060402  7005 raft_consensus.cc:2272] T 90fc7ecf798e49fda56eb67e6fe2b202 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.062736  7005 tablet_replica.cc:333] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.063419  7005 raft_consensus.cc:2243] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.063839  7005 raft_consensus.cc:2272] T 98c348564c4941d8bb6b605bcb70288b P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.065816  7005 tablet_replica.cc:333] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.066373  7005 raft_consensus.cc:2243] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.066782  7005 raft_consensus.cc:2272] T a5a2548442544fa4b6c34bd81fc64dc9 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.068621  7005 tablet_replica.cc:333] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.069154  7005 raft_consensus.cc:2243] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.069573  7005 raft_consensus.cc:2272] T 19581d1a91374a01bfc271ffc9ea6558 P 93a60cf4fc4e47298fad3224ae393a4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.071663  7005 tablet_replica.cc:333] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.072196  7005 raft_consensus.cc:2243] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.072929  7005 raft_consensus.cc:2272] T 6500bb507c4749cb8035b4ce7c74461c P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.074879  7005 tablet_replica.cc:333] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.075390  7005 raft_consensus.cc:2243] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.075754  7005 raft_consensus.cc:2272] T 64bd85e84f0849c9a929516b707f2aec P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.077617  7005 tablet_replica.cc:333] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.078219  7005 raft_consensus.cc:2243] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.078585  7005 raft_consensus.cc:2272] T 480882de823c4b938ea823faa2c2c6a4 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.080758  7005 tablet_replica.cc:333] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.081380  7005 raft_consensus.cc:2243] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.082090  7005 raft_consensus.cc:2272] T d0cfe5ce842b4bd28642566bf44dad2d P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.083936  7005 tablet_replica.cc:333] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.084439  7005 raft_consensus.cc:2243] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.085148  7005 raft_consensus.cc:2272] T fdc6ef2bd2394e0ba87c1f29653eace1 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.086899  7005 tablet_replica.cc:333] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.087376  7005 raft_consensus.cc:2243] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.088073  7005 raft_consensus.cc:2272] T 568bd150e77943d6887eec075264bdf2 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.090075  7005 tablet_replica.cc:333] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.090566  7005 raft_consensus.cc:2243] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.090910  7005 raft_consensus.cc:2272] T ac4c9cc396ae4bb5a08beed6d56412f5 P 93a60cf4fc4e47298fad3224ae393a4e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.093317  7005 tablet_replica.cc:333] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.093852  7005 raft_consensus.cc:2243] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.094225  7005 raft_consensus.cc:2272] T 52a4704f7c374728868027127171513f P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.096287  7005 tablet_replica.cc:333] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.096765  7005 raft_consensus.cc:2243] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.097523  7005 raft_consensus.cc:2272] T a480ab4624b544dbbf66924d1c475cd4 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.099480  7005 tablet_replica.cc:333] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.099958  7005 raft_consensus.cc:2243] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.100780  7005 raft_consensus.cc:2272] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.102960  7005 tablet_replica.cc:333] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.103468  7005 raft_consensus.cc:2243] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.104166  7005 raft_consensus.cc:2272] T 359bae5c513c4be193f7d42aed1250e6 P 93a60cf4fc4e47298fad3224ae393a4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.106295  7005 tablet_replica.cc:333] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.106801  7005 raft_consensus.cc:2243] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.107549  7005 raft_consensus.cc:2272] T 44b8cc8a5741468cb5d9a3876e020188 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.109668  7005 tablet_replica.cc:333] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.110128  7005 raft_consensus.cc:2243] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.110525  7005 raft_consensus.cc:2272] T b6e4003d1f254fbca9c2a3157b56b968 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.112694  7005 tablet_replica.cc:333] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e: stopping tablet replica
I20260709 13:07:48.113163  7005 raft_consensus.cc:2243] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.113592  7005 raft_consensus.cc:2272] T 8db72511366941e88df0a824a3d4cb79 P 93a60cf4fc4e47298fad3224ae393a4e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:48.118888 17693 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:07:48.122490 17693 consensus_peers.cc:597] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d -> Peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Couldn't send request to peer 93a60cf4fc4e47298fad3224ae393a4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:48.124892 17693 consensus_peers.cc:597] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d -> Peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Couldn't send request to peer 93a60cf4fc4e47298fad3224ae393a4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:48.136224 17767 consensus_peers.cc:597] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 -> Peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Couldn't send request to peer 93a60cf4fc4e47298fad3224ae393a4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.156498  7005 tablet_server.cc:196] TabletServer@127.6.215.65:0 shutdown complete.
W20260709 13:07:48.191536 17693 consensus_peers.cc:597] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d -> Peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Couldn't send request to peer 93a60cf4fc4e47298fad3224ae393a4e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.193219  7005 tablet_server.cc:179] TabletServer@127.6.215.66:0 shutting down...
W20260709 13:07:48.200996 17768 consensus_peers.cc:597] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 -> Peer e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467): Couldn't send request to peer e6537a4c3753400e8bba662080f00b7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.217829  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:48.218518  7005 tablet_replica.cc:333] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.219269  7005 raft_consensus.cc:2243] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.220198  7005 raft_consensus.cc:2272] T 90fc7ecf798e49fda56eb67e6fe2b202 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.222790  7005 tablet_replica.cc:333] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.223387  7005 raft_consensus.cc:2243] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.224342  7005 raft_consensus.cc:2272] T 98c348564c4941d8bb6b605bcb70288b P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.227035  7005 tablet_replica.cc:333] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.227800  7005 raft_consensus.cc:2243] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.228652  7005 raft_consensus.cc:2272] T a5a2548442544fa4b6c34bd81fc64dc9 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:48.228938 17768 consensus_peers.cc:597] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 -> Peer e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467): Couldn't send request to peer e6537a4c3753400e8bba662080f00b7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.230845  7005 tablet_replica.cc:333] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.231478  7005 raft_consensus.cc:2243] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.232208  7005 raft_consensus.cc:2272] T 480882de823c4b938ea823faa2c2c6a4 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.234323  7005 tablet_replica.cc:333] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.234982  7005 raft_consensus.cc:2243] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.235399  7005 raft_consensus.cc:2272] T 64bd85e84f0849c9a929516b707f2aec P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.237165  7005 tablet_replica.cc:333] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.237701  7005 raft_consensus.cc:2243] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.238102  7005 raft_consensus.cc:2272] T d0cfe5ce842b4bd28642566bf44dad2d P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.240348  7005 tablet_replica.cc:333] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.240867  7005 raft_consensus.cc:2243] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.241706  7005 raft_consensus.cc:2272] T 359bae5c513c4be193f7d42aed1250e6 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.243767  7005 tablet_replica.cc:333] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.244318  7005 raft_consensus.cc:2243] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.244724  7005 raft_consensus.cc:2272] T a480ab4624b544dbbf66924d1c475cd4 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.246877  7005 tablet_replica.cc:333] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.247429  7005 raft_consensus.cc:2243] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.247830  7005 raft_consensus.cc:2272] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.249806  7005 tablet_replica.cc:333] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.250314  7005 raft_consensus.cc:2243] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.250746  7005 raft_consensus.cc:2272] T b6e4003d1f254fbca9c2a3157b56b968 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.253103  7005 tablet_replica.cc:333] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.253643  7005 raft_consensus.cc:2243] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.254103  7005 raft_consensus.cc:2272] T 44b8cc8a5741468cb5d9a3876e020188 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.256158  7005 tablet_replica.cc:333] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.256714  7005 raft_consensus.cc:2243] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.257079  7005 raft_consensus.cc:2272] T fdc6ef2bd2394e0ba87c1f29653eace1 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.258976  7005 tablet_replica.cc:333] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.259454  7005 raft_consensus.cc:2243] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.259943  7005 raft_consensus.cc:2272] T 568bd150e77943d6887eec075264bdf2 P e6537a4c3753400e8bba662080f00b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.261957  7005 tablet_replica.cc:333] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.262463  7005 raft_consensus.cc:2243] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.263235  7005 raft_consensus.cc:2272] T 52a4704f7c374728868027127171513f P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.265204  7005 tablet_replica.cc:333] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.265708  7005 raft_consensus.cc:2243] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.266183  7005 raft_consensus.cc:2272] T ac4c9cc396ae4bb5a08beed6d56412f5 P e6537a4c3753400e8bba662080f00b7d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.269254  7005 tablet_replica.cc:333] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.269820  7005 raft_consensus.cc:2243] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.270206  7005 raft_consensus.cc:2272] T 6500bb507c4749cb8035b4ce7c74461c P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.272181  7005 tablet_replica.cc:333] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.272609  7005 raft_consensus.cc:2243] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.273188  7005 raft_consensus.cc:2272] T 19581d1a91374a01bfc271ffc9ea6558 P e6537a4c3753400e8bba662080f00b7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.276503  7005 tablet_replica.cc:333] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d: stopping tablet replica
I20260709 13:07:48.276964  7005 raft_consensus.cc:2243] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.277812  7005 raft_consensus.cc:2272] T 8db72511366941e88df0a824a3d4cb79 P e6537a4c3753400e8bba662080f00b7d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:48.319314 17768 consensus_peers.cc:597] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 -> Peer e6537a4c3753400e8bba662080f00b7d (127.6.215.66:40467): Couldn't send request to peer e6537a4c3753400e8bba662080f00b7d. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.66:40467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.320822  7005 tablet_server.cc:196] TabletServer@127.6.215.66:0 shutdown complete.
W20260709 13:07:48.355471 17767 consensus_peers.cc:597] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 -> Peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Couldn't send request to peer 93a60cf4fc4e47298fad3224ae393a4e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.356952  7005 tablet_server.cc:179] TabletServer@127.6.215.67:0 shutting down...
W20260709 13:07:48.378712 17767 consensus_peers.cc:597] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 -> Peer 93a60cf4fc4e47298fad3224ae393a4e (127.6.215.65:40633): Couldn't send request to peer 93a60cf4fc4e47298fad3224ae393a4e. Status: Network error: Client connection negotiation failed: client connection to 127.6.215.65:40633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.387545  7005 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:48.388298  7005 tablet_replica.cc:333] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.388963  7005 raft_consensus.cc:2243] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.389434  7005 raft_consensus.cc:2272] T 90fc7ecf798e49fda56eb67e6fe2b202 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.391505  7005 tablet_replica.cc:333] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.392028  7005 raft_consensus.cc:2243] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.392454  7005 raft_consensus.cc:2272] T 98c348564c4941d8bb6b605bcb70288b P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.394273  7005 tablet_replica.cc:333] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.395000  7005 raft_consensus.cc:2243] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.395488  7005 raft_consensus.cc:2272] T a5a2548442544fa4b6c34bd81fc64dc9 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.398030  7005 tablet_replica.cc:333] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.398692  7005 raft_consensus.cc:2243] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.399137  7005 raft_consensus.cc:2272] T 8db72511366941e88df0a824a3d4cb79 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.401223  7005 tablet_replica.cc:333] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.401751  7005 raft_consensus.cc:2243] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.402138  7005 raft_consensus.cc:2272] T 359bae5c513c4be193f7d42aed1250e6 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.404021  7005 tablet_replica.cc:333] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.404510  7005 raft_consensus.cc:2243] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.404889  7005 raft_consensus.cc:2272] T a480ab4624b544dbbf66924d1c475cd4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.406667  7005 tablet_replica.cc:333] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.407199  7005 raft_consensus.cc:2243] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.407608  7005 raft_consensus.cc:2272] T 60549dbf5f124f1fb8a0a3afd74aa8b8 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.409556  7005 tablet_replica.cc:333] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.410071  7005 raft_consensus.cc:2243] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.410480  7005 raft_consensus.cc:2272] T 44b8cc8a5741468cb5d9a3876e020188 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.412473  7005 tablet_replica.cc:333] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.412961  7005 raft_consensus.cc:2243] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.413846  7005 raft_consensus.cc:2272] T b6e4003d1f254fbca9c2a3157b56b968 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.416328  7005 tablet_replica.cc:333] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.416880  7005 raft_consensus.cc:2243] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.417286  7005 raft_consensus.cc:2272] T 568bd150e77943d6887eec075264bdf2 P 7c224ad6ecab4bda8d05a8575cd52774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.419759  7005 tablet_replica.cc:333] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.420259  7005 raft_consensus.cc:2243] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.420646  7005 raft_consensus.cc:2272] T fdc6ef2bd2394e0ba87c1f29653eace1 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.422570  7005 tablet_replica.cc:333] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.423044  7005 raft_consensus.cc:2243] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.423734  7005 raft_consensus.cc:2272] T 19581d1a91374a01bfc271ffc9ea6558 P 7c224ad6ecab4bda8d05a8575cd52774 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.425797  7005 tablet_replica.cc:333] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.426276  7005 raft_consensus.cc:2243] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.426667  7005 raft_consensus.cc:2272] T 6500bb507c4749cb8035b4ce7c74461c P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.428443  7005 tablet_replica.cc:333] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.428908  7005 raft_consensus.cc:2243] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.429639  7005 raft_consensus.cc:2272] T 64bd85e84f0849c9a929516b707f2aec P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.431329  7005 tablet_replica.cc:333] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.431903  7005 raft_consensus.cc:2243] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.432350  7005 raft_consensus.cc:2272] T 480882de823c4b938ea823faa2c2c6a4 P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.434149  7005 tablet_replica.cc:333] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.434651  7005 raft_consensus.cc:2243] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.435053  7005 raft_consensus.cc:2272] T d0cfe5ce842b4bd28642566bf44dad2d P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.437211  7005 tablet_replica.cc:333] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.437983  7005 raft_consensus.cc:2243] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:48.438385  7005 raft_consensus.cc:2272] T 52a4704f7c374728868027127171513f P 7c224ad6ecab4bda8d05a8575cd52774 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.440243  7005 tablet_replica.cc:333] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774: stopping tablet replica
I20260709 13:07:48.440655  7005 raft_consensus.cc:2243] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.441303  7005 raft_consensus.cc:2272] T ac4c9cc396ae4bb5a08beed6d56412f5 P 7c224ad6ecab4bda8d05a8575cd52774 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.481287  7005 tablet_server.cc:196] TabletServer@127.6.215.67:0 shutdown complete.
I20260709 13:07:48.514487  7005 master.cc:562] Master@127.6.215.126:40441 shutting down...
I20260709 13:07:48.532912  7005 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:48.533671  7005 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:48.534099  7005 tablet_replica.cc:333] T 00000000000000000000000000000000 P 913a1b4f54fd462baf2c5ddfe386d281: stopping tablet replica
I20260709 13:07:48.554221  7005 master.cc:584] Master@127.6.215.126:40441 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13058 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25605 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (336157 ms total)
[  PASSED  ] 8 tests.
I20260709 13:07:48.605893  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 386 messages since previous log ~15 seconds ago
I20260709 13:07:48.606117  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 386 messages since previous log ~15 seconds ago
I20260709 13:07:48.606281  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 385 messages since previous log ~15 seconds ago
I20260709 13:07:48.606457  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:07:48.606640  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:07:48.606841  7005 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 4 messages since previous log ~213 seconds ago
I20260709 13:07:48.607004  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~213 seconds ago
I20260709 13:07:48.607184  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~166 seconds ago
I20260709 13:07:48.607402  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:07:48.607676  7005 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
